-- Logs begin at Thu 2022-08-18 10:18:03 UTC, end at Thu 2022-08-18 11:24:50 UTC. -- Aug 18 10:48:29.029089 dv-cinder-826608-10-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Aug 18 10:48:29.039604 dv-cinder-826608-10-iscsi devstack@keystone.service[81419]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 18 10:48:29.041906 dv-cinder-826608-10-iscsi devstack@keystone.service[81419]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 18 10:48:29 2022] *** Aug 18 10:48:29.041906 dv-cinder-826608-10-iscsi devstack@keystone.service[81419]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 18 10:48:29.041906 dv-cinder-826608-10-iscsi devstack@keystone.service[81419]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 18 10:48:29.041906 dv-cinder-826608-10-iscsi devstack@keystone.service[81419]: nodename: dv-cinder-826608-10-iscsi Aug 18 10:48:29.041906 dv-cinder-826608-10-iscsi devstack@keystone.service[81419]: machine: x86_64 Aug 18 10:48:29.041906 dv-cinder-826608-10-iscsi devstack@keystone.service[81419]: clock source: unix Aug 18 10:48:29.041906 dv-cinder-826608-10-iscsi devstack@keystone.service[81419]: pcre jit disabled Aug 18 10:48:29.041906 dv-cinder-826608-10-iscsi devstack@keystone.service[81419]: detected number of CPU cores: 4 Aug 18 10:48:29.041906 dv-cinder-826608-10-iscsi devstack@keystone.service[81419]: current working directory: / Aug 18 10:48:29.041906 dv-cinder-826608-10-iscsi devstack@keystone.service[81419]: detected binary path: /usr/bin/uwsgi-core Aug 18 10:48:29.041906 dv-cinder-826608-10-iscsi devstack@keystone.service[81419]: your processes number limit is 47680 Aug 18 10:48:29.041906 dv-cinder-826608-10-iscsi devstack@keystone.service[81419]: your memory page size is 4096 bytes Aug 18 10:48:29.041906 dv-cinder-826608-10-iscsi devstack@keystone.service[81419]: detected max file descriptor number: 2048 Aug 18 10:48:29.041906 dv-cinder-826608-10-iscsi devstack@keystone.service[81419]: lock engine: pthread robust mutexes Aug 18 10:48:29.042713 dv-cinder-826608-10-iscsi devstack@keystone.service[81419]: thunder lock: enabled Aug 18 10:48:29.042713 dv-cinder-826608-10-iscsi devstack@keystone.service[81419]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 18 10:48:29.042713 dv-cinder-826608-10-iscsi devstack@keystone.service[81419]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 18 10:48:29.081493 dv-cinder-826608-10-iscsi devstack@keystone.service[81419]: Python main interpreter initialized at 0x55c83100b9c0 Aug 18 10:48:29.081493 dv-cinder-826608-10-iscsi devstack@keystone.service[81419]: python threads support enabled Aug 18 10:48:29.081493 dv-cinder-826608-10-iscsi devstack@keystone.service[81419]: your server socket listen backlog is limited to 100 connections Aug 18 10:48:29.081493 dv-cinder-826608-10-iscsi devstack@keystone.service[81419]: your mercy for graceful operations on workers is 90 seconds Aug 18 10:48:29.081899 dv-cinder-826608-10-iscsi devstack@keystone.service[81419]: mapped 403077 bytes (393 KB) for 2 cores Aug 18 10:48:29.081977 dv-cinder-826608-10-iscsi devstack@keystone.service[81419]: *** Operational MODE: preforking *** Aug 18 10:48:29.082228 dv-cinder-826608-10-iscsi devstack@keystone.service[81419]: *** uWSGI is running in multiple interpreter mode *** Aug 18 10:48:29.082228 dv-cinder-826608-10-iscsi devstack@keystone.service[81419]: spawned uWSGI master process (pid: 81419) Aug 18 10:48:29.082445 dv-cinder-826608-10-iscsi systemd[1]: Started Devstack devstack@keystone.service. Aug 18 10:48:29.083263 dv-cinder-826608-10-iscsi devstack@keystone.service[81419]: spawned uWSGI worker 1 (pid: 81432, cores: 1) Aug 18 10:48:29.083349 dv-cinder-826608-10-iscsi devstack@keystone.service[81419]: spawned uWSGI worker 2 (pid: 81433, cores: 1) Aug 18 10:48:29.084292 dv-cinder-826608-10-iscsi devstack@keystone.service[81419]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 18 10:48:33.449036 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 10:48:33.449036 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: from cryptography.utils import int_from_bytes Aug 18 10:48:33.449856 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 10:48:33.449856 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: from cryptography.utils import int_from_bytes Aug 18 10:48:33.455346 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 10:48:33.455346 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: from cryptography.utils import int_from_bytes Aug 18 10:48:33.455817 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 10:48:33.455817 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: from cryptography.utils import int_from_bytes Aug 18 10:48:33.501188 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 18 10:48:33.501410 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 18 10:48:33.501574 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] command line args: [] {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 18 10:48:33.501845 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 18 10:48:33.502022 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] ================================================================================ {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 18 10:48:33.502273 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] admin_token = **** {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:48:33.502515 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] config_dir = [] {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:48:33.502701 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:48:33.502882 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] config_source = [] {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:48:33.503060 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] debug = True {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:48:33.503259 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:48:33.503629 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:48:33.503806 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:48:33.504057 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:48:33.504303 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:48:33.504576 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] list_limit = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:48:33.504707 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] log_config_append = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:48:33.504847 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 18 10:48:33.504934 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:48:33.505088 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 18 10:48:33.505191 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] log_dir = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:48:33.505191 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] log_file = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:48:33.505387 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] command line args: [] {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 18 10:48:33.505490 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:48:33.505634 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 18 10:48:33.505721 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:48:33.505923 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:48:33.506007 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] ================================================================================ {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 18 10:48:33.506175 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:48:33.506260 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] admin_token = **** {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:48:33.506383 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:48:33.506466 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] config_dir = [] {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:48:33.506544 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:48:33.506672 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:48:33.506754 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:48:33.506826 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] config_source = [] {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:48:33.506940 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] debug = True {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:48:33.507021 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:48:33.507128 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:48:33.507241 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:48:33.507366 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:48:33.507444 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:48:33.507546 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:48:33.507623 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:48:33.507798 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:48:33.507883 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:48:33.508046 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:48:33.508124 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:48:33.508280 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] list_limit = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:48:33.508364 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:48:33.508445 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] log_config_append = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:48:33.508563 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:48:33.508685 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:48:33.508823 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] log_dir = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:48:33.508953 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] log_file = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:48:33.509065 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.15/identity {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:48:33.509199 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:48:33.509276 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] publish_errors = False {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:48:33.509423 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:48:33.509572 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:48:33.509695 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:48:33.509776 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:48:33.509954 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:48:33.510039 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:48:33.510154 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:48:33.510242 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:48:33.510830 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:48:33.510964 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:48:33.511090 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:48:33.511178 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] standard_threads = False {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:48:33.511304 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:48:33.511404 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:48:33.511511 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:48:33.511643 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:48:33.511756 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:48:33.511840 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:48:33.511919 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] use_journal = False {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:48:33.512086 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:48:33.512171 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] use_json = False {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:48:33.512242 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] use_stderr = False {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:48:33.512364 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:48:33.512459 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] use_syslog = False {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:48:33.512563 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:48:33.512648 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:48:33.512881 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.513035 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:48:33.513112 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.513313 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:48:33.513399 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.513608 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.513851 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.15/identity {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:48:33.513931 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.514086 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] publish_errors = False {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:48:33.514164 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.514262 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:48:33.514347 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.514495 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:48:33.514574 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.514676 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:48:33.514775 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.514924 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:48:33.515008 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.515215 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:48:33.515303 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.515453 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] standard_threads = False {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:48:33.515533 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.515711 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.515946 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.516193 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.516270 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:48:33.516440 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.516676 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.516918 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:48:33.516996 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.517101 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:48:33.517186 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.517266 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] use_journal = False {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:48:33.517398 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.517477 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] use_json = False {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:48:33.517647 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] use_stderr = False {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:48:33.517725 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.517828 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] use_syslog = False {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:48:33.517916 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.518064 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:48:33.518148 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.518322 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.518401 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.518563 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.518648 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.518825 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.518910 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.519052 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.519129 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.519282 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.519361 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.519530 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.519606 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.519781 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.519865 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.520012 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.520087 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.520255 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.520340 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.520531 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.520779 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.520872 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.521025 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.521261 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.521509 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.521610 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.521758 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.521849 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.522247 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.522331 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.522481 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.522560 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.522710 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.522796 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.522940 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.523018 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.523169 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.523246 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.523398 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.523485 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.523634 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.523717 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.523881 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.523964 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.524110 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.524196 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.524346 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.524426 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.524583 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.524704 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.524813 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.524906 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.525045 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.525124 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.525296 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.525384 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.525536 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.525782 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.526654 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.526891 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.526981 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.527128 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.527266 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.527440 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.527518 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.527589 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.527659 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.527812 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.527900 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.528046 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.528133 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.528281 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.528373 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.528511 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.528607 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.528772 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.528942 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.529082 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.529229 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.529368 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.529560 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.529736 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.529877 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.529993 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.530100 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.530204 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.530305 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.530478 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.530634 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.530634 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.530879 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.530994 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.531099 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.531267 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.531437 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.531557 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.531675 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.531807 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.531924 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.532051 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.532169 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.532284 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.532458 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.532537 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.532617 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.532691 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.532769 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.532769 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.532769 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.532957 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.533024 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.533132 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.533352 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.533452 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.533641 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.533718 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.533864 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.533946 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.534104 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.534233 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.534340 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.534421 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.534581 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.534656 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.534817 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.534898 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.535073 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.535167 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.535283 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.535364 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.535498 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.535578 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.535727 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.535805 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.535954 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.536033 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.536187 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.536275 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.536415 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.536495 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.536652 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.536731 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.536886 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.536973 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.537122 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.537200 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.537356 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.537433 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.537631 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.537724 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.537887 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.537965 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.538124 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.538201 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.538354 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] auth.external = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.538434 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.538582 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.538661 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.538817 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.538901 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.539053 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.539128 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.539292 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.539372 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] auth.password = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.539528 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] auth.token = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.539614 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.539767 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.539855 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.540002 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.540081 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.540238 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.540317 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.540464 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.540550 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.540700 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.540778 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.540938 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.541018 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.541164 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.541253 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.541399 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] credential.caching = True {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.541477 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.541748 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.541910 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.542046 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.542200 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.542331 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.542411 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.542483 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.542603 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.542682 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.542847 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.542937 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.543088 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.543169 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.543321 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.543401 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.543554 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.543633 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.543784 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.543865 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.544021 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.544101 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.544253 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.544333 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.544494 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.544575 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.544731 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.544810 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.544979 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.545066 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.545218 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.545299 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] federation.caching = True {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.545474 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.545573 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.545758 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.545838 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.545997 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.546076 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.546225 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.546303 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] auth.external = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.546460 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.546538 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.546693 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.546773 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.546943 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.547023 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.547178 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.547257 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] auth.password = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.547418 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] auth.token = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.547499 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.547653 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.547732 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.547887 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.547965 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.548121 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] identity.caching = True {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.548200 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.548353 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.548431 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.548597 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.548684 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.548830 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.548916 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.549062 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.549142 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.549298 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] credential.caching = True {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.549384 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.549571 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.549684 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.549810 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.549901 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.550055 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.550149 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.550287 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.550368 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.550533 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.550612 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.550770 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.550865 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.551038 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.551118 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.551280 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.551358 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.551518 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.551605 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.551761 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.551846 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.552014 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.552094 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.552261 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.552352 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.552529 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.552608 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.552766 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.552844 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.553003 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.553162 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.553239 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.553311 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] federation.caching = True {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.553455 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.553550 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.553711 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.553803 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.553948 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.554028 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.554194 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.554274 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.554435 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.554522 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.554672 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.554752 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.554901 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.554979 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.555146 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.555234 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.555397 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.555477 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.555631 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.555772 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.555917 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.556009 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.556164 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] identity.caching = True {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.556244 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.556435 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.556521 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.556660 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.556749 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.556896 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.556980 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.557130 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.557210 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.557421 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.557568 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.557683 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.557819 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.558006 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.558081 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.558154 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.558294 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.558378 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.558551 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.558630 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.558787 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.558866 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.559021 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.559102 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.559255 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.559335 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.559564 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.559670 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.559748 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.559820 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.559998 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.560087 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.560186 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.560277 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.560417 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.user = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.560497 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.560656 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.560736 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.560912 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.561001 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.561141 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.561222 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.561387 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.561468 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.561652 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.561746 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.561924 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.562059 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.562190 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.562318 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.562445 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.562580 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.562707 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.562833 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.562960 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.563087 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.563228 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.563363 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.563490 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.563616 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.563743 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.563871 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.563997 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.564131 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.564259 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.564391 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.564516 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.564645 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.564767 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.564909 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.565049 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.565178 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.565307 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.565435 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.565604 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.565747 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.565875 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.566004 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.566132 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.566261 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.566390 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.566529 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.566656 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.566783 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.566921 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.567047 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.567175 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.567312 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.567440 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.567565 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.567694 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.567822 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.567947 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.568083 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.568211 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.568300 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.568420 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.568559 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.568689 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.568823 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.568950 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.569077 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.569217 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.569348 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.user = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.569479 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.569630 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.569759 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.569885 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.569969 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] resource.caching = True {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.570099 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.570227 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.570372 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.570501 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.570626 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.570753 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.570878 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.571004 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.571138 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.571265 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.571391 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.571517 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.571643 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.571770 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.571904 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.571987 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.572164 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.572291 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.572418 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.572546 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] role.caching = True {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.572681 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.573318 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] role.driver = sql {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.573449 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.573756 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.573889 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.574013 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.574148 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.574274 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.574404 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.574543 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.574674 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.574815 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.574945 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.575075 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.575204 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.575334 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.575462 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.575599 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.575726 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.575849 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.575978 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.576102 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.576224 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.576369 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.576494 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.576624 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.576748 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.576871 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.576994 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.577125 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.577249 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.577249 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.577480 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.577623 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.577747 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.577949 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.578092 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.578225 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.578349 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.578473 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.578602 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.578740 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.578866 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.578990 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.579114 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.579237 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.579360 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.579491 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] resource.caching = True {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.579621 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.579750 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.579890 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.580020 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.580104 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.580272 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.580397 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.580520 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.580643 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.580773 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.580897 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.581030 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.581155 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.581278 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.581402 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.581553 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.581678 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.581820 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.581950 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.582080 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] role.caching = True {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.582163 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.582163 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] token.caching = True {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.582440 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] role.driver = sql {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.582577 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.582706 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.582835 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.582963 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.583092 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.583220 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.583366 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.583496 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.583624 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.583751 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.583881 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.584016 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.584146 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.584274 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.584401 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.584526 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.584654 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.584789 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.584919 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.585065 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.585209 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.585334 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.585458 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.585619 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.585739 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.585865 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.585990 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.586114 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.586239 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.586239 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.586484 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.586484 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.586746 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.586890 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.587017 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] database.connection = **** {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.587154 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.587291 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.587417 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.587540 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.587664 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.587787 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.587910 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.588042 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.588172 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.588297 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.588297 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.588569 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.589138 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.589212 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.589345 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.589468 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.589638 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.589767 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.589895 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.590035 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.590164 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.590288 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.590413 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.590540 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.590669 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.590815 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.590944 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.591072 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.591200 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.591328 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.591456 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.591591 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.591719 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.591847 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] token.caching = True {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.591973 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.592101 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.592225 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 18 10:48:33.592362 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.592362 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.592362 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.592362 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.592362 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.592362 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.592362 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.592362 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.592362 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.593325 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.593325 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.593325 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.593325 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.593325 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.593325 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.593325 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.593325 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] database.connection = **** {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.593325 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.594405 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.594405 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.594405 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.594405 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.594405 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.594998 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.594998 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.594998 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.595364 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.595673 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.595922 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.596179 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.596417 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.596664 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.596897 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.597139 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.597375 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:48:33.597569 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 18 10:48:33.618462 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 10:48:33.618690 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 10:48:33.618915 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 10:48:33.622079 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81433) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 10:48:33.622315 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81433) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 10:48:33.622545 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81433) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 10:48:33.627450 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 10:48:33.630868 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81433) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 10:48:33.656981 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 10:48:33.657214 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 10:48:33.658220 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81433) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 10:48:33.658451 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81433) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 10:48:33.710926 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 10:48:33.711711 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81433) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 10:48:33.760099 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 10:48:33.760867 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 10:48:33.761404 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81433) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 10:48:33.761669 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81433) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 10:48:33.922327 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81433) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 10:48:33.922598 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 10:48:33.922598 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 10:48:33.922862 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81433) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 10:48:33.923015 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 10:48:33.923148 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81433) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 10:48:33.923277 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 10:48:33.923417 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81433) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 10:48:33.923546 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 10:48:33.923680 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81433) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 10:48:33.923812 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 10:48:33.923939 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81433) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 10:48:33.946876 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81433) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 10:48:33.947070 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 10:48:33.947207 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81433) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 10:48:33.947353 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 10:48:33.947482 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81433) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 10:48:33.947608 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 10:48:33.947608 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 10:48:33.947877 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81433) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 10:48:33.951809 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 10:48:33.951992 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81433) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 10:48:33.952134 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 10:48:33.952268 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81433) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 10:48:33.952470 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 10:48:33.952615 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81433) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 10:48:33.960076 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81433) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 10:48:33.960240 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 10:48:33.973350 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81433) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 10:48:33.973601 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81433) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 10:48:33.973787 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81433) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 10:48:33.974016 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81433) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 10:48:33.974239 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81433) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 10:48:33.974455 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81433) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 10:48:33.974584 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 10:48:33.974715 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81433) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 10:48:33.974853 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 10:48:33.974980 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 10:48:33.975105 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 10:48:33.975302 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 10:48:33.975518 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 10:48:33.975729 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 10:48:33.991526 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:33.991734 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 18 10:48:33.992033 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:33.992167 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:33.992296 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 18 10:48:33.992438 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 18 10:48:33.992567 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:33.992692 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:33.992826 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 18 10:48:33.992966 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:33.993104 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:33.993281 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:33.993411 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:33.993559 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:33.993829 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:33.994095 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.003379 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.003658 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.003929 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.004214 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.004357 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.004556 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.004829 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.005111 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.011834 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81432) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 10:48:34.012780 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81433) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 10:48:34.014738 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81432) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 10:48:34.015023 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.015307 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.015593 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.015732 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81433) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 10:48:34.015866 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.016008 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.016142 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.016273 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.016403 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.016531 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.016669 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.016800 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.017014 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.017152 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.017296 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.017434 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.017603 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.017736 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.017997 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.018279 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.018555 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.040389 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.041891 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81432) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 10:48:34.042041 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.042171 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.043525 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81433) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 10:48:34.043805 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.046838 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81432) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 10:48:34.047116 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.047400 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.048497 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81433) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 10:48:34.048783 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.049070 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.053767 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81432) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 10:48:34.054049 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.055470 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81433) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 10:48:34.055760 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.058766 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81432) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 10:48:34.059059 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.059342 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.059622 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.059894 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.060168 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.060445 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.060604 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81433) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 10:48:34.060735 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.060862 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.061053 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.061342 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.061648 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.061929 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.062204 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.062479 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.078654 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.078933 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.080362 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.080650 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.082834 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81432) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 10:48:34.084682 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81433) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 10:48:34.086049 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.086343 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.087924 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.088223 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.090602 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81432) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 10:48:34.092496 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81433) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 10:48:34.093742 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81432) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 10:48:34.095660 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81433) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 10:48:34.096954 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.097253 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.097556 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.097846 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.098125 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.098414 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.098927 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.099232 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.099521 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.099809 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.100097 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.100669 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.114368 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81432) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 10:48:34.114652 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.114921 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.115185 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.116628 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81433) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 10:48:34.116930 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.117203 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.117468 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.122695 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.124241 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.124529 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.125167 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.126724 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.127008 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.127182 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81432) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 10:48:34.127466 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.127749 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.128047 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.128328 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.129682 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81433) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 10:48:34.129975 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.130269 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.130572 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.130853 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.140629 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81432) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 10:48:34.140912 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.141197 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.141480 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.141785 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.142063 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.142340 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.142938 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81433) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 10:48:34.143226 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.143512 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.143800 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.144087 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.144367 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.144658 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.158012 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81432) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 10:48:34.160584 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81433) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 10:48:34.161035 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81432) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 10:48:34.163669 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81433) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 10:48:34.163941 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.165398 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.166620 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.167191 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81432) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 10:48:34.167474 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.167771 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.168174 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.169677 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81433) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 10:48:34.169976 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.170278 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.174298 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.175757 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81432) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 10:48:34.176788 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.178285 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81433) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 10:48:34.178686 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.178985 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.179273 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.179551 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.181252 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.181576 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.181873 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.182679 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.188117 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81432) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 10:48:34.188411 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.188788 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.191018 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81433) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 10:48:34.191350 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.191606 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.195710 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81432) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 10:48:34.195993 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.196274 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.196550 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.196824 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.197108 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.197382 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.197676 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.198643 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.198841 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.199096 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81433) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 10:48:34.199181 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.199372 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.199453 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.199672 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.199753 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.199923 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.200007 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.202546 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.202546 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.202546 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.202546 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.202546 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.202546 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.202989 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.202989 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.202989 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.202989 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 10:48:34.234900 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55c83100b9c0 pid: 81432 (default app) Aug 18 10:48:34.237674 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55c83100b9c0 pid: 81433 (default app) Aug 18 10:48:34.238343 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8762cb-b575-48fc-a0dc-d71d2f0b60ec None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:48:34.238628 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8762cb-b575-48fc-a0dc-d71d2f0b60ec None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:48:34.238898 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8762cb-b575-48fc-a0dc-d71d2f0b60ec None None] PATH_INFO: `/v3` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:48:34.243077 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1/1] 10.222.0.15 () {50 vars in 791 bytes} [Thu Aug 18 10:48:34 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:48:41.025222 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4134f6-391a-42a2-89b7-c29770b00695 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:48:41.025810 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4134f6-391a-42a2-89b7-c29770b00695 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:48:41.025902 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4134f6-391a-42a2-89b7-c29770b00695 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:48:41.030783 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1/2] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:48:41 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:48:41.036544 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3815cf4-e525-4fb0-85b2-0b8c7b748e44 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:48:41.036974 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3815cf4-e525-4fb0-85b2-0b8c7b748e44 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:48:41.037102 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3815cf4-e525-4fb0-85b2-0b8c7b748e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:48:41.107551 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: INFO dbcounter [None req-b3815cf4-e525-4fb0-85b2-0b8c7b748e44 None None] Registered counter for database keystone Aug 18 10:48:41.126738 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG oslo_db.sqlalchemy.engines [None req-b3815cf4-e525-4fb0-85b2-0b8c7b748e44 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81432) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 10:48:41.133014 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writer thread running {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 10:48:41.319212 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG passlib.handlers.bcrypt [None req-b3815cf4-e525-4fb0-85b2-0b8c7b748e44 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81432) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 18 10:48:41.319589 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG passlib.handlers.bcrypt [None req-b3815cf4-e525-4fb0-85b2-0b8c7b748e44 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81432) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 18 10:48:41.376917 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-b3815cf4-e525-4fb0-85b2-0b8c7b748e44 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:48:41.378570 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-b3815cf4-e525-4fb0-85b2-0b8c7b748e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:48:41.509463 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 2/3] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:48:41 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 474 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 18 10:48:41.997354 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4134f6-391a-42a2-89b7-c29770b00695 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:48:42.068855 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: INFO dbcounter [None req-7e4134f6-391a-42a2-89b7-c29770b00695 None None] Registered counter for database keystone Aug 18 10:48:42.091296 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG oslo_db.sqlalchemy.engines [None req-7e4134f6-391a-42a2-89b7-c29770b00695 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81433) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 10:48:42.097443 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writer thread running {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 10:48:42.221038 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4134f6-391a-42a2-89b7-c29770b00695 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:48:42.225441 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0ffdfe-c4e9-40b6-9583-69e858137a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:48:42.226117 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ffdfe-c4e9-40b6-9583-69e858137a21 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:48:42.226393 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ffdfe-c4e9-40b6-9583-69e858137a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:48:42.226667 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ffdfe-c4e9-40b6-9583-69e858137a21 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:48:42.235751 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0ffdfe-c4e9-40b6-9583-69e858137a21 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:48:42.287924 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ac0ffdfe-c4e9-40b6-9583-69e858137a21 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 18 10:48:42.288206 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0ffdfe-c4e9-40b6-9583-69e858137a21 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:48:42.298659 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 2/4] 10.222.0.15 () {58 vars in 1324 bytes} [Thu Aug 18 10:48:41 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 10:48:42.304572 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3815cf4-e525-4fb0-85b2-0b8c7b748e44 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:48:42.319816 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3815cf4-e525-4fb0-85b2-0b8c7b748e44 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:48:42.324703 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea14e7ea-ade6-4969-9d22-07510e0bc641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:48:42.325844 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14e7ea-ade6-4969-9d22-07510e0bc641 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:48:42.326133 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14e7ea-ade6-4969-9d22-07510e0bc641 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:48:42.326408 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14e7ea-ade6-4969-9d22-07510e0bc641 admin admin] PATH_INFO: `/v3/projects/8a5400fd95e746d7a23658c890ad84cd` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:48:42.328000 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea14e7ea-ade6-4969-9d22-07510e0bc641 admin admin] RBAC: Authorizing `identity:get_project(project_id=8a5400fd95e746d7a23658c890ad84cd)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:48:42.384548 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ea14e7ea-ade6-4969-9d22-07510e0bc641 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 18 10:48:42.384891 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea14e7ea-ade6-4969-9d22-07510e0bc641 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:48:42.389991 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 3/5] 10.222.0.15 () {56 vars in 1207 bytes} [Thu Aug 18 10:48:42 2022] GET /identity/v3/projects/8a5400fd95e746d7a23658c890ad84cd => generated 344 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:48:44.304654 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3990c929-db6d-4a3c-a6f5-6fd78e771ab2 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:48:44.305206 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3990c929-db6d-4a3c-a6f5-6fd78e771ab2 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:48:44.305206 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3990c929-db6d-4a3c-a6f5-6fd78e771ab2 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:48:44.310083 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 3/6] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:48:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:48:44.315411 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f5087-1cac-4c0e-95af-6bd572d17163 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:48:44.315847 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f5087-1cac-4c0e-95af-6bd572d17163 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:48:44.315962 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f5087-1cac-4c0e-95af-6bd572d17163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:48:44.336224 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-b90f5087-1cac-4c0e-95af-6bd572d17163 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:48:44.337775 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-b90f5087-1cac-4c0e-95af-6bd572d17163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:48:44.345640 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 4/7] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:48:44 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 18 10:48:44.623778 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3990c929-db6d-4a3c-a6f5-6fd78e771ab2 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:48:44.636208 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3990c929-db6d-4a3c-a6f5-6fd78e771ab2 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:48:44.640406 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5badd5-547c-4072-8933-ecece171582f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:48:44.641007 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5badd5-547c-4072-8933-ecece171582f admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:48:44.641291 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5badd5-547c-4072-8933-ecece171582f admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:48:44.641596 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5badd5-547c-4072-8933-ecece171582f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:48:44.649698 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5badd5-547c-4072-8933-ecece171582f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:48:44.652468 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5badd5-547c-4072-8933-ecece171582f admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:48:44.661277 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 4/8] 10.222.0.15 () {58 vars in 1324 bytes} [Thu Aug 18 10:48:44 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 18 10:48:44.667693 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90f5087-1cac-4c0e-95af-6bd572d17163 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:48:44.676991 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90f5087-1cac-4c0e-95af-6bd572d17163 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:48:44.681280 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4152aa24-0252-4f4f-82a7-42bac3ad4094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:48:44.682066 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4152aa24-0252-4f4f-82a7-42bac3ad4094 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:48:44.682414 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4152aa24-0252-4f4f-82a7-42bac3ad4094 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:48:44.682688 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4152aa24-0252-4f4f-82a7-42bac3ad4094 admin admin] PATH_INFO: `/v3/users/55b16d3a97d74b659d9af679ed207645` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:48:44.684012 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4152aa24-0252-4f4f-82a7-42bac3ad4094 admin admin] RBAC: Authorizing `identity:get_user(user_id=55b16d3a97d74b659d9af679ed207645)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:48:44.685904 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4152aa24-0252-4f4f-82a7-42bac3ad4094 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:48:44.687502 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 5/9] 10.222.0.15 () {56 vars in 1198 bytes} [Thu Aug 18 10:48:44 2022] GET /identity/v3/users/55b16d3a97d74b659d9af679ed207645 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:48:46.688940 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c51a60-2993-45ce-b7f1-7f6b4d7eab76 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:48:46.689467 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c51a60-2993-45ce-b7f1-7f6b4d7eab76 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:48:46.689467 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c51a60-2993-45ce-b7f1-7f6b4d7eab76 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:48:46.690830 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 5/10] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:48:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:48:46.695857 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897dc5d4-7376-43df-bf03-544640935a01 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:48:46.696241 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897dc5d4-7376-43df-bf03-544640935a01 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:48:46.696477 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897dc5d4-7376-43df-bf03-544640935a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:48:46.715052 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-897dc5d4-7376-43df-bf03-544640935a01 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:48:46.716319 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-897dc5d4-7376-43df-bf03-544640935a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:48:46.716444 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eea5dd6-b264-4a99-a7f8-0d9dac0c24e4 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:48:46.716707 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eea5dd6-b264-4a99-a7f8-0d9dac0c24e4 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:48:46.716981 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eea5dd6-b264-4a99-a7f8-0d9dac0c24e4 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:48:46.718324 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 6/11] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:48:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 10:48:46.723328 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e13b39-59fb-4833-8600-2e9e597ddaa3 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:48:46.723608 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e13b39-59fb-4833-8600-2e9e597ddaa3 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:48:46.723883 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e13b39-59fb-4833-8600-2e9e597ddaa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:48:46.766705 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG passlib.handlers.bcrypt [None req-33e13b39-59fb-4833-8600-2e9e597ddaa3 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81433) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 18 10:48:46.767369 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG passlib.handlers.bcrypt [None req-33e13b39-59fb-4833-8600-2e9e597ddaa3 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81433) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 18 10:48:46.797237 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 6/12] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:48:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 10:48:46.813021 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-33e13b39-59fb-4833-8600-2e9e597ddaa3 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:48:46.814661 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-33e13b39-59fb-4833-8600-2e9e597ddaa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:48:46.915975 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 7/13] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:48:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 10:48:47.063414 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897dc5d4-7376-43df-bf03-544640935a01 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:48:47.087699 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:48:47.171614 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897dc5d4-7376-43df-bf03-544640935a01 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:48:47.191363 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e13b39-59fb-4833-8600-2e9e597ddaa3 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:48:47.210221 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6bf47a-683c-4ab1-ac0f-d1278be196ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:48:47.210850 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6bf47a-683c-4ab1-ac0f-d1278be196ad None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:48:47.211136 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6bf47a-683c-4ab1-ac0f-d1278be196ad None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:48:47.211423 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6bf47a-683c-4ab1-ac0f-d1278be196ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:48:47.285637 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6bf47a-683c-4ab1-ac0f-d1278be196ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:48:47.287175 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6bf47a-683c-4ab1-ac0f-d1278be196ad None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:48:47.309582 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e13b39-59fb-4833-8600-2e9e597ddaa3 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:48:47.311942 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:48:47.314694 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:48:47.349290 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca487a1-5fd6-4352-aa49-7ea0d374cda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:48:47.350515 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca487a1-5fd6-4352-aa49-7ea0d374cda0 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:48:47.350805 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca487a1-5fd6-4352-aa49-7ea0d374cda0 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:48:47.351085 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca487a1-5fd6-4352-aa49-7ea0d374cda0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:48:47.363400 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca487a1-5fd6-4352-aa49-7ea0d374cda0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:48:47.372543 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-7ca487a1-5fd6-4352-aa49-7ea0d374cda0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 10:48:47.372543 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:48:47.372543 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:48:47.372543 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:48:47.372543 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:48:47.372543 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:48:47.372543 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:48:47.372543 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:48:47.372543 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:48:47.372543 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:48:47.372543 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:48:47.372543 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:48:47.372543 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:48:47.372543 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:48:47.372543 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:48:47.372543 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:48:47.373691 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:48:47.373691 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:48:47.373691 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:48:47.373691 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:48:47.373691 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:48:47.373691 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:48:47.373691 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:48:47.373691 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:48:47.373691 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:48:47.373691 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:48:47.373691 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:48:47.373691 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:48:47.373691 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:48:47.373691 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:48:47.373691 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:48:47.373691 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:48:47.374547 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:48:47.374547 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:48:47.374547 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:48:47.374547 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:48:47.374547 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:48:47.374547 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:48:47.374547 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:48:47.374547 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:48:47.374547 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:48:47.374547 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:48:47.374547 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 10:48:47.374547 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:48:47.374547 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 8/14] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Aug 18 10:48:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:48:47.379435 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca487a1-5fd6-4352-aa49-7ea0d374cda0 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:48:47.393609 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 7/15] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 18 10:48:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 10:48:47.399431 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6bf47a-683c-4ab1-ac0f-d1278be196ad None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:48:47.485760 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca487a1-5fd6-4352-aa49-7ea0d374cda0 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:48:47.501041 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6bf47a-683c-4ab1-ac0f-d1278be196ad None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:48:47.518935 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9052dea7-77a9-430e-9bec-7933b843f6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:48:47.519549 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9052dea7-77a9-430e-9bec-7933b843f6da None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:48:47.519830 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9052dea7-77a9-430e-9bec-7933b843f6da None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:48:47.520103 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9052dea7-77a9-430e-9bec-7933b843f6da None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:48:47.520778 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9052dea7-77a9-430e-9bec-7933b843f6da None admin] RBAC: Adding query filter params (name=admin) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:48:47.521083 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9052dea7-77a9-430e-9bec-7933b843f6da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:48:47.522842 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9052dea7-77a9-430e-9bec-7933b843f6da None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:48:47.525023 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:48:47.535894 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 9/16] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 18 10:48:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 10:48:47.538030 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9203d6e1-d594-43d7-8fa4-d337c2c3249e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:48:47.538662 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9203d6e1-d594-43d7-8fa4-d337c2c3249e None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:48:47.538940 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9203d6e1-d594-43d7-8fa4-d337c2c3249e None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:48:47.539210 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9203d6e1-d594-43d7-8fa4-d337c2c3249e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:48:47.542120 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9052dea7-77a9-430e-9bec-7933b843f6da None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:48:47.550188 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9203d6e1-d594-43d7-8fa4-d337c2c3249e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:48:47.551665 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9203d6e1-d594-43d7-8fa4-d337c2c3249e None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:48:47.568996 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:48:47.569234 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-9203d6e1-d594-43d7-8fa4-d337c2c3249e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:48:47.569234 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:48:47.569234 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:48:47.569234 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:48:47.569234 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:48:47.569234 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:48:47.569234 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:48:47.569234 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:48:47.569234 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:48:47.569234 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:48:47.569234 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:48:47.569234 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:48:47.569234 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 10:48:47.569234 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 10:48:47.569234 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 10:48:47.569234 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 10:48:47.570145 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:48:47.570145 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:48:47.570145 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:48:47.570145 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:48:47.570145 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:48:47.570145 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:48:47.570145 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:48:47.570145 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:48:47.570145 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:48:47.570145 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:48:47.570145 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:48:47.570145 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:48:47.570145 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:48:47.570145 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:48:47.570145 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:48:47.570145 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:48:47.570145 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 10:48:47.570940 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 10:48:47.570940 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:48:47.570940 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:48:47.570940 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 8/17] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:48:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 10:48:47.576613 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9203d6e1-d594-43d7-8fa4-d337c2c3249e None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:48:47.650307 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9052dea7-77a9-430e-9bec-7933b843f6da None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:48:47.684927 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f52d0e-fd90-4657-bad9-db19d2cab867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:48:47.685595 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f52d0e-fd90-4657-bad9-db19d2cab867 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:48:47.685873 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f52d0e-fd90-4657-bad9-db19d2cab867 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:48:47.686009 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9203d6e1-d594-43d7-8fa4-d337c2c3249e None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:48:47.686142 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f52d0e-fd90-4657-bad9-db19d2cab867 None admin] PATH_INFO: `/v3/users/55b16d3a97d74b659d9af679ed207645` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:48:47.687630 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f52d0e-fd90-4657-bad9-db19d2cab867 None admin] RBAC: Authorizing `identity:get_user(user_id=55b16d3a97d74b659d9af679ed207645)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:48:47.689077 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f52d0e-fd90-4657-bad9-db19d2cab867 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:48:47.690681 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 10/18] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Aug 18 10:48:47 2022] GET /identity/v3/users/55b16d3a97d74b659d9af679ed207645 => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 10:48:47.696297 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f52d0e-fd90-4657-bad9-db19d2cab867 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:48:47.725046 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be33e95-78f8-43b6-90a8-0ba6f3c8adc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:48:47.725696 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be33e95-78f8-43b6-90a8-0ba6f3c8adc1 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:48:47.725975 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be33e95-78f8-43b6-90a8-0ba6f3c8adc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:48:47.726249 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be33e95-78f8-43b6-90a8-0ba6f3c8adc1 None admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:48:47.726895 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be33e95-78f8-43b6-90a8-0ba6f3c8adc1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:48:47.727205 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be33e95-78f8-43b6-90a8-0ba6f3c8adc1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:48:47.728641 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be33e95-78f8-43b6-90a8-0ba6f3c8adc1 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:48:47.746742 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 9/19] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 18 10:48:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 10:48:47.800726 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:48:47.810555 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f52d0e-fd90-4657-bad9-db19d2cab867 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:48:47.848889 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0e329f-ad9d-4de8-82c3-88e1bf2b96e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:48:47.849456 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e329f-ad9d-4de8-82c3-88e1bf2b96e6 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:48:47.849781 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e329f-ad9d-4de8-82c3-88e1bf2b96e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:48:47.850061 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e329f-ad9d-4de8-82c3-88e1bf2b96e6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:48:47.851276 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0e329f-ad9d-4de8-82c3-88e1bf2b96e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:48:47.852796 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0e329f-ad9d-4de8-82c3-88e1bf2b96e6 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:48:47.855862 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 11/20] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:48:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 10:48:47.862276 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be33e95-78f8-43b6-90a8-0ba6f3c8adc1 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:48:47.911986 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:48:48.002644 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be33e95-78f8-43b6-90a8-0ba6f3c8adc1 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:48:48.041727 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93977dee-abb6-4661-b97d-6cff1164d691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:48:48.042280 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93977dee-abb6-4661-b97d-6cff1164d691 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:48:48.042564 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93977dee-abb6-4661-b97d-6cff1164d691 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:48:48.042836 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93977dee-abb6-4661-b97d-6cff1164d691 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:48:48.043578 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93977dee-abb6-4661-b97d-6cff1164d691 None admin] RBAC: Adding query filter params (role.id=127fdc7ef05b4e0b98a940b334e5fcab, scope.domain.id=default, user.id=55b16d3a97d74b659d9af679ed207645) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:48:48.043883 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93977dee-abb6-4661-b97d-6cff1164d691 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:48:48.045346 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93977dee-abb6-4661-b97d-6cff1164d691 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:48:48.053207 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 10/21] 10.222.0.15 () {56 vars in 1322 bytes} [Thu Aug 18 10:48:47 2022] GET /identity/v3/role_assignments?user.id=55b16d3a97d74b659d9af679ed207645&scope.domain.id=default&role.id=127fdc7ef05b4e0b98a940b334e5fcab => generated 233 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:48:50.130697 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4187b0c-f121-464f-996a-8a579b50894e None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:48:50.131202 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4187b0c-f121-464f-996a-8a579b50894e None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:48:50.131310 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4187b0c-f121-464f-996a-8a579b50894e None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:48:50.132907 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 12/22] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:48:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:48:50.139572 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5431b-7a02-4017-be6e-3fbc62fd026c None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:48:50.140041 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5431b-7a02-4017-be6e-3fbc62fd026c None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:48:50.140135 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5431b-7a02-4017-be6e-3fbc62fd026c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:48:50.162768 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-0cb5431b-7a02-4017-be6e-3fbc62fd026c None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:48:50.163978 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-0cb5431b-7a02-4017-be6e-3fbc62fd026c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:48:50.270268 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 11/23] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:48:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 10:48:50.407366 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e393f06-5773-431a-959d-6e79d8929c3d None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:48:50.407982 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e393f06-5773-431a-959d-6e79d8929c3d None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:48:50.408459 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e393f06-5773-431a-959d-6e79d8929c3d None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:48:50.410319 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 13/24] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:48:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:48:50.416030 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b0be6d-4c78-4687-835c-c7f1c1e813ae None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:48:50.417276 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b0be6d-4c78-4687-835c-c7f1c1e813ae None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:48:50.417823 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b0be6d-4c78-4687-835c-c7f1c1e813ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:48:50.441718 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-25b0be6d-4c78-4687-835c-c7f1c1e813ae None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:48:50.443292 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-25b0be6d-4c78-4687-835c-c7f1c1e813ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:48:50.476630 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:48:50.552579 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 12/25] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:48:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 10:48:50.746190 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1232a1e2-53b1-4c8c-9076-97128a3183c7 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:48:50.746908 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1232a1e2-53b1-4c8c-9076-97128a3183c7 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:48:50.747402 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1232a1e2-53b1-4c8c-9076-97128a3183c7 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:48:50.749424 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 14/26] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:48:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:48:50.754886 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2232bc6-0c1b-4426-b732-106b6abb5eec None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:48:50.755491 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2232bc6-0c1b-4426-b732-106b6abb5eec None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:48:50.757285 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1232a1e2-53b1-4c8c-9076-97128a3183c7 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:48:50.761364 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2232bc6-0c1b-4426-b732-106b6abb5eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:48:50.820126 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-c2232bc6-0c1b-4426-b732-106b6abb5eec None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:48:50.823348 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-c2232bc6-0c1b-4426-b732-106b6abb5eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:48:50.975176 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 13/27] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:48:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 10:48:50.976295 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2232bc6-0c1b-4426-b732-106b6abb5eec None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:48:50.983429 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1232a1e2-53b1-4c8c-9076-97128a3183c7 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:48:51.019102 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af53d1ca-9210-4e51-8607-df878eb5e0a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:48:51.020050 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af53d1ca-9210-4e51-8607-df878eb5e0a6 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:48:51.020535 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af53d1ca-9210-4e51-8607-df878eb5e0a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:48:51.021012 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af53d1ca-9210-4e51-8607-df878eb5e0a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:48:51.042506 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af53d1ca-9210-4e51-8607-df878eb5e0a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:48:51.044301 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af53d1ca-9210-4e51-8607-df878eb5e0a6 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:48:51.071925 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-af53d1ca-9210-4e51-8607-df878eb5e0a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:48:51.071925 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:48:51.071925 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:48:51.071925 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:48:51.071925 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:48:51.071925 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:48:51.071925 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:48:51.071925 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:48:51.071925 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:48:51.071925 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:48:51.071925 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:48:51.071925 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:48:51.071925 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 10:48:51.071925 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 10:48:51.071925 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 10:48:51.071925 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 10:48:51.073392 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:48:51.073392 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:48:51.073392 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:48:51.073392 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:48:51.073392 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:48:51.073392 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:48:51.073392 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:48:51.073392 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:48:51.073392 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:48:51.073392 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:48:51.073392 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:48:51.073392 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:48:51.073392 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:48:51.073392 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:48:51.073392 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:48:51.073392 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:48:51.073392 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 10:48:51.074206 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 10:48:51.074206 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:48:51.074206 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:48:51.079461 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 15/28] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:48:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:48:51.082037 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda0c49-d975-4fe3-8488-6bcca8536269 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:48:51.083480 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda0c49-d975-4fe3-8488-6bcca8536269 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:48:51.084563 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda0c49-d975-4fe3-8488-6bcca8536269 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:48:51.086224 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 16/29] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:48:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:48:51.088768 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dda0c49-d975-4fe3-8488-6bcca8536269 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:48:51.121769 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:48:51.142931 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:48:51.163713 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2232bc6-0c1b-4426-b732-106b6abb5eec None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:48:51.235675 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94d5372-2dbe-4951-9259-5ae742002eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:48:51.236303 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d5372-2dbe-4951-9259-5ae742002eaf None admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:48:51.236583 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d5372-2dbe-4951-9259-5ae742002eaf None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:48:51.236855 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d5372-2dbe-4951-9259-5ae742002eaf None admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:48:51.237544 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94d5372-2dbe-4951-9259-5ae742002eaf None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:48:51.238941 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94d5372-2dbe-4951-9259-5ae742002eaf None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:48:51.299297 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dda0c49-d975-4fe3-8488-6bcca8536269 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:48:51.340788 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140a8e4e-5c4a-4657-9d4f-1f8bb3b2a528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:48:51.342049 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140a8e4e-5c4a-4657-9d4f-1f8bb3b2a528 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:48:51.342818 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140a8e4e-5c4a-4657-9d4f-1f8bb3b2a528 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:48:51.343509 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140a8e4e-5c4a-4657-9d4f-1f8bb3b2a528 None admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:48:51.344952 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140a8e4e-5c4a-4657-9d4f-1f8bb3b2a528 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:48:51.345990 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140a8e4e-5c4a-4657-9d4f-1f8bb3b2a528 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:48:51.348983 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140a8e4e-5c4a-4657-9d4f-1f8bb3b2a528 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:48:51.372887 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 17/30] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 18 10:48:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:48:51.374835 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f0ee57-47c9-4bfd-9593-113b42c5e8c0 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:48:51.375328 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f0ee57-47c9-4bfd-9593-113b42c5e8c0 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:48:51.376044 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f0ee57-47c9-4bfd-9593-113b42c5e8c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:48:51.404920 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-38f0ee57-47c9-4bfd-9593-113b42c5e8c0 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:48:51.406625 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-38f0ee57-47c9-4bfd-9593-113b42c5e8c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:48:51.429550 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 14/31] 10.222.0.15 () {60 vars in 1131 bytes} [Thu Aug 18 10:48:50 2022] POST /identity/v3/roles => generated 219 bytes in 447 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 10:48:51.429550 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94d5372-2dbe-4951-9259-5ae742002eaf None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:48:51.552821 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94d5372-2dbe-4951-9259-5ae742002eaf None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:48:51.565678 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 18/32] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:48:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 10:48:51.567027 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f0ee57-47c9-4bfd-9593-113b42c5e8c0 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:48:51.575745 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:48:51.647324 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6609ae9-3768-47c7-b2f9-ab9679bbc2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:48:51.648125 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6609ae9-3768-47c7-b2f9-ab9679bbc2d8 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:48:51.648409 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6609ae9-3768-47c7-b2f9-ab9679bbc2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:48:51.648685 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6609ae9-3768-47c7-b2f9-ab9679bbc2d8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:48:51.663217 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6609ae9-3768-47c7-b2f9-ab9679bbc2d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:48:51.671664 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-f6609ae9-3768-47c7-b2f9-ab9679bbc2d8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 10:48:51.671664 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:48:51.671664 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:48:51.671664 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:48:51.671664 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:48:51.671664 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:48:51.671664 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:48:51.671664 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:48:51.671664 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:48:51.671664 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:48:51.671664 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:48:51.671664 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:48:51.671664 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:48:51.671664 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:48:51.671664 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:48:51.671664 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:48:51.672515 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:48:51.672515 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:48:51.672515 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:48:51.672515 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:48:51.672515 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:48:51.672515 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:48:51.672515 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:48:51.672515 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:48:51.672515 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:48:51.672515 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:48:51.672515 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:48:51.672515 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:48:51.672515 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:48:51.672515 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:48:51.672515 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:48:51.672515 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:48:51.673256 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:48:51.673256 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:48:51.673256 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:48:51.673256 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:48:51.673256 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:48:51.673256 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:48:51.673256 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:48:51.673256 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:48:51.673256 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:48:51.673256 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:48:51.673256 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 10:48:51.673256 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:48:51.673256 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 15/33] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Aug 18 10:48:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:48:51.687027 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6609ae9-3768-47c7-b2f9-ab9679bbc2d8 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:48:51.700985 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:48:51.799606 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f0ee57-47c9-4bfd-9593-113b42c5e8c0 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:48:51.846314 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c893242-c6b9-4f8e-bf34-118c0a90930b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:48:51.846853 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c893242-c6b9-4f8e-bf34-118c0a90930b None admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:48:51.847136 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c893242-c6b9-4f8e-bf34-118c0a90930b None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:48:51.847406 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c893242-c6b9-4f8e-bf34-118c0a90930b None admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:48:51.847831 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6609ae9-3768-47c7-b2f9-ab9679bbc2d8 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:48:51.848065 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c893242-c6b9-4f8e-bf34-118c0a90930b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:48:51.849566 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c893242-c6b9-4f8e-bf34-118c0a90930b None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:48:51.896631 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c613bab7-c491-4ffb-8227-cc1ce36b5e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:48:51.897989 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c613bab7-c491-4ffb-8227-cc1ce36b5e7e None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:48:51.897989 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c613bab7-c491-4ffb-8227-cc1ce36b5e7e None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:48:51.898387 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c613bab7-c491-4ffb-8227-cc1ce36b5e7e None admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:48:51.899204 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c613bab7-c491-4ffb-8227-cc1ce36b5e7e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:48:51.899582 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c613bab7-c491-4ffb-8227-cc1ce36b5e7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:48:51.901864 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c613bab7-c491-4ffb-8227-cc1ce36b5e7e None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:48:51.915143 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 16/34] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 18 10:48:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 10:48:51.917075 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f22b30e-fba0-4308-8845-835b716a97a3 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:48:51.917368 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f22b30e-fba0-4308-8845-835b716a97a3 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:48:51.917661 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f22b30e-fba0-4308-8845-835b716a97a3 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:48:51.919044 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 17/35] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:48:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:48:51.919578 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f22b30e-fba0-4308-8845-835b716a97a3 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:48:51.991180 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:48:51.995921 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 19/36] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Aug 18 10:48:51 2022] POST /identity/v3/projects => generated 301 bytes in 429 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 10:48:51.997497 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6876315-c995-44be-a223-925f42c72e9e None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:48:51.997816 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6876315-c995-44be-a223-925f42c72e9e None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:48:51.998086 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6876315-c995-44be-a223-925f42c72e9e None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:48:51.999383 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 20/37] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:48:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:48:52.000503 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68093af-9097-4af1-a8ab-c610408d0b87 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:48:52.000855 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68093af-9097-4af1-a8ab-c610408d0b87 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:48:52.001140 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68093af-9097-4af1-a8ab-c610408d0b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:48:52.028129 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-b68093af-9097-4af1-a8ab-c610408d0b87 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:48:52.029747 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-b68093af-9097-4af1-a8ab-c610408d0b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:48:52.032766 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f22b30e-fba0-4308-8845-835b716a97a3 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:48:52.079783 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588a53e0-4aae-445d-b264-d864e2266147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:48:52.080536 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a53e0-4aae-445d-b264-d864e2266147 None admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:48:52.080956 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a53e0-4aae-445d-b264-d864e2266147 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:48:52.081582 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a53e0-4aae-445d-b264-d864e2266147 None admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:48:52.083359 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588a53e0-4aae-445d-b264-d864e2266147 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:48:52.084913 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588a53e0-4aae-445d-b264-d864e2266147 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:48:52.101229 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:48:52.117557 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 18/38] 10.222.0.15 () {60 vars in 1131 bytes} [Thu Aug 18 10:48:51 2022] POST /identity/v3/roles => generated 225 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 10:48:52.117557 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588a53e0-4aae-445d-b264-d864e2266147 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:48:52.140445 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 21/39] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:48:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 10:48:52.141935 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d4ccf-4032-4588-aec3-a33b9184dcb6 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:48:52.142228 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d4ccf-4032-4588-aec3-a33b9184dcb6 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:48:52.142506 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d4ccf-4032-4588-aec3-a33b9184dcb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:48:52.167741 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-0b2d4ccf-4032-4588-aec3-a33b9184dcb6 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:48:52.170254 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-0b2d4ccf-4032-4588-aec3-a33b9184dcb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:48:52.258113 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588a53e0-4aae-445d-b264-d864e2266147 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:48:52.270569 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 22/40] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:48:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 10:48:52.295117 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:48:52.298488 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d57806-f945-4e97-b41b-e08ecb105163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:48:52.299239 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d57806-f945-4e97-b41b-e08ecb105163 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:48:52.299654 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d57806-f945-4e97-b41b-e08ecb105163 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:48:52.300026 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d57806-f945-4e97-b41b-e08ecb105163 None admin] PATH_INFO: `/v3/users/55b16d3a97d74b659d9af679ed207645` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:48:52.301492 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d57806-f945-4e97-b41b-e08ecb105163 None admin] RBAC: Authorizing `identity:get_user(user_id=55b16d3a97d74b659d9af679ed207645)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:48:52.303262 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d57806-f945-4e97-b41b-e08ecb105163 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:48:52.305010 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 19/41] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Aug 18 10:48:52 2022] GET /identity/v3/users/55b16d3a97d74b659d9af679ed207645 => generated 247 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:48:52.310852 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d4ccf-4032-4588-aec3-a33b9184dcb6 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:48:52.423026 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d4ccf-4032-4588-aec3-a33b9184dcb6 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:48:52.441505 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:48:52.461968 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bfaa97-f255-45e3-9749-5b9fa2f562c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:48:52.462608 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bfaa97-f255-45e3-9749-5b9fa2f562c0 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:48:52.463652 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bfaa97-f255-45e3-9749-5b9fa2f562c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:48:52.464022 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bfaa97-f255-45e3-9749-5b9fa2f562c0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:48:52.465342 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bfaa97-f255-45e3-9749-5b9fa2f562c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:48:52.466941 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bfaa97-f255-45e3-9749-5b9fa2f562c0 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:48:52.473214 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 23/42] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:48:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 10:48:52.474493 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d57806-f945-4e97-b41b-e08ecb105163 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:48:52.480019 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bfaa97-f255-45e3-9749-5b9fa2f562c0 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:48:52.589116 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bfaa97-f255-45e3-9749-5b9fa2f562c0 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:48:52.626922 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df089ae-3fb5-453a-8945-91331a828b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:48:52.627547 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df089ae-3fb5-453a-8945-91331a828b6b None admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:48:52.627825 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df089ae-3fb5-453a-8945-91331a828b6b None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:48:52.628098 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df089ae-3fb5-453a-8945-91331a828b6b None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:48:52.628801 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df089ae-3fb5-453a-8945-91331a828b6b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:48:52.630247 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df089ae-3fb5-453a-8945-91331a828b6b None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:48:52.647928 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 24/43] 10.222.0.15 () {60 vars in 1131 bytes} [Thu Aug 18 10:48:52 2022] POST /identity/v3/roles => generated 223 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 10:48:52.648785 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df089ae-3fb5-453a-8945-91331a828b6b None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:48:52.706635 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:48:52.719227 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d57806-f945-4e97-b41b-e08ecb105163 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:48:52.760901 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88edcd6-ec28-43d0-b338-8718f9785430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:48:52.761616 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88edcd6-ec28-43d0-b338-8718f9785430 None admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:48:52.761902 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88edcd6-ec28-43d0-b338-8718f9785430 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:48:52.762246 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88edcd6-ec28-43d0-b338-8718f9785430 None admin] PATH_INFO: `/v3/domains/default/users/55b16d3a97d74b659d9af679ed207645/roles/127fdc7ef05b4e0b98a940b334e5fcab` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:48:52.764447 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88edcd6-ec28-43d0-b338-8718f9785430 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=55b16d3a97d74b659d9af679ed207645, role_id=127fdc7ef05b4e0b98a940b334e5fcab)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:48:52.765979 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88edcd6-ec28-43d0-b338-8718f9785430 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:48:52.778071 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df089ae-3fb5-453a-8945-91331a828b6b None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:48:52.782222 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 20/44] 10.222.0.15 () {58 vars in 1361 bytes} [Thu Aug 18 10:48:52 2022] PUT /identity/v3/domains/default/users/55b16d3a97d74b659d9af679ed207645/roles/127fdc7ef05b4e0b98a940b334e5fcab => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 10:48:52.824188 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e58fef-6a80-4b95-b75f-dd652c508327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:48:52.824862 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e58fef-6a80-4b95-b75f-dd652c508327 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:48:52.825144 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e58fef-6a80-4b95-b75f-dd652c508327 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:48:52.825422 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e58fef-6a80-4b95-b75f-dd652c508327 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:48:52.829864 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e58fef-6a80-4b95-b75f-dd652c508327 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:48:52.831371 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e58fef-6a80-4b95-b75f-dd652c508327 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:48:52.833151 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 25/45] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:48:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:48:52.839205 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88edcd6-ec28-43d0-b338-8718f9785430 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:48:52.913362 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:48:52.962588 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88edcd6-ec28-43d0-b338-8718f9785430 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:48:52.999646 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbff2ec1-909a-430d-bddb-8370c9349a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:48:53.000261 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff2ec1-909a-430d-bddb-8370c9349a7d None admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:48:53.000544 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff2ec1-909a-430d-bddb-8370c9349a7d None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:48:53.000818 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff2ec1-909a-430d-bddb-8370c9349a7d None admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:48:53.001489 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbff2ec1-909a-430d-bddb-8370c9349a7d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:48:53.002972 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbff2ec1-909a-430d-bddb-8370c9349a7d None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:48:53.034467 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 21/46] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Aug 18 10:48:52 2022] POST /identity/v3/projects => generated 312 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 10:48:54.709410 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84f573d-9675-450c-8558-a81608b4ebac None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:48:54.709946 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84f573d-9675-450c-8558-a81608b4ebac None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:48:54.710027 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84f573d-9675-450c-8558-a81608b4ebac None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:48:54.711386 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 26/47] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:48:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:48:54.717326 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d0410-0e33-40bb-9f7a-e33d5f480bac None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:48:54.717762 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d0410-0e33-40bb-9f7a-e33d5f480bac None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:48:54.717921 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d0410-0e33-40bb-9f7a-e33d5f480bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:48:54.736866 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-252d0410-0e33-40bb-9f7a-e33d5f480bac None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:48:54.738418 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-252d0410-0e33-40bb-9f7a-e33d5f480bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:48:54.808162 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 22/48] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:48:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 10:48:54.925110 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a0c475-5137-4c26-80b0-ca388b109640 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:48:54.925401 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a0c475-5137-4c26-80b0-ca388b109640 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:48:54.925713 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a0c475-5137-4c26-80b0-ca388b109640 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:48:54.927069 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 27/49] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:48:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:48:54.932916 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11853d76-3d61-4ae9-a710-2fdab746d02a None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:48:54.933203 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11853d76-3d61-4ae9-a710-2fdab746d02a None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:48:54.933473 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11853d76-3d61-4ae9-a710-2fdab746d02a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:48:54.951828 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-11853d76-3d61-4ae9-a710-2fdab746d02a None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:48:54.953091 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-11853d76-3d61-4ae9-a710-2fdab746d02a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:48:54.987003 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:48:55.022440 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 23/50] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:48:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 10:48:55.076773 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a0c475-5137-4c26-80b0-ca388b109640 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:48:55.178140 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a0c475-5137-4c26-80b0-ca388b109640 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:48:55.191645 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:48:55.215589 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93611f5e-d55b-46e4-adba-67f1335f5c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:48:55.216231 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93611f5e-d55b-46e4-adba-67f1335f5c41 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:48:55.216514 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93611f5e-d55b-46e4-adba-67f1335f5c41 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:48:55.216789 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93611f5e-d55b-46e4-adba-67f1335f5c41 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:48:55.227559 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93611f5e-d55b-46e4-adba-67f1335f5c41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:48:55.233083 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-93611f5e-d55b-46e4-adba-67f1335f5c41 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 10:48:55.233083 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:48:55.233083 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:48:55.233083 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:48:55.233083 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:48:55.233083 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:48:55.233083 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:48:55.233083 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:48:55.233083 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:48:55.233083 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:48:55.233083 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:48:55.233083 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:48:55.233083 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:48:55.233083 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:48:55.233083 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:48:55.233083 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:48:55.234209 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:48:55.234209 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:48:55.234209 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:48:55.234209 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:48:55.234209 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:48:55.234209 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:48:55.234209 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:48:55.234209 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:48:55.234209 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:48:55.234209 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:48:55.234209 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:48:55.234209 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:48:55.234209 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:48:55.234209 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:48:55.234209 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:48:55.234209 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:48:55.234962 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:48:55.234962 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:48:55.234962 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:48:55.234962 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:48:55.234962 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:48:55.234962 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:48:55.234962 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:48:55.234962 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:48:55.234962 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:48:55.234962 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:48:55.234962 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 10:48:55.234962 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:48:55.234962 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 28/51] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Aug 18 10:48:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:48:55.240307 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11853d76-3d61-4ae9-a710-2fdab746d02a None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:48:55.292270 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93611f5e-d55b-46e4-adba-67f1335f5c41 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:48:55.344678 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11853d76-3d61-4ae9-a710-2fdab746d02a None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:48:55.379587 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe5cb3e-b34d-479d-bb62-86ed62931b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:48:55.380206 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe5cb3e-b34d-479d-bb62-86ed62931b83 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:48:55.380493 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe5cb3e-b34d-479d-bb62-86ed62931b83 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:48:55.380770 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe5cb3e-b34d-479d-bb62-86ed62931b83 None admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:48:55.381454 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe5cb3e-b34d-479d-bb62-86ed62931b83 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:48:55.381983 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe5cb3e-b34d-479d-bb62-86ed62931b83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:48:55.383192 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe5cb3e-b34d-479d-bb62-86ed62931b83 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:48:55.392540 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 24/52] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 18 10:48:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 10:48:55.398292 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe5cb3e-b34d-479d-bb62-86ed62931b83 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:48:55.403544 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93611f5e-d55b-46e4-adba-67f1335f5c41 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:48:55.430228 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:48:55.444248 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ac8544-a9cf-4316-8bfd-67f547586b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:48:55.444888 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ac8544-a9cf-4316-8bfd-67f547586b7d None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:48:55.445168 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ac8544-a9cf-4316-8bfd-67f547586b7d None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:48:55.445433 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ac8544-a9cf-4316-8bfd-67f547586b7d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:48:55.446584 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ac8544-a9cf-4316-8bfd-67f547586b7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:48:55.448675 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ac8544-a9cf-4316-8bfd-67f547586b7d None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:48:55.450659 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 29/53] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:48:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 10:48:55.456046 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ac8544-a9cf-4316-8bfd-67f547586b7d None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:48:55.497625 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:48:55.503366 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe5cb3e-b34d-479d-bb62-86ed62931b83 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:48:55.543930 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5376d9c9-f898-44af-8cbd-66552f231e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:48:55.544570 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5376d9c9-f898-44af-8cbd-66552f231e00 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:48:55.544850 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5376d9c9-f898-44af-8cbd-66552f231e00 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:48:55.545124 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5376d9c9-f898-44af-8cbd-66552f231e00 None admin] PATH_INFO: `/v3/users/55b16d3a97d74b659d9af679ed207645` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:48:55.546510 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5376d9c9-f898-44af-8cbd-66552f231e00 None admin] RBAC: Authorizing `identity:get_user(user_id=55b16d3a97d74b659d9af679ed207645)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:48:55.547962 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5376d9c9-f898-44af-8cbd-66552f231e00 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:48:55.549571 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 25/54] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Aug 18 10:48:55 2022] GET /identity/v3/users/55b16d3a97d74b659d9af679ed207645 => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 10:48:55.556069 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5376d9c9-f898-44af-8cbd-66552f231e00 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:48:55.567650 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ac8544-a9cf-4316-8bfd-67f547586b7d None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:48:55.606031 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b69fee7-d60a-452d-bacf-a26137ab902f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:48:55.606645 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b69fee7-d60a-452d-bacf-a26137ab902f None admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:48:55.606938 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b69fee7-d60a-452d-bacf-a26137ab902f None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:48:55.607221 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b69fee7-d60a-452d-bacf-a26137ab902f None admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:48:55.607872 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b69fee7-d60a-452d-bacf-a26137ab902f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:48:55.609318 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b69fee7-d60a-452d-bacf-a26137ab902f None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:48:55.638732 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 30/55] 10.222.0.15 () {60 vars in 1140 bytes} [Thu Aug 18 10:48:55 2022] POST /identity/v3/projects => generated 298 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 10:48:55.661346 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:48:55.664708 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5376d9c9-f898-44af-8cbd-66552f231e00 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:48:55.705144 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cdf377-18f3-43a6-bc7a-e5abd6c98023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:48:55.705833 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cdf377-18f3-43a6-bc7a-e5abd6c98023 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:48:55.706115 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cdf377-18f3-43a6-bc7a-e5abd6c98023 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:48:55.706389 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cdf377-18f3-43a6-bc7a-e5abd6c98023 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:48:55.707626 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cdf377-18f3-43a6-bc7a-e5abd6c98023 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:48:55.709103 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cdf377-18f3-43a6-bc7a-e5abd6c98023 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:48:55.710818 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 26/56] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:48:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:48:55.717372 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b69fee7-d60a-452d-bacf-a26137ab902f None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:48:55.823728 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:48:55.833898 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b69fee7-d60a-452d-bacf-a26137ab902f None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:48:55.871673 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01059060-c67d-4606-8689-469d408e633d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:48:55.872298 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01059060-c67d-4606-8689-469d408e633d None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:48:55.872582 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01059060-c67d-4606-8689-469d408e633d None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:48:55.872863 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01059060-c67d-4606-8689-469d408e633d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:48:55.873626 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01059060-c67d-4606-8689-469d408e633d None admin] RBAC: Adding query filter params (role.id=127fdc7ef05b4e0b98a940b334e5fcab, scope.domain.id=default, user.id=55b16d3a97d74b659d9af679ed207645) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:48:55.873939 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01059060-c67d-4606-8689-469d408e633d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:48:55.875400 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01059060-c67d-4606-8689-469d408e633d None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:48:55.885511 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 31/57] 10.222.0.15 () {56 vars in 1322 bytes} [Thu Aug 18 10:48:55 2022] GET /identity/v3/role_assignments?user.id=55b16d3a97d74b659d9af679ed207645&scope.domain.id=default&role.id=127fdc7ef05b4e0b98a940b334e5fcab => generated 530 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:48:57.585741 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204dad55-a093-4089-8b17-ab17de5083e0 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:48:57.586301 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204dad55-a093-4089-8b17-ab17de5083e0 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:48:57.586718 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204dad55-a093-4089-8b17-ab17de5083e0 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:48:57.589861 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 27/58] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:48:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:48:57.596445 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb2aae-48b3-4b13-88ab-872ba9a14c0f None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:48:57.596905 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb2aae-48b3-4b13-88ab-872ba9a14c0f None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:48:57.597013 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb2aae-48b3-4b13-88ab-872ba9a14c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:48:57.621132 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-fbbb2aae-48b3-4b13-88ab-872ba9a14c0f None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:48:57.622391 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-fbbb2aae-48b3-4b13-88ab-872ba9a14c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:48:57.689437 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 32/59] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:48:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 10:48:57.965009 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204dad55-a093-4089-8b17-ab17de5083e0 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:48:58.067502 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204dad55-a093-4089-8b17-ab17de5083e0 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:48:58.101836 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a293092c-e170-441c-8d18-5882adfb4747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:48:58.102456 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a293092c-e170-441c-8d18-5882adfb4747 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:48:58.102732 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a293092c-e170-441c-8d18-5882adfb4747 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:48:58.103004 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a293092c-e170-441c-8d18-5882adfb4747 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:48:58.104372 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a293092c-e170-441c-8d18-5882adfb4747 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:48:58.105822 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a293092c-e170-441c-8d18-5882adfb4747 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:48:58.107391 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 28/60] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:48:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:48:58.113123 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbb2aae-48b3-4b13-88ab-872ba9a14c0f None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:48:58.304596 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:48:58.319221 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbb2aae-48b3-4b13-88ab-872ba9a14c0f None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:48:58.352377 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ffc408-e3bb-48b0-bf46-28ce8465bc07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:48:58.352976 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ffc408-e3bb-48b0-bf46-28ce8465bc07 None admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:48:58.353293 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ffc408-e3bb-48b0-bf46-28ce8465bc07 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:48:58.353710 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ffc408-e3bb-48b0-bf46-28ce8465bc07 None admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:48:58.354325 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ffc408-e3bb-48b0-bf46-28ce8465bc07 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:48:58.355765 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ffc408-e3bb-48b0-bf46-28ce8465bc07 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:48:58.381059 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 33/61] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Aug 18 10:48:58 2022] POST /identity/v3/users => generated 275 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 10:49:01.320180 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e62ae-672d-4ed4-a444-f0e4d6fa50f2 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:01.321627 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e62ae-672d-4ed4-a444-f0e4d6fa50f2 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:01.322456 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e62ae-672d-4ed4-a444-f0e4d6fa50f2 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:01.325255 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 29/62] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:49:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:49:01.333898 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b029da4-3dc4-4967-90d0-2410b52a1973 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:01.334873 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b029da4-3dc4-4967-90d0-2410b52a1973 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:01.335358 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b029da4-3dc4-4967-90d0-2410b52a1973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:01.357689 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-3b029da4-3dc4-4967-90d0-2410b52a1973 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:49:01.359395 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-3b029da4-3dc4-4967-90d0-2410b52a1973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:49:01.460922 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 34/63] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:49:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 10:49:01.768366 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93255281-a17a-4f8a-95df-94deb2894d89 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:01.769046 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93255281-a17a-4f8a-95df-94deb2894d89 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:01.769573 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93255281-a17a-4f8a-95df-94deb2894d89 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:01.771191 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 30/64] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:49:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:49:01.778031 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf554ea-8b15-479c-8182-1a203f3874a6 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:01.778620 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf554ea-8b15-479c-8182-1a203f3874a6 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:01.779097 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf554ea-8b15-479c-8182-1a203f3874a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:01.807894 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-2bf554ea-8b15-479c-8182-1a203f3874a6 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:49:01.808966 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-2bf554ea-8b15-479c-8182-1a203f3874a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:49:01.828585 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93255281-a17a-4f8a-95df-94deb2894d89 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:01.875283 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:01.907452 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 35/65] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:49:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 10:49:01.909026 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed953dc-7964-4c10-b196-bb197d126e88 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:01.909443 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed953dc-7964-4c10-b196-bb197d126e88 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:01.909900 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed953dc-7964-4c10-b196-bb197d126e88 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:01.911291 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 36/66] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:49:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:49:01.917387 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a2a4e9-6351-4411-93b5-5a5b9ac7cac5 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:01.917977 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a2a4e9-6351-4411-93b5-5a5b9ac7cac5 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:01.918312 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a2a4e9-6351-4411-93b5-5a5b9ac7cac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:01.925459 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:01.944031 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-12a2a4e9-6351-4411-93b5-5a5b9ac7cac5 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:49:01.945710 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-12a2a4e9-6351-4411-93b5-5a5b9ac7cac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:49:01.965486 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93255281-a17a-4f8a-95df-94deb2894d89 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:02.000253 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b309155b-b28d-4c67-ad02-54bd84823f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:02.001130 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b309155b-b28d-4c67-ad02-54bd84823f3b None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:02.001584 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b309155b-b28d-4c67-ad02-54bd84823f3b None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:02.002025 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b309155b-b28d-4c67-ad02-54bd84823f3b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:02.013886 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b309155b-b28d-4c67-ad02-54bd84823f3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:49:02.019391 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-b309155b-b28d-4c67-ad02-54bd84823f3b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 10:49:02.019391 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:49:02.019391 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:49:02.019391 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:49:02.019391 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:49:02.019391 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:49:02.019391 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:49:02.019391 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:49:02.019391 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:49:02.019391 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:49:02.019391 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:49:02.019391 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:49:02.019391 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:49:02.019391 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:49:02.019391 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:49:02.019391 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:49:02.020496 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:49:02.020496 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:49:02.020496 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:49:02.020496 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:49:02.020496 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:49:02.020496 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:49:02.020496 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:49:02.020496 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:49:02.020496 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:49:02.020496 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:49:02.020496 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:49:02.020496 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:49:02.020496 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:49:02.020496 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:49:02.020496 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:49:02.020496 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:49:02.021486 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:49:02.021486 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:49:02.021486 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:49:02.021486 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:49:02.021486 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:49:02.021486 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:49:02.021486 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:49:02.021486 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:49:02.021486 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:49:02.021486 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:49:02.021486 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 10:49:02.021486 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:49:02.022359 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 37/67] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:49:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 10:49:02.023710 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 31/68] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 18 10:49:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 10:49:02.025953 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e69b2-fe55-4282-8a2c-0924fe2e4f40 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:02.026401 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e69b2-fe55-4282-8a2c-0924fe2e4f40 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:02.026810 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e69b2-fe55-4282-8a2c-0924fe2e4f40 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:02.028271 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 38/69] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:49:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:49:02.029579 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b309155b-b28d-4c67-ad02-54bd84823f3b None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:02.033780 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d217540-0abf-416b-a182-cd054d54d78f None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:02.035908 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d217540-0abf-416b-a182-cd054d54d78f None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:02.036336 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d217540-0abf-416b-a182-cd054d54d78f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:02.074571 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-4d217540-0abf-416b-a182-cd054d54d78f None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:49:02.075794 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-4d217540-0abf-416b-a182-cd054d54d78f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:49:02.144194 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:02.148754 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b309155b-b28d-4c67-ad02-54bd84823f3b None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:02.186111 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fad942-5cbe-4676-83f4-3efce6359562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:02.187082 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fad942-5cbe-4676-83f4-3efce6359562 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:02.187557 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fad942-5cbe-4676-83f4-3efce6359562 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:02.188021 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fad942-5cbe-4676-83f4-3efce6359562 None admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:02.188990 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fad942-5cbe-4676-83f4-3efce6359562 None admin] RBAC: Adding query filter params (name=member) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:49:02.189502 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fad942-5cbe-4676-83f4-3efce6359562 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:02.191157 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fad942-5cbe-4676-83f4-3efce6359562 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:02.201706 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 32/70] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Aug 18 10:49:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 10:49:02.203131 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fad942-5cbe-4676-83f4-3efce6359562 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:02.221415 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 39/71] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:49:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 10:49:02.222710 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d217540-0abf-416b-a182-cd054d54d78f None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:02.303576 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:02.334041 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fad942-5cbe-4676-83f4-3efce6359562 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:02.350443 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d217540-0abf-416b-a182-cd054d54d78f None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:02.372597 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b64c344-dec0-40b2-a901-d5d7de7c643f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:02.373247 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b64c344-dec0-40b2-a901-d5d7de7c643f None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:02.373707 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b64c344-dec0-40b2-a901-d5d7de7c643f None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:02.373983 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b64c344-dec0-40b2-a901-d5d7de7c643f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:02.385448 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b64c344-dec0-40b2-a901-d5d7de7c643f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:49:02.387895 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f9de17-91e7-4bc9-b10d-5df09f029a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:02.388534 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f9de17-91e7-4bc9-b10d-5df09f029a42 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:02.388816 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f9de17-91e7-4bc9-b10d-5df09f029a42 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:02.389089 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f9de17-91e7-4bc9-b10d-5df09f029a42 None admin] PATH_INFO: `/v3/users/dbca316ef38e45aeb63de5837094e8ce` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:02.390692 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-2b64c344-dec0-40b2-a901-d5d7de7c643f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 10:49:02.390692 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:49:02.390692 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:49:02.390692 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:49:02.390692 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:49:02.390692 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:49:02.390692 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:49:02.390692 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:49:02.390692 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:49:02.390692 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:49:02.390692 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:49:02.390692 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:49:02.390692 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:49:02.390692 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:49:02.390692 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:49:02.390692 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:49:02.391493 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:49:02.391493 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:49:02.391493 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:49:02.391493 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:49:02.391493 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:49:02.391493 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:49:02.391493 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:49:02.391493 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:49:02.391493 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:49:02.391493 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:49:02.391493 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:49:02.391493 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:49:02.391493 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:49:02.391493 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:49:02.391493 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:49:02.391493 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:49:02.392950 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:49:02.392950 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:49:02.392950 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:49:02.392950 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:49:02.392950 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:49:02.392950 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:49:02.392950 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:49:02.392950 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:49:02.392950 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:49:02.392950 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:49:02.392950 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 10:49:02.392950 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:49:02.392950 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 33/72] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Aug 18 10:49:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:49:02.398077 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3880ebb6-6b61-4f92-b130-f896054c0f3b None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:02.398365 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3880ebb6-6b61-4f92-b130-f896054c0f3b None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:02.398641 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3880ebb6-6b61-4f92-b130-f896054c0f3b None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:02.400766 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 34/73] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:49:02 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:49:02.405399 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3880ebb6-6b61-4f92-b130-f896054c0f3b None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:02.408498 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f9de17-91e7-4bc9-b10d-5df09f029a42 None admin] RBAC: Authorizing `identity:get_user(user_id=dbca316ef38e45aeb63de5837094e8ce)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:02.410021 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f9de17-91e7-4bc9-b10d-5df09f029a42 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:02.411706 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 40/74] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Aug 18 10:49:02 2022] GET /identity/v3/users/dbca316ef38e45aeb63de5837094e8ce => generated 275 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:02.412468 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f9de17-91e7-4bc9-b10d-5df09f029a42 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:02.428203 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:02.521205 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f9de17-91e7-4bc9-b10d-5df09f029a42 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:02.522424 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3880ebb6-6b61-4f92-b130-f896054c0f3b None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:02.543324 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:02.556677 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af13b3b8-8bf0-4e73-beab-94a440093d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:02.557290 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af13b3b8-8bf0-4e73-beab-94a440093d24 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:02.557616 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af13b3b8-8bf0-4e73-beab-94a440093d24 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:02.557733 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd6f82f-aa8d-4d94-9c25-29556d704032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:02.558050 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af13b3b8-8bf0-4e73-beab-94a440093d24 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:02.558295 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd6f82f-aa8d-4d94-9c25-29556d704032 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:02.558613 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd6f82f-aa8d-4d94-9c25-29556d704032 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:02.558863 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd6f82f-aa8d-4d94-9c25-29556d704032 None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:02.559528 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd6f82f-aa8d-4d94-9c25-29556d704032 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:49:02.559833 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd6f82f-aa8d-4d94-9c25-29556d704032 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:02.561207 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd6f82f-aa8d-4d94-9c25-29556d704032 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:02.568346 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af13b3b8-8bf0-4e73-beab-94a440093d24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:49:02.569553 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 41/75] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 18 10:49:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:02.570737 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca0a38-157b-47f5-b330-41ef07553dcf None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:02.571026 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca0a38-157b-47f5-b330-41ef07553dcf None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:02.571306 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca0a38-157b-47f5-b330-41ef07553dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:02.573538 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-af13b3b8-8bf0-4e73-beab-94a440093d24 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 10:49:02.573538 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:49:02.573538 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:49:02.573538 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:49:02.573538 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:49:02.573538 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:49:02.573538 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:49:02.573538 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:49:02.573538 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:49:02.573538 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:49:02.573538 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:49:02.573538 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:49:02.573538 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:49:02.573538 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:49:02.573538 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:49:02.573538 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:49:02.574968 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:49:02.574968 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:49:02.574968 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:49:02.574968 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:49:02.574968 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:49:02.574968 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:49:02.574968 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:49:02.574968 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:49:02.574968 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:49:02.574968 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:49:02.574968 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:49:02.574968 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:49:02.574968 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:49:02.574968 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:49:02.574968 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:49:02.574968 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:49:02.575901 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:49:02.575901 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:49:02.575901 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:49:02.575901 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:49:02.575901 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:49:02.575901 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:49:02.575901 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:49:02.575901 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:49:02.575901 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:49:02.575901 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:49:02.575901 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 10:49:02.575901 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:49:02.575901 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 35/76] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Aug 18 10:49:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:49:02.575901 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af13b3b8-8bf0-4e73-beab-94a440093d24 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:02.594974 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-71ca0a38-157b-47f5-b330-41ef07553dcf None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:49:02.596188 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-71ca0a38-157b-47f5-b330-41ef07553dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:49:02.659378 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:02.665476 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 42/77] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:49:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 10:49:02.666966 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ca0a38-157b-47f5-b330-41ef07553dcf None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:02.699781 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af13b3b8-8bf0-4e73-beab-94a440093d24 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:02.739020 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff6900a-bd7a-4a3e-b6d4-ca089254b583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:02.739755 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff6900a-bd7a-4a3e-b6d4-ca089254b583 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:02.740037 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff6900a-bd7a-4a3e-b6d4-ca089254b583 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:02.740313 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff6900a-bd7a-4a3e-b6d4-ca089254b583 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:02.775093 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ca0a38-157b-47f5-b330-41ef07553dcf None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:02.789582 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:02.816142 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c779f8-2903-4222-be80-765e201db036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:02.816790 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c779f8-2903-4222-be80-765e201db036 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:02.817078 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c779f8-2903-4222-be80-765e201db036 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:02.817359 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c779f8-2903-4222-be80-765e201db036 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:02.817763 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff6900a-bd7a-4a3e-b6d4-ca089254b583 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:02.819406 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff6900a-bd7a-4a3e-b6d4-ca089254b583 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:02.828935 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c779f8-2903-4222-be80-765e201db036 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:49:02.833715 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-17c779f8-2903-4222-be80-765e201db036 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 10:49:02.833715 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:49:02.833715 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:49:02.833715 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:49:02.833715 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:49:02.833715 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:49:02.833715 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:49:02.833715 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:49:02.833715 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:49:02.833715 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:49:02.833715 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:49:02.833715 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:49:02.833715 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:49:02.833715 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:49:02.833715 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:49:02.833715 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:49:02.834548 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:49:02.834548 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:49:02.834548 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:49:02.834548 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:49:02.834548 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:49:02.834548 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:49:02.834548 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:49:02.834548 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:49:02.834548 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:49:02.834548 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:49:02.834548 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:49:02.834548 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:49:02.834548 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:49:02.834548 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:49:02.834548 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:49:02.834548 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:49:02.835376 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:49:02.835376 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:49:02.835376 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:49:02.835376 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:49:02.835376 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:49:02.835376 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:49:02.835376 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:49:02.835376 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:49:02.835376 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:49:02.835376 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:49:02.835376 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 10:49:02.835376 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:49:02.835376 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 43/78] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 18 10:49:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:49:02.836002 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c779f8-2903-4222-be80-765e201db036 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:02.916594 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:02.941252 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 36/79] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 18 10:49:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 10:49:02.942162 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff6900a-bd7a-4a3e-b6d4-ca089254b583 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:02.953875 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c779f8-2903-4222-be80-765e201db036 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:02.995862 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae18578-298a-43ea-8d80-2dabd0e83942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:02.996503 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae18578-298a-43ea-8d80-2dabd0e83942 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:02.996790 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae18578-298a-43ea-8d80-2dabd0e83942 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:02.997075 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae18578-298a-43ea-8d80-2dabd0e83942 None admin] PATH_INFO: `/v3/users/55b16d3a97d74b659d9af679ed207645` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:02.998542 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae18578-298a-43ea-8d80-2dabd0e83942 None admin] RBAC: Authorizing `identity:get_user(user_id=55b16d3a97d74b659d9af679ed207645)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:03.000070 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae18578-298a-43ea-8d80-2dabd0e83942 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:03.001621 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 44/80] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Aug 18 10:49:02 2022] GET /identity/v3/users/55b16d3a97d74b659d9af679ed207645 => generated 247 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:03.002399 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae18578-298a-43ea-8d80-2dabd0e83942 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:03.047036 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:03.052340 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff6900a-bd7a-4a3e-b6d4-ca089254b583 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:03.087016 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98989151-b470-4bbf-8a20-710f086826d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:03.087608 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98989151-b470-4bbf-8a20-710f086826d2 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:03.088391 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98989151-b470-4bbf-8a20-710f086826d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:03.088761 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98989151-b470-4bbf-8a20-710f086826d2 None admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:03.089412 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98989151-b470-4bbf-8a20-710f086826d2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:49:03.089737 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98989151-b470-4bbf-8a20-710f086826d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:03.091131 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98989151-b470-4bbf-8a20-710f086826d2 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:03.104207 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 37/81] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 18 10:49:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:03.104207 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98989151-b470-4bbf-8a20-710f086826d2 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:03.104692 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae18578-298a-43ea-8d80-2dabd0e83942 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:03.139830 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7a4c4a-ffd1-4642-bc65-8ee0e2cc7220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:03.140771 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a4c4a-ffd1-4642-bc65-8ee0e2cc7220 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:03.141232 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a4c4a-ffd1-4642-bc65-8ee0e2cc7220 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:03.141738 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a4c4a-ffd1-4642-bc65-8ee0e2cc7220 None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:03.142860 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7a4c4a-ffd1-4642-bc65-8ee0e2cc7220 None admin] RBAC: Adding query filter params (name=member) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:49:03.143374 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7a4c4a-ffd1-4642-bc65-8ee0e2cc7220 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:03.145430 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7a4c4a-ffd1-4642-bc65-8ee0e2cc7220 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:03.155288 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:03.157452 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 45/82] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Aug 18 10:49:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:03.158671 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7a4c4a-ffd1-4642-bc65-8ee0e2cc7220 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:03.221388 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98989151-b470-4bbf-8a20-710f086826d2 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:03.257101 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee905a49-5f86-4b1e-a0ff-f58d5b397c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:03.257101 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee905a49-5f86-4b1e-a0ff-f58d5b397c92 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:03.257101 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee905a49-5f86-4b1e-a0ff-f58d5b397c92 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:03.257101 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee905a49-5f86-4b1e-a0ff-f58d5b397c92 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:03.258371 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee905a49-5f86-4b1e-a0ff-f58d5b397c92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:03.260404 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee905a49-5f86-4b1e-a0ff-f58d5b397c92 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:03.265575 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 38/83] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:49:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:03.265575 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee905a49-5f86-4b1e-a0ff-f58d5b397c92 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:03.265812 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7a4c4a-ffd1-4642-bc65-8ee0e2cc7220 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:03.267410 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:03.301443 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f371d6-a131-457b-8068-26469f6f0c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:03.302115 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f371d6-a131-457b-8068-26469f6f0c8b None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:03.302394 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f371d6-a131-457b-8068-26469f6f0c8b None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:03.302670 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f371d6-a131-457b-8068-26469f6f0c8b None admin] PATH_INFO: `/v3/projects/db515fd18ab64bc190c7a76ae5f7e632` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:03.303843 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f371d6-a131-457b-8068-26469f6f0c8b None admin] RBAC: Authorizing `identity:get_project(project_id=db515fd18ab64bc190c7a76ae5f7e632)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:03.305296 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f371d6-a131-457b-8068-26469f6f0c8b None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:03.307520 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 46/84] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 18 10:49:03 2022] GET /identity/v3/projects/db515fd18ab64bc190c7a76ae5f7e632 => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:03.308288 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f371d6-a131-457b-8068-26469f6f0c8b None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:03.373565 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee905a49-5f86-4b1e-a0ff-f58d5b397c92 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:03.382422 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:03.408760 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f371d6-a131-457b-8068-26469f6f0c8b None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:03.409570 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13793a50-fd08-470d-a748-1223d2d249c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:03.410190 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13793a50-fd08-470d-a748-1223d2d249c0 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:03.410475 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13793a50-fd08-470d-a748-1223d2d249c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:03.410750 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13793a50-fd08-470d-a748-1223d2d249c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:03.443638 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42789c62-0515-450e-831b-5764fb81fc08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:03.444279 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42789c62-0515-450e-831b-5764fb81fc08 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:03.444553 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42789c62-0515-450e-831b-5764fb81fc08 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:03.444826 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42789c62-0515-450e-831b-5764fb81fc08 None admin] PATH_INFO: `/v3/users/dbca316ef38e45aeb63de5837094e8ce` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:03.446003 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42789c62-0515-450e-831b-5764fb81fc08 None admin] RBAC: Authorizing `identity:get_user(user_id=dbca316ef38e45aeb63de5837094e8ce)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:03.448023 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42789c62-0515-450e-831b-5764fb81fc08 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:03.449617 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 47/85] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Aug 18 10:49:03 2022] GET /identity/v3/users/dbca316ef38e45aeb63de5837094e8ce => generated 275 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:03.450393 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42789c62-0515-450e-831b-5764fb81fc08 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:03.485364 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13793a50-fd08-470d-a748-1223d2d249c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:03.486861 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13793a50-fd08-470d-a748-1223d2d249c0 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:03.491466 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:03.550776 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42789c62-0515-450e-831b-5764fb81fc08 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:03.585182 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd355440-2284-4bb8-b39c-1a0c98e95e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:03.585846 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd355440-2284-4bb8-b39c-1a0c98e95e93 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:03.586129 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd355440-2284-4bb8-b39c-1a0c98e95e93 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:03.586405 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd355440-2284-4bb8-b39c-1a0c98e95e93 None admin] PATH_INFO: `/v3/users/dbca316ef38e45aeb63de5837094e8ce` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:03.587094 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 39/86] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 18 10:49:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 10:49:03.588209 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd355440-2284-4bb8-b39c-1a0c98e95e93 None admin] RBAC: Authorizing `identity:get_user(user_id=dbca316ef38e45aeb63de5837094e8ce)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:03.588670 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13793a50-fd08-470d-a748-1223d2d249c0 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:03.589759 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd355440-2284-4bb8-b39c-1a0c98e95e93 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:03.591359 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 48/87] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Aug 18 10:49:03 2022] GET /identity/v3/users/dbca316ef38e45aeb63de5837094e8ce => generated 275 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:03.592216 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd355440-2284-4bb8-b39c-1a0c98e95e93 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:03.603603 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:03.697381 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13793a50-fd08-470d-a748-1223d2d249c0 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:03.699852 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd355440-2284-4bb8-b39c-1a0c98e95e93 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:03.706877 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:03.734225 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a367afce-ff71-417e-a7b4-325b65205448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:03.734888 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a367afce-ff71-417e-a7b4-325b65205448 None admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:03.734991 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de786f63-adce-40b3-a885-ad6679d775a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:03.735205 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a367afce-ff71-417e-a7b4-325b65205448 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:03.735447 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a367afce-ff71-417e-a7b4-325b65205448 None admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:03.735538 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de786f63-adce-40b3-a885-ad6679d775a9 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:03.735814 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de786f63-adce-40b3-a885-ad6679d775a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:03.736093 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de786f63-adce-40b3-a885-ad6679d775a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:03.736190 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a367afce-ff71-417e-a7b4-325b65205448 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:03.736825 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de786f63-adce-40b3-a885-ad6679d775a9 None admin] RBAC: Adding query filter params (role.id=719e5c62188d4f8a838987d6e72ca8f7, scope.project.id=db515fd18ab64bc190c7a76ae5f7e632, user.id=dbca316ef38e45aeb63de5837094e8ce) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:49:03.737137 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de786f63-adce-40b3-a885-ad6679d775a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:03.737577 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a367afce-ff71-417e-a7b4-325b65205448 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:03.738611 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de786f63-adce-40b3-a885-ad6679d775a9 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:03.744220 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 49/88] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Aug 18 10:49:03 2022] GET /identity/v3/role_assignments?user.id=dbca316ef38e45aeb63de5837094e8ce&scope.project.id=db515fd18ab64bc190c7a76ae5f7e632&role.id=719e5c62188d4f8a838987d6e72ca8f7 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:03.745209 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de786f63-adce-40b3-a885-ad6679d775a9 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:03.767958 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 40/89] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Aug 18 10:49:03 2022] POST /identity/v3/users => generated 289 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 10:49:03.769036 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a367afce-ff71-417e-a7b4-325b65205448 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:03.848266 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:03.902896 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de786f63-adce-40b3-a885-ad6679d775a9 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:03.903616 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a367afce-ff71-417e-a7b4-325b65205448 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:03.953315 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaeaaeb-beda-4a7f-bfb4-2d570c816385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:03.953900 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaeaaeb-beda-4a7f-bfb4-2d570c816385 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:03.954184 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaeaaeb-beda-4a7f-bfb4-2d570c816385 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:03.954458 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaeaaeb-beda-4a7f-bfb4-2d570c816385 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:03.962236 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e6e306-ae6e-47e1-b7f3-d865a6647ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:03.963489 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e6e306-ae6e-47e1-b7f3-d865a6647ec6 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:03.963775 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e6e306-ae6e-47e1-b7f3-d865a6647ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:03.964049 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e6e306-ae6e-47e1-b7f3-d865a6647ec6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:04.010569 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:04.058182 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e6e306-ae6e-47e1-b7f3-d865a6647ec6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:04.059858 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e6e306-ae6e-47e1-b7f3-d865a6647ec6 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:04.060777 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaeaaeb-beda-4a7f-bfb4-2d570c816385 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:04.062460 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaeaaeb-beda-4a7f-bfb4-2d570c816385 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:04.168400 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:04.207622 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 50/90] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 18 10:49:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 10:49:04.207622 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaeaaeb-beda-4a7f-bfb4-2d570c816385 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:04.216741 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 41/91] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 18 10:49:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 10:49:04.216741 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e6e306-ae6e-47e1-b7f3-d865a6647ec6 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:04.313923 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:04.327979 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e6e306-ae6e-47e1-b7f3-d865a6647ec6 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:04.362090 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaeaaeb-beda-4a7f-bfb4-2d570c816385 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:04.407738 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c62b184-92cc-4814-b586-722fd62921ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:04.408416 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c62b184-92cc-4814-b586-722fd62921ad None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:04.408743 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c62b184-92cc-4814-b586-722fd62921ad None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:04.409048 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c62b184-92cc-4814-b586-722fd62921ad None admin] PATH_INFO: `/v3/projects/db515fd18ab64bc190c7a76ae5f7e632` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:04.410632 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c62b184-92cc-4814-b586-722fd62921ad None admin] RBAC: Authorizing `identity:get_project(project_id=db515fd18ab64bc190c7a76ae5f7e632)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:04.412153 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c62b184-92cc-4814-b586-722fd62921ad None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:04.416564 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 42/92] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 18 10:49:04 2022] GET /identity/v3/projects/db515fd18ab64bc190c7a76ae5f7e632 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:04.417548 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c62b184-92cc-4814-b586-722fd62921ad None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:04.442631 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca4eeb6-03fd-4f4f-91a3-949d9e0b07fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:04.443281 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca4eeb6-03fd-4f4f-91a3-949d9e0b07fd None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:04.443616 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca4eeb6-03fd-4f4f-91a3-949d9e0b07fd None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:04.443891 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca4eeb6-03fd-4f4f-91a3-949d9e0b07fd None admin] PATH_INFO: `/v3/projects/db515fd18ab64bc190c7a76ae5f7e632` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:04.445236 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca4eeb6-03fd-4f4f-91a3-949d9e0b07fd None admin] RBAC: Authorizing `identity:get_project(project_id=db515fd18ab64bc190c7a76ae5f7e632)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:04.446729 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca4eeb6-03fd-4f4f-91a3-949d9e0b07fd None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:04.449091 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 51/93] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 18 10:49:04 2022] GET /identity/v3/projects/db515fd18ab64bc190c7a76ae5f7e632 => generated 298 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:04.449715 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca4eeb6-03fd-4f4f-91a3-949d9e0b07fd None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:04.494457 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:04.630229 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca4eeb6-03fd-4f4f-91a3-949d9e0b07fd None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:04.691986 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c62b184-92cc-4814-b586-722fd62921ad None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:04.695391 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a682ea-b9ef-42e1-9df4-736fe19c5840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:04.696020 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a682ea-b9ef-42e1-9df4-736fe19c5840 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:04.696303 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a682ea-b9ef-42e1-9df4-736fe19c5840 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:04.696580 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a682ea-b9ef-42e1-9df4-736fe19c5840 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:04.699224 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a682ea-b9ef-42e1-9df4-736fe19c5840 None admin] RBAC: Adding query filter params (role.id=0ecb6b324fc643f3826b2878f2f6174b, scope.project.id=db515fd18ab64bc190c7a76ae5f7e632, user.id=dbca316ef38e45aeb63de5837094e8ce) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:49:04.699224 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a682ea-b9ef-42e1-9df4-736fe19c5840 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:04.700559 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a682ea-b9ef-42e1-9df4-736fe19c5840 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:04.710098 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 52/94] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Aug 18 10:49:04 2022] GET /identity/v3/role_assignments?user.id=dbca316ef38e45aeb63de5837094e8ce&scope.project.id=db515fd18ab64bc190c7a76ae5f7e632&role.id=0ecb6b324fc643f3826b2878f2f6174b => generated 259 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:04.710950 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a682ea-b9ef-42e1-9df4-736fe19c5840 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:04.714091 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:04.764850 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f434eae1-29b7-4e8c-9a25-0f3e16e3dad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:04.765894 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f434eae1-29b7-4e8c-9a25-0f3e16e3dad6 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:04.766397 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f434eae1-29b7-4e8c-9a25-0f3e16e3dad6 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:04.766884 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f434eae1-29b7-4e8c-9a25-0f3e16e3dad6 None admin] PATH_INFO: `/v3/projects/9e375c249e6e487586047ee77015bfe2` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:04.770379 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f434eae1-29b7-4e8c-9a25-0f3e16e3dad6 None admin] RBAC: Authorizing `identity:get_project(project_id=9e375c249e6e487586047ee77015bfe2)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:04.772610 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f434eae1-29b7-4e8c-9a25-0f3e16e3dad6 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:04.774846 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 43/95] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 18 10:49:04 2022] GET /identity/v3/projects/9e375c249e6e487586047ee77015bfe2 => generated 312 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:04.780881 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f434eae1-29b7-4e8c-9a25-0f3e16e3dad6 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:04.832829 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a682ea-b9ef-42e1-9df4-736fe19c5840 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:04.872803 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fbfb49-4be4-4b01-b501-02774d4aa914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:04.873538 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fbfb49-4be4-4b01-b501-02774d4aa914 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:04.873838 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fbfb49-4be4-4b01-b501-02774d4aa914 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:04.874119 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fbfb49-4be4-4b01-b501-02774d4aa914 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:04.874859 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fbfb49-4be4-4b01-b501-02774d4aa914 None admin] RBAC: Adding query filter params (role.id=127fdc7ef05b4e0b98a940b334e5fcab, scope.project.id=db515fd18ab64bc190c7a76ae5f7e632, user.id=55b16d3a97d74b659d9af679ed207645) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:49:04.875171 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fbfb49-4be4-4b01-b501-02774d4aa914 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:04.877056 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fbfb49-4be4-4b01-b501-02774d4aa914 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:04.885583 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 53/96] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Aug 18 10:49:04 2022] GET /identity/v3/role_assignments?user.id=55b16d3a97d74b659d9af679ed207645&scope.project.id=db515fd18ab64bc190c7a76ae5f7e632&role.id=127fdc7ef05b4e0b98a940b334e5fcab => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:04.937660 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:04.942617 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f434eae1-29b7-4e8c-9a25-0f3e16e3dad6 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:04.990445 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc8b1b8-6b6b-4ac9-82b7-885c22474f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:04.991331 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc8b1b8-6b6b-4ac9-82b7-885c22474f41 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:04.991849 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc8b1b8-6b6b-4ac9-82b7-885c22474f41 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:04.992272 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc8b1b8-6b6b-4ac9-82b7-885c22474f41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:04.993247 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc8b1b8-6b6b-4ac9-82b7-885c22474f41 None admin] RBAC: Adding query filter params (role.id=719e5c62188d4f8a838987d6e72ca8f7, scope.project.id=9e375c249e6e487586047ee77015bfe2, user.id=dbca316ef38e45aeb63de5837094e8ce) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:49:04.993782 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc8b1b8-6b6b-4ac9-82b7-885c22474f41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:04.995543 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc8b1b8-6b6b-4ac9-82b7-885c22474f41 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:05.002707 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 44/97] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Aug 18 10:49:04 2022] GET /identity/v3/role_assignments?user.id=dbca316ef38e45aeb63de5837094e8ce&scope.project.id=9e375c249e6e487586047ee77015bfe2&role.id=719e5c62188d4f8a838987d6e72ca8f7 => generated 259 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:06.347370 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e8644-e252-430f-8eb4-c4fb82d739d2 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:06.348075 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e8644-e252-430f-8eb4-c4fb82d739d2 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:06.348075 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e8644-e252-430f-8eb4-c4fb82d739d2 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:06.349275 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 54/98] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:49:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 10:49:06.355432 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e01f10-5151-4b51-ba9e-139dd0fe4133 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:06.356384 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e01f10-5151-4b51-ba9e-139dd0fe4133 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:06.356810 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e01f10-5151-4b51-ba9e-139dd0fe4133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:06.387397 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-09e01f10-5151-4b51-ba9e-139dd0fe4133 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:49:06.389046 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-09e01f10-5151-4b51-ba9e-139dd0fe4133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:49:06.423383 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc47d9-a139-43c6-9f45-14b4bc5f2471 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:06.423999 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc47d9-a139-43c6-9f45-14b4bc5f2471 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:06.424502 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc47d9-a139-43c6-9f45-14b4bc5f2471 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:06.426104 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 55/99] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:49:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 10:49:06.432083 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f7dda-19fc-443e-831b-b6f3ce2914c6 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:06.432642 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f7dda-19fc-443e-831b-b6f3ce2914c6 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:06.433122 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f7dda-19fc-443e-831b-b6f3ce2914c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:06.452465 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-382f7dda-19fc-443e-831b-b6f3ce2914c6 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:49:06.454063 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-382f7dda-19fc-443e-831b-b6f3ce2914c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:49:06.500727 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 45/100] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:49:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 10:49:06.545422 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:06.554828 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 56/101] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:49:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 10:49:06.757975 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e9fc8-f586-4380-bf97-1a6722ad7838 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:06.758311 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e9fc8-f586-4380-bf97-1a6722ad7838 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:06.758488 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e9fc8-f586-4380-bf97-1a6722ad7838 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:06.760641 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 46/102] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:49:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:49:06.765617 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c59761-3bff-467b-ad4b-5c3243546333 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:06.765915 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c59761-3bff-467b-ad4b-5c3243546333 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:06.766201 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c59761-3bff-467b-ad4b-5c3243546333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:06.791100 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-20c59761-3bff-467b-ad4b-5c3243546333 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:49:06.792321 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-20c59761-3bff-467b-ad4b-5c3243546333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:49:06.876550 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 57/103] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:49:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 10:49:07.026439 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5e9fc8-f586-4380-bf97-1a6722ad7838 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:07.050244 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c59761-3bff-467b-ad4b-5c3243546333 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:07.209911 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:07.219032 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c59761-3bff-467b-ad4b-5c3243546333 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:07.228830 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5e9fc8-f586-4380-bf97-1a6722ad7838 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:07.273196 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:07.296557 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a59278d-6fbe-4510-a346-5771a59d35b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:07.297123 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a59278d-6fbe-4510-a346-5771a59d35b0 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:07.297402 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a59278d-6fbe-4510-a346-5771a59d35b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:07.297717 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a59278d-6fbe-4510-a346-5771a59d35b0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:07.306297 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd9f60e-fb2a-447d-969c-8edf3e23f95c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:07.306961 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd9f60e-fb2a-447d-969c-8edf3e23f95c None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:07.307249 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd9f60e-fb2a-447d-969c-8edf3e23f95c None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:07.307532 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd9f60e-fb2a-447d-969c-8edf3e23f95c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:07.308711 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd9f60e-fb2a-447d-969c-8edf3e23f95c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:07.310224 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd9f60e-fb2a-447d-969c-8edf3e23f95c None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:07.311828 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 47/104] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:49:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:07.317268 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a59278d-6fbe-4510-a346-5771a59d35b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:49:07.318407 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd9f60e-fb2a-447d-969c-8edf3e23f95c None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:07.322653 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-2a59278d-6fbe-4510-a346-5771a59d35b0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 10:49:07.322653 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:49:07.322653 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:49:07.322653 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:49:07.322653 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:49:07.322653 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:49:07.322653 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:49:07.322653 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:49:07.322653 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:49:07.322653 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:49:07.322653 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:49:07.322653 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:49:07.322653 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:49:07.322653 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:49:07.322653 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:49:07.322653 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:49:07.323684 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:49:07.323684 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:49:07.323684 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:49:07.323684 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:49:07.323684 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:49:07.323684 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:49:07.323684 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:49:07.323684 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:49:07.323684 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:49:07.323684 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:49:07.323684 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:49:07.323684 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:49:07.323684 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:49:07.323684 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:49:07.323684 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:49:07.323684 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:49:07.325122 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:49:07.325122 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:49:07.325122 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:49:07.325122 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:49:07.325122 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:49:07.325122 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:49:07.325122 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:49:07.325122 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:49:07.325122 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:49:07.325122 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:49:07.325122 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 10:49:07.325122 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:49:07.325122 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 58/105] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 18 10:49:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 10:49:07.330473 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a59278d-6fbe-4510-a346-5771a59d35b0 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:07.486066 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a59278d-6fbe-4510-a346-5771a59d35b0 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:07.536324 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d2016-c88f-4187-abf2-ffdce0631469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:07.538005 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d2016-c88f-4187-abf2-ffdce0631469 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:07.538289 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d2016-c88f-4187-abf2-ffdce0631469 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:07.538563 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d2016-c88f-4187-abf2-ffdce0631469 None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:07.539233 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6d2016-c88f-4187-abf2-ffdce0631469 None admin] RBAC: Adding query filter params (name=member) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:49:07.539763 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6d2016-c88f-4187-abf2-ffdce0631469 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:07.541196 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6d2016-c88f-4187-abf2-ffdce0631469 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:07.555886 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 59/106] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Aug 18 10:49:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 10:49:07.556708 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d2016-c88f-4187-abf2-ffdce0631469 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:07.567529 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd9f60e-fb2a-447d-969c-8edf3e23f95c None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:07.637546 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:07.638521 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5103b346-bb7e-4c06-a339-7836aca4cd91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:07.639314 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5103b346-bb7e-4c06-a339-7836aca4cd91 None admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:07.639602 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5103b346-bb7e-4c06-a339-7836aca4cd91 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:07.639879 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5103b346-bb7e-4c06-a339-7836aca4cd91 None admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:07.640745 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5103b346-bb7e-4c06-a339-7836aca4cd91 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:07.642448 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5103b346-bb7e-4c06-a339-7836aca4cd91 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:07.673358 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 48/107] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Aug 18 10:49:07 2022] POST /identity/v3/projects => generated 302 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 10:49:07.674291 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5103b346-bb7e-4c06-a339-7836aca4cd91 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:07.693939 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:07.698443 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d2016-c88f-4187-abf2-ffdce0631469 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:07.779762 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9832f419-0f54-4f7b-991b-2a57d7becc9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:07.780536 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9832f419-0f54-4f7b-991b-2a57d7becc9b None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:07.780825 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9832f419-0f54-4f7b-991b-2a57d7becc9b None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:07.781103 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9832f419-0f54-4f7b-991b-2a57d7becc9b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:07.803068 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5103b346-bb7e-4c06-a339-7836aca4cd91 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:07.814407 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9832f419-0f54-4f7b-991b-2a57d7becc9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:49:07.819606 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-9832f419-0f54-4f7b-991b-2a57d7becc9b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 10:49:07.819606 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:49:07.819606 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:49:07.819606 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:49:07.819606 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:49:07.819606 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:49:07.819606 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:49:07.819606 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:49:07.819606 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:49:07.819606 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:49:07.819606 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:49:07.819606 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:49:07.819606 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:49:07.819606 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:49:07.819606 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:49:07.819606 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:49:07.820698 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:49:07.820698 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:49:07.820698 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:49:07.820698 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:49:07.820698 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:49:07.820698 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:49:07.820698 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:49:07.820698 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:49:07.820698 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:49:07.820698 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:49:07.820698 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:49:07.820698 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:49:07.820698 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:49:07.820698 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:49:07.820698 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:49:07.820698 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:49:07.821463 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:49:07.821463 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:49:07.821463 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:49:07.821463 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:49:07.821463 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:49:07.821463 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:49:07.821463 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:49:07.821463 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:49:07.821463 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:49:07.821463 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:49:07.821463 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 10:49:07.821463 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:49:07.821463 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 60/108] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 18 10:49:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:49:07.823169 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6983a4-6b57-49e1-8c90-8b47061503fd None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:07.823323 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6983a4-6b57-49e1-8c90-8b47061503fd None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:07.825556 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6983a4-6b57-49e1-8c90-8b47061503fd None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:07.830796 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 61/109] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:49:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:49:07.834826 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6983a4-6b57-49e1-8c90-8b47061503fd None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:07.848166 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8c5b33-c1b6-4610-b42e-0d4c19832312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:07.848867 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8c5b33-c1b6-4610-b42e-0d4c19832312 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:07.849201 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8c5b33-c1b6-4610-b42e-0d4c19832312 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:07.849483 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8c5b33-c1b6-4610-b42e-0d4c19832312 None admin] PATH_INFO: `/v3/users/dbca316ef38e45aeb63de5837094e8ce` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:07.850916 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8c5b33-c1b6-4610-b42e-0d4c19832312 None admin] RBAC: Authorizing `identity:get_user(user_id=dbca316ef38e45aeb63de5837094e8ce)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:07.852383 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8c5b33-c1b6-4610-b42e-0d4c19832312 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:07.854130 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 49/110] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Aug 18 10:49:07 2022] GET /identity/v3/users/dbca316ef38e45aeb63de5837094e8ce => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:07.855271 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e210600-ae53-4e99-b662-5856ec174b24 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:07.855609 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e210600-ae53-4e99-b662-5856ec174b24 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:07.855886 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e210600-ae53-4e99-b662-5856ec174b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:07.878850 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-9e210600-ae53-4e99-b662-5856ec174b24 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:49:07.880113 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-9e210600-ae53-4e99-b662-5856ec174b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:49:07.966478 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 50/111] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:49:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 10:49:07.967367 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e210600-ae53-4e99-b662-5856ec174b24 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:07.987412 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:08.008756 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6983a4-6b57-49e1-8c90-8b47061503fd None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:08.019712 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:08.049585 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ea4c4e-fa5f-44fc-a894-d67121b032c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:08.050270 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea4c4e-fa5f-44fc-a894-d67121b032c9 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:08.050611 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea4c4e-fa5f-44fc-a894-d67121b032c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:08.050899 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea4c4e-fa5f-44fc-a894-d67121b032c9 None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:08.051668 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ea4c4e-fa5f-44fc-a894-d67121b032c9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:49:08.051980 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ea4c4e-fa5f-44fc-a894-d67121b032c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:08.053771 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ea4c4e-fa5f-44fc-a894-d67121b032c9 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:08.063776 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 62/112] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Aug 18 10:49:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:08.066061 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c84b79-e1e8-4d16-bb00-bc95326f22b7 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:08.066511 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c84b79-e1e8-4d16-bb00-bc95326f22b7 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:08.067343 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c84b79-e1e8-4d16-bb00-bc95326f22b7 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:08.069434 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 63/113] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:49:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:49:08.070703 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c84b79-e1e8-4d16-bb00-bc95326f22b7 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:08.089170 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e210600-ae53-4e99-b662-5856ec174b24 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:08.129105 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf74bc0-05ca-44bf-806a-d47a97da3e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:08.130896 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf74bc0-05ca-44bf-806a-d47a97da3e56 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:08.131694 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf74bc0-05ca-44bf-806a-d47a97da3e56 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:08.133270 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf74bc0-05ca-44bf-806a-d47a97da3e56 None admin] PATH_INFO: `/v3/projects/db515fd18ab64bc190c7a76ae5f7e632` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:08.135987 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf74bc0-05ca-44bf-806a-d47a97da3e56 None admin] RBAC: Authorizing `identity:get_project(project_id=db515fd18ab64bc190c7a76ae5f7e632)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:08.137742 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf74bc0-05ca-44bf-806a-d47a97da3e56 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:08.140276 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 51/114] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 18 10:49:07 2022] GET /identity/v3/projects/db515fd18ab64bc190c7a76ae5f7e632 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:08.142514 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeca59c-9e2f-4726-b930-702b44e63a18 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:08.143521 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeca59c-9e2f-4726-b930-702b44e63a18 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:08.144099 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeca59c-9e2f-4726-b930-702b44e63a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:08.169176 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-deeca59c-9e2f-4726-b930-702b44e63a18 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:49:08.171016 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-deeca59c-9e2f-4726-b930-702b44e63a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:49:08.254888 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c84b79-e1e8-4d16-bb00-bc95326f22b7 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:08.256035 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 52/115] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:49:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 10:49:08.258276 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeca59c-9e2f-4726-b930-702b44e63a18 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:08.272431 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:08.300534 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8be61d3-c9de-4b9b-90be-12fd77733b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:08.301227 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8be61d3-c9de-4b9b-90be-12fd77733b80 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:08.301809 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8be61d3-c9de-4b9b-90be-12fd77733b80 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:08.302093 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8be61d3-c9de-4b9b-90be-12fd77733b80 None admin] PATH_INFO: `/v3/users/a02a06e1ca6a47768fbad9958a5a1b39` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:08.321103 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8be61d3-c9de-4b9b-90be-12fd77733b80 None admin] RBAC: Authorizing `identity:get_user(user_id=a02a06e1ca6a47768fbad9958a5a1b39)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:08.323300 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8be61d3-c9de-4b9b-90be-12fd77733b80 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:08.325697 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 64/116] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Aug 18 10:49:08 2022] GET /identity/v3/users/a02a06e1ca6a47768fbad9958a5a1b39 => generated 289 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:08.327002 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1798d4c7-594e-40e5-bdef-4393e8713c71 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:08.327282 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1798d4c7-594e-40e5-bdef-4393e8713c71 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:08.327556 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1798d4c7-594e-40e5-bdef-4393e8713c71 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:08.328768 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 65/117] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:49:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:49:08.329754 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1798d4c7-594e-40e5-bdef-4393e8713c71 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:08.373042 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:08.390988 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeca59c-9e2f-4726-b930-702b44e63a18 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:08.433435 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95666001-436c-43bc-a60c-8bc76328d421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:08.434599 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95666001-436c-43bc-a60c-8bc76328d421 None admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:08.435128 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95666001-436c-43bc-a60c-8bc76328d421 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:08.435673 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95666001-436c-43bc-a60c-8bc76328d421 None admin] PATH_INFO: `/v3/projects/db515fd18ab64bc190c7a76ae5f7e632/users/dbca316ef38e45aeb63de5837094e8ce/roles/719e5c62188d4f8a838987d6e72ca8f7` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:08.438241 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95666001-436c-43bc-a60c-8bc76328d421 None admin] RBAC: Authorizing `identity:create_grant(project_id=db515fd18ab64bc190c7a76ae5f7e632, user_id=dbca316ef38e45aeb63de5837094e8ce, role_id=719e5c62188d4f8a838987d6e72ca8f7)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:08.440111 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95666001-436c-43bc-a60c-8bc76328d421 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:08.457960 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 53/118] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Aug 18 10:49:08 2022] PUT /identity/v3/projects/db515fd18ab64bc190c7a76ae5f7e632/users/dbca316ef38e45aeb63de5837094e8ce/roles/719e5c62188d4f8a838987d6e72ca8f7 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 10:49:08.460147 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7964290c-d5f7-4095-bec2-428817bcd007 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:08.461069 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7964290c-d5f7-4095-bec2-428817bcd007 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:08.461592 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7964290c-d5f7-4095-bec2-428817bcd007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:08.497546 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1798d4c7-594e-40e5-bdef-4393e8713c71 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:08.506714 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-7964290c-d5f7-4095-bec2-428817bcd007 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:49:08.510303 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-7964290c-d5f7-4095-bec2-428817bcd007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:49:08.567855 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50545a4-3f0e-4966-8434-1bf04a19e934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:08.569379 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50545a4-3f0e-4966-8434-1bf04a19e934 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:08.570160 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50545a4-3f0e-4966-8434-1bf04a19e934 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:08.570643 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50545a4-3f0e-4966-8434-1bf04a19e934 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:08.585469 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50545a4-3f0e-4966-8434-1bf04a19e934 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:49:08.592981 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-a50545a4-3f0e-4966-8434-1bf04a19e934 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 10:49:08.592981 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:49:08.592981 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:49:08.592981 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:49:08.592981 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:49:08.592981 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:49:08.592981 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:49:08.592981 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:49:08.592981 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:49:08.592981 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:49:08.592981 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:49:08.592981 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:49:08.592981 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:49:08.592981 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:49:08.592981 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:49:08.592981 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:49:08.593951 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:49:08.593951 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:49:08.593951 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:49:08.593951 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:49:08.593951 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:49:08.593951 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:49:08.593951 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:49:08.593951 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:49:08.593951 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:49:08.593951 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:49:08.593951 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:49:08.593951 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:49:08.593951 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:49:08.593951 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:49:08.593951 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:49:08.593951 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:49:08.594701 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:49:08.594701 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:49:08.594701 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:49:08.594701 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:49:08.594701 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:49:08.594701 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:49:08.594701 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:49:08.594701 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:49:08.594701 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:49:08.594701 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:49:08.594701 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 10:49:08.594701 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:49:08.595268 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 66/119] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Aug 18 10:49:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:49:08.596332 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50545a4-3f0e-4966-8434-1bf04a19e934 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:08.615418 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:08.621493 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 54/120] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:49:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 10:49:08.626642 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7964290c-d5f7-4095-bec2-428817bcd007 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:08.700981 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:08.716077 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50545a4-3f0e-4966-8434-1bf04a19e934 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:08.750891 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7964290c-d5f7-4095-bec2-428817bcd007 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:08.752581 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ea963c-82ee-431e-80d4-e6179da1b1fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:08.753385 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea963c-82ee-431e-80d4-e6179da1b1fa None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:08.754039 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea963c-82ee-431e-80d4-e6179da1b1fa None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:08.754454 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea963c-82ee-431e-80d4-e6179da1b1fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:08.789418 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b9c390-81d1-45ac-9dfb-e13d3128d1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:08.790172 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b9c390-81d1-45ac-9dfb-e13d3128d1af None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:08.791003 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b9c390-81d1-45ac-9dfb-e13d3128d1af None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:08.791298 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b9c390-81d1-45ac-9dfb-e13d3128d1af None admin] PATH_INFO: `/v3/roles/member` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:08.802483 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b9c390-81d1-45ac-9dfb-e13d3128d1af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:49:08.808164 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-c5b9c390-81d1-45ac-9dfb-e13d3128d1af None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 10:49:08.808164 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:49:08.808164 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:49:08.808164 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:49:08.808164 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:49:08.808164 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:49:08.808164 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:49:08.808164 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:49:08.808164 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:49:08.808164 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:49:08.808164 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:49:08.808164 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:49:08.808164 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:49:08.808164 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:49:08.808164 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:49:08.808164 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:49:08.809195 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:49:08.809195 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:49:08.809195 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:49:08.809195 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:49:08.809195 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:49:08.809195 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:49:08.809195 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:49:08.809195 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:49:08.809195 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:49:08.809195 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:49:08.809195 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:49:08.809195 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:49:08.809195 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:49:08.809195 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:49:08.809195 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:49:08.809195 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:49:08.810030 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:49:08.810030 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:49:08.810030 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:49:08.810030 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:49:08.810030 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:49:08.810030 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:49:08.810030 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:49:08.810030 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:49:08.810030 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:49:08.810030 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:49:08.810030 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 10:49:08.810030 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:49:08.810030 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 55/121] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 18 10:49:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:49:08.810707 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b9c390-81d1-45ac-9dfb-e13d3128d1af None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:08.833770 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ea963c-82ee-431e-80d4-e6179da1b1fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:08.835461 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ea963c-82ee-431e-80d4-e6179da1b1fa None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:08.874508 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:08.920640 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b9c390-81d1-45ac-9dfb-e13d3128d1af None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:08.929183 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:08.944238 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 67/122] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 18 10:49:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 10:49:08.945291 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ea963c-82ee-431e-80d4-e6179da1b1fa None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:08.964448 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a014382-fdde-45ee-9041-9d3cd0322015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:08.964938 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a014382-fdde-45ee-9041-9d3cd0322015 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:08.965223 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a014382-fdde-45ee-9041-9d3cd0322015 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:08.965500 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a014382-fdde-45ee-9041-9d3cd0322015 None admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:08.966210 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a014382-fdde-45ee-9041-9d3cd0322015 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:49:08.966516 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a014382-fdde-45ee-9041-9d3cd0322015 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:08.967913 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a014382-fdde-45ee-9041-9d3cd0322015 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:08.977630 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 56/123] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 18 10:49:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:08.979210 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a014382-fdde-45ee-9041-9d3cd0322015 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:09.064945 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ea963c-82ee-431e-80d4-e6179da1b1fa None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:09.106679 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a014382-fdde-45ee-9041-9d3cd0322015 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:09.107128 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b0ce0b-1620-4892-a0f0-10209243cbfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:09.107896 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b0ce0b-1620-4892-a0f0-10209243cbfd None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:09.108467 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b0ce0b-1620-4892-a0f0-10209243cbfd None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:09.109656 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b0ce0b-1620-4892-a0f0-10209243cbfd None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:09.114731 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b0ce0b-1620-4892-a0f0-10209243cbfd None admin] RBAC: Adding query filter params (name=member) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:49:09.115254 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b0ce0b-1620-4892-a0f0-10209243cbfd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:09.116905 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b0ce0b-1620-4892-a0f0-10209243cbfd None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:09.128937 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 68/124] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Aug 18 10:49:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:09.130547 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b0ce0b-1620-4892-a0f0-10209243cbfd None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:09.133734 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:09.149378 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863fb05f-8b6c-41e8-b25d-8b771efd5514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:09.150648 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863fb05f-8b6c-41e8-b25d-8b771efd5514 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:09.151075 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863fb05f-8b6c-41e8-b25d-8b771efd5514 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:09.151307 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863fb05f-8b6c-41e8-b25d-8b771efd5514 None admin] PATH_INFO: `/v3/projects/db515fd18ab64bc190c7a76ae5f7e632` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:09.152697 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863fb05f-8b6c-41e8-b25d-8b771efd5514 None admin] RBAC: Authorizing `identity:get_project(project_id=db515fd18ab64bc190c7a76ae5f7e632)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:09.154266 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863fb05f-8b6c-41e8-b25d-8b771efd5514 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:09.156058 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 57/125] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 18 10:49:08 2022] GET /identity/v3/projects/db515fd18ab64bc190c7a76ae5f7e632 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:09.162694 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863fb05f-8b6c-41e8-b25d-8b771efd5514 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:09.193205 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:09.264518 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b0ce0b-1620-4892-a0f0-10209243cbfd None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:09.287285 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863fb05f-8b6c-41e8-b25d-8b771efd5514 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:09.307516 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1899e827-a8cb-4d02-96b5-ae7d3adac7b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:09.308303 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899e827-a8cb-4d02-96b5-ae7d3adac7b0 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:09.308677 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899e827-a8cb-4d02-96b5-ae7d3adac7b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:09.309050 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899e827-a8cb-4d02-96b5-ae7d3adac7b0 None admin] PATH_INFO: `/v3/users/55b16d3a97d74b659d9af679ed207645` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:09.310342 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1899e827-a8cb-4d02-96b5-ae7d3adac7b0 None admin] RBAC: Authorizing `identity:get_user(user_id=55b16d3a97d74b659d9af679ed207645)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:09.312641 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1899e827-a8cb-4d02-96b5-ae7d3adac7b0 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:09.315041 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 69/126] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Aug 18 10:49:09 2022] GET /identity/v3/users/55b16d3a97d74b659d9af679ed207645 => generated 247 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:09.318340 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1899e827-a8cb-4d02-96b5-ae7d3adac7b0 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:09.330913 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7e222b-0754-4bb5-842f-d7539b39512a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:09.331826 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e222b-0754-4bb5-842f-d7539b39512a None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:09.332328 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e222b-0754-4bb5-842f-d7539b39512a None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:09.332803 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e222b-0754-4bb5-842f-d7539b39512a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:09.345403 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7e222b-0754-4bb5-842f-d7539b39512a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:49:09.351167 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-0b7e222b-0754-4bb5-842f-d7539b39512a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 10:49:09.351167 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:49:09.351167 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:49:09.351167 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:49:09.351167 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:49:09.351167 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:49:09.351167 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:49:09.351167 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:49:09.351167 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:49:09.351167 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:49:09.351167 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:49:09.351167 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:49:09.351167 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:49:09.351167 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:49:09.351167 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:49:09.351167 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:49:09.352017 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:49:09.352017 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:49:09.352017 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:49:09.352017 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:49:09.352017 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:49:09.352017 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:49:09.352017 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:49:09.352017 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:49:09.352017 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:49:09.352017 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:49:09.352017 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:49:09.352017 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:49:09.352017 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:49:09.352017 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:49:09.352017 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:49:09.352017 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:49:09.352771 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:49:09.352771 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:49:09.352771 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:49:09.352771 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:49:09.352771 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:49:09.352771 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:49:09.352771 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:49:09.352771 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:49:09.352771 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:49:09.352771 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:49:09.352771 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 10:49:09.352771 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:49:09.355404 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 58/127] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Aug 18 10:49:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:49:09.356437 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7e222b-0754-4bb5-842f-d7539b39512a None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:09.414610 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:09.453569 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1899e827-a8cb-4d02-96b5-ae7d3adac7b0 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:09.471318 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7e222b-0754-4bb5-842f-d7539b39512a None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:09.471829 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:09.490865 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c289c3-1445-47a6-b044-888fb9b87625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:09.491518 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c289c3-1445-47a6-b044-888fb9b87625 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:09.491798 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c289c3-1445-47a6-b044-888fb9b87625 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:09.492072 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c289c3-1445-47a6-b044-888fb9b87625 None admin] PATH_INFO: `/v3/users/dbca316ef38e45aeb63de5837094e8ce` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:09.493224 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c289c3-1445-47a6-b044-888fb9b87625 None admin] RBAC: Authorizing `identity:get_user(user_id=dbca316ef38e45aeb63de5837094e8ce)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:09.495027 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c289c3-1445-47a6-b044-888fb9b87625 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:09.496776 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 70/128] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Aug 18 10:49:09 2022] GET /identity/v3/users/dbca316ef38e45aeb63de5837094e8ce => generated 275 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:09.497392 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c289c3-1445-47a6-b044-888fb9b87625 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:09.512733 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1e69e4-8adb-41ff-8b83-2c3261c3dc17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:09.513713 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1e69e4-8adb-41ff-8b83-2c3261c3dc17 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:09.514196 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1e69e4-8adb-41ff-8b83-2c3261c3dc17 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:09.514685 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1e69e4-8adb-41ff-8b83-2c3261c3dc17 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:09.515743 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1e69e4-8adb-41ff-8b83-2c3261c3dc17 None admin] RBAC: Adding query filter params (role.id=fcb5eb4c33b24ac9904230e57dec7ec9, scope.project.id=db515fd18ab64bc190c7a76ae5f7e632, user.id=a02a06e1ca6a47768fbad9958a5a1b39) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:49:09.516274 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1e69e4-8adb-41ff-8b83-2c3261c3dc17 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:09.517970 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1e69e4-8adb-41ff-8b83-2c3261c3dc17 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:09.529667 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 59/129] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Aug 18 10:49:09 2022] GET /identity/v3/role_assignments?user.id=a02a06e1ca6a47768fbad9958a5a1b39&scope.project.id=db515fd18ab64bc190c7a76ae5f7e632&role.id=fcb5eb4c33b24ac9904230e57dec7ec9 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:09.530959 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1e69e4-8adb-41ff-8b83-2c3261c3dc17 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:09.608184 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c289c3-1445-47a6-b044-888fb9b87625 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:09.647345 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079808ee-1dae-4b80-be74-13133f8be318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:09.648002 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079808ee-1dae-4b80-be74-13133f8be318 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:09.648285 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079808ee-1dae-4b80-be74-13133f8be318 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:09.648558 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079808ee-1dae-4b80-be74-13133f8be318 None admin] PATH_INFO: `/v3/projects/db515fd18ab64bc190c7a76ae5f7e632` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:09.650023 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079808ee-1dae-4b80-be74-13133f8be318 None admin] RBAC: Authorizing `identity:get_project(project_id=db515fd18ab64bc190c7a76ae5f7e632)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:09.651381 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079808ee-1dae-4b80-be74-13133f8be318 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:09.653419 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 71/130] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 18 10:49:09 2022] GET /identity/v3/projects/db515fd18ab64bc190c7a76ae5f7e632 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:09.654258 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079808ee-1dae-4b80-be74-13133f8be318 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:09.722249 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:09.764760 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1e69e4-8adb-41ff-8b83-2c3261c3dc17 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:09.773952 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079808ee-1dae-4b80-be74-13133f8be318 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:09.782049 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:09.804969 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaca971e-c7fc-4949-8f49-af2c4dfa625e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:09.806030 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca971e-c7fc-4949-8f49-af2c4dfa625e None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:09.807072 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca971e-c7fc-4949-8f49-af2c4dfa625e None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:09.813545 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca971e-c7fc-4949-8f49-af2c4dfa625e None admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:09.814376 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaca971e-c7fc-4949-8f49-af2c4dfa625e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:49:09.814691 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaca971e-c7fc-4949-8f49-af2c4dfa625e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:09.816121 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaca971e-c7fc-4949-8f49-af2c4dfa625e None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:09.821230 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5102bcd3-0053-4afb-af95-946c3c76992c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:09.822624 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5102bcd3-0053-4afb-af95-946c3c76992c None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:09.822991 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5102bcd3-0053-4afb-af95-946c3c76992c None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:09.823444 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5102bcd3-0053-4afb-af95-946c3c76992c None admin] PATH_INFO: `/v3/projects/9e375c249e6e487586047ee77015bfe2` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:09.827610 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5102bcd3-0053-4afb-af95-946c3c76992c None admin] RBAC: Authorizing `identity:get_project(project_id=9e375c249e6e487586047ee77015bfe2)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:09.829067 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5102bcd3-0053-4afb-af95-946c3c76992c None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:09.830775 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 72/131] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 18 10:49:09 2022] GET /identity/v3/projects/9e375c249e6e487586047ee77015bfe2 => generated 312 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:09.831524 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5102bcd3-0053-4afb-af95-946c3c76992c None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:09.836979 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 60/132] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 18 10:49:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:09.838399 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaca971e-c7fc-4949-8f49-af2c4dfa625e None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:10.015432 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5102bcd3-0053-4afb-af95-946c3c76992c None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:10.040575 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:10.043669 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaca971e-c7fc-4949-8f49-af2c4dfa625e None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:10.058712 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecc3198-46c5-411c-ac56-cd533bd96b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:10.059757 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc3198-46c5-411c-ac56-cd533bd96b82 None admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:10.060455 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc3198-46c5-411c-ac56-cd533bd96b82 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:10.060741 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc3198-46c5-411c-ac56-cd533bd96b82 None admin] PATH_INFO: `/v3/projects/db515fd18ab64bc190c7a76ae5f7e632/users/55b16d3a97d74b659d9af679ed207645/roles/127fdc7ef05b4e0b98a940b334e5fcab` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:10.063152 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecc3198-46c5-411c-ac56-cd533bd96b82 None admin] RBAC: Authorizing `identity:create_grant(project_id=db515fd18ab64bc190c7a76ae5f7e632, user_id=55b16d3a97d74b659d9af679ed207645, role_id=127fdc7ef05b4e0b98a940b334e5fcab)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:10.064605 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecc3198-46c5-411c-ac56-cd533bd96b82 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:10.083025 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 73/133] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Aug 18 10:49:09 2022] PUT /identity/v3/projects/db515fd18ab64bc190c7a76ae5f7e632/users/55b16d3a97d74b659d9af679ed207645/roles/127fdc7ef05b4e0b98a940b334e5fcab => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 10:49:10.085792 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecc3198-46c5-411c-ac56-cd533bd96b82 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:10.090486 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af72e0-c1db-49d5-abf1-35bfa2d2428b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:10.091687 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af72e0-c1db-49d5-abf1-35bfa2d2428b None admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:10.093763 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af72e0-c1db-49d5-abf1-35bfa2d2428b None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:10.094105 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af72e0-c1db-49d5-abf1-35bfa2d2428b None admin] PATH_INFO: `/v3/projects/9e375c249e6e487586047ee77015bfe2/users/dbca316ef38e45aeb63de5837094e8ce/roles/719e5c62188d4f8a838987d6e72ca8f7` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:10.099083 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14af72e0-c1db-49d5-abf1-35bfa2d2428b None admin] RBAC: Authorizing `identity:create_grant(project_id=9e375c249e6e487586047ee77015bfe2, user_id=dbca316ef38e45aeb63de5837094e8ce, role_id=719e5c62188d4f8a838987d6e72ca8f7)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:10.100617 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14af72e0-c1db-49d5-abf1-35bfa2d2428b None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:10.135910 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 61/134] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Aug 18 10:49:09 2022] PUT /identity/v3/projects/9e375c249e6e487586047ee77015bfe2/users/dbca316ef38e45aeb63de5837094e8ce/roles/719e5c62188d4f8a838987d6e72ca8f7 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 10:49:10.137244 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c613e-f00f-4879-b30c-e365127773cb None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:10.137546 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c613e-f00f-4879-b30c-e365127773cb None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:10.137840 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c613e-f00f-4879-b30c-e365127773cb None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:10.139421 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 62/135] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:49:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:49:10.145855 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13af00f-9f10-4860-a8a5-052d7eebdaf1 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:10.146164 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13af00f-9f10-4860-a8a5-052d7eebdaf1 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:10.146425 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13af00f-9f10-4860-a8a5-052d7eebdaf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:10.195357 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-b13af00f-9f10-4860-a8a5-052d7eebdaf1 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:49:10.197429 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-b13af00f-9f10-4860-a8a5-052d7eebdaf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:49:10.274021 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:10.300505 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecc3198-46c5-411c-ac56-cd533bd96b82 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:10.331730 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 63/136] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:49:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 10:49:10.356192 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2fde06-0728-429b-a7f4-f4a642941427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:10.356924 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2fde06-0728-429b-a7f4-f4a642941427 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:10.357211 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2fde06-0728-429b-a7f4-f4a642941427 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:10.357582 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2fde06-0728-429b-a7f4-f4a642941427 None admin] PATH_INFO: `/v3/users/dbca316ef38e45aeb63de5837094e8ce` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:10.359581 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2fde06-0728-429b-a7f4-f4a642941427 None admin] RBAC: Authorizing `identity:get_user(user_id=dbca316ef38e45aeb63de5837094e8ce)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:10.361196 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2fde06-0728-429b-a7f4-f4a642941427 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:10.362977 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 74/137] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Aug 18 10:49:10 2022] GET /identity/v3/users/dbca316ef38e45aeb63de5837094e8ce => generated 275 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:10.369065 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13af00f-9f10-4860-a8a5-052d7eebdaf1 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:10.493018 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13af00f-9f10-4860-a8a5-052d7eebdaf1 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:10.539580 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d235682c-fdc5-4c5e-b4d7-24c59494cfec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:10.540153 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d235682c-fdc5-4c5e-b4d7-24c59494cfec None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:10.541007 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d235682c-fdc5-4c5e-b4d7-24c59494cfec None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:10.541289 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d235682c-fdc5-4c5e-b4d7-24c59494cfec None admin] PATH_INFO: `/v3/projects/db515fd18ab64bc190c7a76ae5f7e632` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:10.542583 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d235682c-fdc5-4c5e-b4d7-24c59494cfec None admin] RBAC: Authorizing `identity:get_project(project_id=db515fd18ab64bc190c7a76ae5f7e632)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:10.544111 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d235682c-fdc5-4c5e-b4d7-24c59494cfec None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:10.546169 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 64/138] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 18 10:49:10 2022] GET /identity/v3/projects/db515fd18ab64bc190c7a76ae5f7e632 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:10.552029 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2fde06-0728-429b-a7f4-f4a642941427 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:10.611507 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:10.675745 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2fde06-0728-429b-a7f4-f4a642941427 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:10.717930 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f17c02-f0ef-4a0d-9359-7cd2b57fa5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:10.718612 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f17c02-f0ef-4a0d-9359-7cd2b57fa5b5 None admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:10.718893 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f17c02-f0ef-4a0d-9359-7cd2b57fa5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:10.719183 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f17c02-f0ef-4a0d-9359-7cd2b57fa5b5 None admin] PATH_INFO: `/v3/projects/db515fd18ab64bc190c7a76ae5f7e632/users/dbca316ef38e45aeb63de5837094e8ce/roles/0ecb6b324fc643f3826b2878f2f6174b` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:10.721405 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f17c02-f0ef-4a0d-9359-7cd2b57fa5b5 None admin] RBAC: Authorizing `identity:create_grant(project_id=db515fd18ab64bc190c7a76ae5f7e632, user_id=dbca316ef38e45aeb63de5837094e8ce, role_id=0ecb6b324fc643f3826b2878f2f6174b)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:10.722869 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f17c02-f0ef-4a0d-9359-7cd2b57fa5b5 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:10.741029 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 75/139] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Aug 18 10:49:10 2022] PUT /identity/v3/projects/db515fd18ab64bc190c7a76ae5f7e632/users/dbca316ef38e45aeb63de5837094e8ce/roles/0ecb6b324fc643f3826b2878f2f6174b => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 10:49:10.836052 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d235682c-fdc5-4c5e-b4d7-24c59494cfec None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:10.883447 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:10.979493 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d235682c-fdc5-4c5e-b4d7-24c59494cfec None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:11.032091 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea758efa-931f-4897-9f57-101a7c3e9929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:11.033157 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea758efa-931f-4897-9f57-101a7c3e9929 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:11.033705 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea758efa-931f-4897-9f57-101a7c3e9929 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:11.034188 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea758efa-931f-4897-9f57-101a7c3e9929 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:11.038406 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea758efa-931f-4897-9f57-101a7c3e9929 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:11.040390 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea758efa-931f-4897-9f57-101a7c3e9929 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:11.042626 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 65/140] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:49:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:11.049086 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f17c02-f0ef-4a0d-9359-7cd2b57fa5b5 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:11.160750 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f17c02-f0ef-4a0d-9359-7cd2b57fa5b5 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:11.177134 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:11.209981 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b70780f-7373-474d-9e5f-b18b559f844d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:11.210831 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b70780f-7373-474d-9e5f-b18b559f844d None admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:11.211281 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b70780f-7373-474d-9e5f-b18b559f844d None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:11.211746 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b70780f-7373-474d-9e5f-b18b559f844d None admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:11.213050 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b70780f-7373-474d-9e5f-b18b559f844d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:11.215979 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b70780f-7373-474d-9e5f-b18b559f844d None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:11.246819 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 76/141] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Aug 18 10:49:11 2022] POST /identity/v3/users => generated 283 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 10:49:11.312160 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8023bd-bebb-49e2-af0e-105a628a8824 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:11.312778 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8023bd-bebb-49e2-af0e-105a628a8824 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:11.313257 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8023bd-bebb-49e2-af0e-105a628a8824 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:11.314915 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 66/142] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:49:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:49:11.320585 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d75609-cd15-4372-b512-afd5d2ffb606 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:11.320878 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d75609-cd15-4372-b512-afd5d2ffb606 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:11.321158 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d75609-cd15-4372-b512-afd5d2ffb606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:11.347993 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-d2d75609-cd15-4372-b512-afd5d2ffb606 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:49:11.349225 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-d2d75609-cd15-4372-b512-afd5d2ffb606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:49:11.443047 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 77/143] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:49:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 10:49:11.772373 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8023bd-bebb-49e2-af0e-105a628a8824 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:11.905168 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8023bd-bebb-49e2-af0e-105a628a8824 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:11.907078 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:11.953006 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5afe143-1fe4-45f3-9fdd-d430b999b99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:11.953685 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5afe143-1fe4-45f3-9fdd-d430b999b99f None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:11.953968 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5afe143-1fe4-45f3-9fdd-d430b999b99f None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:11.954302 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5afe143-1fe4-45f3-9fdd-d430b999b99f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:11.965465 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5afe143-1fe4-45f3-9fdd-d430b999b99f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:49:11.974186 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-a5afe143-1fe4-45f3-9fdd-d430b999b99f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 10:49:11.974186 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:49:11.974186 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:49:11.974186 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:49:11.974186 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:49:11.974186 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:49:11.974186 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:49:11.974186 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:49:11.974186 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:49:11.974186 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:49:11.974186 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:49:11.974186 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:49:11.974186 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:49:11.974186 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:49:11.974186 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:49:11.974186 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:49:11.975047 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:49:11.975047 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:49:11.975047 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:49:11.975047 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:49:11.975047 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:49:11.975047 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:49:11.975047 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:49:11.975047 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:49:11.975047 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:49:11.975047 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:49:11.975047 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:49:11.975047 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:49:11.975047 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:49:11.975047 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:49:11.975047 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:49:11.975047 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:49:11.975779 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:49:11.975779 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:49:11.975779 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:49:11.975779 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:49:11.975779 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:49:11.975779 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:49:11.975779 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:49:11.975779 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:49:11.975779 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:49:11.975779 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:49:11.975779 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 10:49:11.975779 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:49:11.975779 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 67/144] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 18 10:49:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:49:11.982410 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d75609-cd15-4372-b512-afd5d2ffb606 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:12.013753 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6129322e-a9e3-4cfc-8f8a-aeed83e1b1cb None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:12.014060 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6129322e-a9e3-4cfc-8f8a-aeed83e1b1cb None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:12.014299 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6129322e-a9e3-4cfc-8f8a-aeed83e1b1cb None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:12.015792 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 68/145] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:49:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:49:12.021746 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f414387-5ccc-432a-a0c0-ef3b83d42489 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:12.022029 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f414387-5ccc-432a-a0c0-ef3b83d42489 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:12.022608 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f414387-5ccc-432a-a0c0-ef3b83d42489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:12.052586 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-4f414387-5ccc-432a-a0c0-ef3b83d42489 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:49:12.053619 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-4f414387-5ccc-432a-a0c0-ef3b83d42489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:49:12.106203 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:12.120569 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d75609-cd15-4372-b512-afd5d2ffb606 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:12.148530 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 69/146] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:49:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 10:49:12.175439 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4818aec2-1d4b-4d60-a879-35c4ee583379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:12.176432 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4818aec2-1d4b-4d60-a879-35c4ee583379 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:12.176939 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4818aec2-1d4b-4d60-a879-35c4ee583379 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:12.177413 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4818aec2-1d4b-4d60-a879-35c4ee583379 None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:12.178354 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4818aec2-1d4b-4d60-a879-35c4ee583379 None admin] RBAC: Adding query filter params (name=member) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:49:12.178869 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4818aec2-1d4b-4d60-a879-35c4ee583379 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:12.180534 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4818aec2-1d4b-4d60-a879-35c4ee583379 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:12.194196 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 78/147] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Aug 18 10:49:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:12.201084 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f414387-5ccc-432a-a0c0-ef3b83d42489 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:12.325443 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:12.338352 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f414387-5ccc-432a-a0c0-ef3b83d42489 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:12.378130 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1846fd2a-43b1-4a65-a707-534518320d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:12.378774 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1846fd2a-43b1-4a65-a707-534518320d82 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:12.379052 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1846fd2a-43b1-4a65-a707-534518320d82 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:12.379325 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1846fd2a-43b1-4a65-a707-534518320d82 None admin] PATH_INFO: `/v3/users/dbca316ef38e45aeb63de5837094e8ce` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:12.380467 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1846fd2a-43b1-4a65-a707-534518320d82 None admin] RBAC: Authorizing `identity:get_user(user_id=dbca316ef38e45aeb63de5837094e8ce)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:12.381947 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1846fd2a-43b1-4a65-a707-534518320d82 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:12.383699 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 70/148] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Aug 18 10:49:12 2022] GET /identity/v3/users/dbca316ef38e45aeb63de5837094e8ce => generated 275 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:12.389490 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4818aec2-1d4b-4d60-a879-35c4ee583379 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:12.500875 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4818aec2-1d4b-4d60-a879-35c4ee583379 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:12.535641 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea136a9-a075-4d60-bce0-ad4c71bbfd52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:12.536260 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea136a9-a075-4d60-bce0-ad4c71bbfd52 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:12.536538 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea136a9-a075-4d60-bce0-ad4c71bbfd52 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:12.536809 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea136a9-a075-4d60-bce0-ad4c71bbfd52 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:12.538458 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1846fd2a-43b1-4a65-a707-534518320d82 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:12.591826 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:12.685150 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea136a9-a075-4d60-bce0-ad4c71bbfd52 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:12.686837 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea136a9-a075-4d60-bce0-ad4c71bbfd52 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:12.748348 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1846fd2a-43b1-4a65-a707-534518320d82 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:12.815241 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b3940a-cff3-4f2a-ad1e-8895002d74ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:12.815900 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b3940a-cff3-4f2a-ad1e-8895002d74ba None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:12.816187 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b3940a-cff3-4f2a-ad1e-8895002d74ba None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:12.816462 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b3940a-cff3-4f2a-ad1e-8895002d74ba None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:12.839626 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b3940a-cff3-4f2a-ad1e-8895002d74ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:49:12.846905 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-81b3940a-cff3-4f2a-ad1e-8895002d74ba None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 10:49:12.846905 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:49:12.846905 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:49:12.846905 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:49:12.846905 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:49:12.846905 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:49:12.846905 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:49:12.846905 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:49:12.846905 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:49:12.846905 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:49:12.846905 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:49:12.846905 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:49:12.846905 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:49:12.846905 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:49:12.846905 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:49:12.846905 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:49:12.847782 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:49:12.847782 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:49:12.847782 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:49:12.847782 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:49:12.847782 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:49:12.847782 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:49:12.847782 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:49:12.847782 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:49:12.847782 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:49:12.847782 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:49:12.847782 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:49:12.847782 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:49:12.847782 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:49:12.847782 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:49:12.847782 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:49:12.847782 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:49:12.848535 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:49:12.848535 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:49:12.848535 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:49:12.848535 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:49:12.848535 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:49:12.848535 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:49:12.848535 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:49:12.848535 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:49:12.848535 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:49:12.848535 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:49:12.848535 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 10:49:12.848535 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:49:12.848535 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 71/149] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 18 10:49:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 10:49:12.857481 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b3940a-cff3-4f2a-ad1e-8895002d74ba None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:12.877432 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 79/150] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 18 10:49:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 10:49:12.883624 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea136a9-a075-4d60-bce0-ad4c71bbfd52 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:12.890392 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:12.990943 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:13.034573 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b3940a-cff3-4f2a-ad1e-8895002d74ba None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:13.045846 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea136a9-a075-4d60-bce0-ad4c71bbfd52 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:13.082248 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf6c5ac-3120-409b-9fe8-448cbc3c540d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:13.083352 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf6c5ac-3120-409b-9fe8-448cbc3c540d None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:13.084167 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf6c5ac-3120-409b-9fe8-448cbc3c540d None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:13.084847 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf6c5ac-3120-409b-9fe8-448cbc3c540d None admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:13.085704 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf6c5ac-3120-409b-9fe8-448cbc3c540d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:49:13.086182 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf6c5ac-3120-409b-9fe8-448cbc3c540d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:13.087815 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf6c5ac-3120-409b-9fe8-448cbc3c540d None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:13.093575 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc61290-b8b9-42e4-a4ee-0dd2bbf26872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:13.093575 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc61290-b8b9-42e4-a4ee-0dd2bbf26872 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:13.093575 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc61290-b8b9-42e4-a4ee-0dd2bbf26872 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:13.093575 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc61290-b8b9-42e4-a4ee-0dd2bbf26872 None admin] PATH_INFO: `/v3/projects/db515fd18ab64bc190c7a76ae5f7e632` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:13.093964 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc61290-b8b9-42e4-a4ee-0dd2bbf26872 None admin] RBAC: Authorizing `identity:get_project(project_id=db515fd18ab64bc190c7a76ae5f7e632)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:13.094754 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc61290-b8b9-42e4-a4ee-0dd2bbf26872 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:13.096692 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 80/151] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 18 10:49:12 2022] GET /identity/v3/projects/db515fd18ab64bc190c7a76ae5f7e632 => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 10:49:13.097727 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e482ff3-0375-4fbb-afc1-5d58c29aaaaf None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:13.097949 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e482ff3-0375-4fbb-afc1-5d58c29aaaaf None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:13.098220 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e482ff3-0375-4fbb-afc1-5d58c29aaaaf None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:13.099572 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 81/152] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:49:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:49:13.104578 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 72/153] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Aug 18 10:49:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:13.106067 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e482ff3-0375-4fbb-afc1-5d58c29aaaaf None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:13.109414 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae9e05b-7d48-4bf5-9b6b-ecd909536ca4 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:13.109938 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae9e05b-7d48-4bf5-9b6b-ecd909536ca4 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:13.111342 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae9e05b-7d48-4bf5-9b6b-ecd909536ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:13.141572 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-7ae9e05b-7d48-4bf5-9b6b-ecd909536ca4 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:49:13.142763 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-7ae9e05b-7d48-4bf5-9b6b-ecd909536ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:49:13.295863 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e482ff3-0375-4fbb-afc1-5d58c29aaaaf None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:13.311110 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 73/154] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:49:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 10:49:13.312340 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae9e05b-7d48-4bf5-9b6b-ecd909536ca4 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:13.339935 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:13.342329 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:13.361313 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c6fe68-e673-4e6c-a128-ec0c2517d714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:13.361872 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6fe68-e673-4e6c-a128-ec0c2517d714 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:13.362152 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6fe68-e673-4e6c-a128-ec0c2517d714 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:13.362419 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6fe68-e673-4e6c-a128-ec0c2517d714 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:13.363261 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c6fe68-e673-4e6c-a128-ec0c2517d714 None admin] RBAC: Adding query filter params (role.id=719e5c62188d4f8a838987d6e72ca8f7, scope.project.id=db515fd18ab64bc190c7a76ae5f7e632, user.id=dbca316ef38e45aeb63de5837094e8ce) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:49:13.363567 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c6fe68-e673-4e6c-a128-ec0c2517d714 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:13.364997 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c6fe68-e673-4e6c-a128-ec0c2517d714 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:13.374107 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 82/155] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Aug 18 10:49:13 2022] GET /identity/v3/role_assignments?user.id=dbca316ef38e45aeb63de5837094e8ce&scope.project.id=db515fd18ab64bc190c7a76ae5f7e632&role.id=719e5c62188d4f8a838987d6e72ca8f7 => generated 608 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:13.491526 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae9e05b-7d48-4bf5-9b6b-ecd909536ca4 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:13.541843 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb669b3-c032-4669-8f77-c25e49d646cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:13.542506 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb669b3-c032-4669-8f77-c25e49d646cc None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:13.542785 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb669b3-c032-4669-8f77-c25e49d646cc None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:13.543063 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb669b3-c032-4669-8f77-c25e49d646cc None admin] PATH_INFO: `/v3/users/a02a06e1ca6a47768fbad9958a5a1b39` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:13.545995 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb669b3-c032-4669-8f77-c25e49d646cc None admin] RBAC: Authorizing `identity:get_user(user_id=a02a06e1ca6a47768fbad9958a5a1b39)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:13.547475 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb669b3-c032-4669-8f77-c25e49d646cc None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:13.549129 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 74/156] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Aug 18 10:49:13 2022] GET /identity/v3/users/a02a06e1ca6a47768fbad9958a5a1b39 => generated 289 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:13.554848 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c6fe68-e673-4e6c-a128-ec0c2517d714 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:13.725717 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c6fe68-e673-4e6c-a128-ec0c2517d714 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:13.767461 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d793e44f-2da4-48fe-9084-640ab03aebed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:13.768110 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d793e44f-2da4-48fe-9084-640ab03aebed None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:13.768388 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d793e44f-2da4-48fe-9084-640ab03aebed None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:13.768660 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d793e44f-2da4-48fe-9084-640ab03aebed None admin] PATH_INFO: `/v3/projects/db515fd18ab64bc190c7a76ae5f7e632` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:13.774044 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d793e44f-2da4-48fe-9084-640ab03aebed None admin] RBAC: Authorizing `identity:get_project(project_id=db515fd18ab64bc190c7a76ae5f7e632)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:13.776216 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d793e44f-2da4-48fe-9084-640ab03aebed None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:13.777200 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18298cc7-48a3-4e1a-9e60-c33e8ef9646f None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:13.777486 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18298cc7-48a3-4e1a-9e60-c33e8ef9646f None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:13.777808 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18298cc7-48a3-4e1a-9e60-c33e8ef9646f None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:13.778374 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 83/157] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 18 10:49:13 2022] GET /identity/v3/projects/db515fd18ab64bc190c7a76ae5f7e632 => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:13.779144 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 75/158] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:49:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 10:49:13.784600 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d793e44f-2da4-48fe-9084-640ab03aebed None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:13.789179 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8836afdc-b3a5-4cb7-8229-c3218fe6f55a None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:13.789460 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8836afdc-b3a5-4cb7-8229-c3218fe6f55a None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:13.789755 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8836afdc-b3a5-4cb7-8229-c3218fe6f55a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:13.829163 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-8836afdc-b3a5-4cb7-8229-c3218fe6f55a None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:49:13.830413 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-8836afdc-b3a5-4cb7-8229-c3218fe6f55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:49:13.855970 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:13.929192 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d793e44f-2da4-48fe-9084-640ab03aebed None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:13.995780 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 76/159] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:49:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 10:49:13.997035 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8836afdc-b3a5-4cb7-8229-c3218fe6f55a None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:13.997581 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fb12ca-e619-4c66-bf02-1c0093620751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:13.998272 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb12ca-e619-4c66-bf02-1c0093620751 None admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:13.998553 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb12ca-e619-4c66-bf02-1c0093620751 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:13.998826 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb12ca-e619-4c66-bf02-1c0093620751 None admin] PATH_INFO: `/v3/projects/db515fd18ab64bc190c7a76ae5f7e632/users/a02a06e1ca6a47768fbad9958a5a1b39/roles/fcb5eb4c33b24ac9904230e57dec7ec9` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:14.000818 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fb12ca-e619-4c66-bf02-1c0093620751 None admin] RBAC: Authorizing `identity:create_grant(project_id=db515fd18ab64bc190c7a76ae5f7e632, user_id=a02a06e1ca6a47768fbad9958a5a1b39, role_id=fcb5eb4c33b24ac9904230e57dec7ec9)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:14.002324 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fb12ca-e619-4c66-bf02-1c0093620751 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:14.018999 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 84/160] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Aug 18 10:49:13 2022] PUT /identity/v3/projects/db515fd18ab64bc190c7a76ae5f7e632/users/a02a06e1ca6a47768fbad9958a5a1b39/roles/fcb5eb4c33b24ac9904230e57dec7ec9 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 10:49:14.027947 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:14.144243 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8836afdc-b3a5-4cb7-8229-c3218fe6f55a None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:14.185637 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17bda16-dc7b-4e61-9360-02cf24b42bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:14.186290 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17bda16-dc7b-4e61-9360-02cf24b42bf0 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:14.186585 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17bda16-dc7b-4e61-9360-02cf24b42bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:14.186844 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17bda16-dc7b-4e61-9360-02cf24b42bf0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:14.207361 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17bda16-dc7b-4e61-9360-02cf24b42bf0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:49:14.212221 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-f17bda16-dc7b-4e61-9360-02cf24b42bf0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 10:49:14.212221 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:49:14.212221 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:49:14.212221 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:49:14.212221 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:49:14.212221 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:49:14.212221 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:49:14.212221 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:49:14.212221 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:49:14.212221 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:49:14.212221 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:49:14.212221 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:49:14.212221 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:49:14.212221 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:49:14.212221 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:49:14.212221 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:49:14.213721 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:49:14.213721 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:49:14.213721 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:49:14.213721 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:49:14.213721 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:49:14.213721 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:49:14.213721 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:49:14.213721 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:49:14.213721 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:49:14.213721 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:49:14.213721 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:49:14.213721 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:49:14.213721 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:49:14.213721 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:49:14.213721 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:49:14.213721 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:49:14.214603 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:49:14.214603 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:49:14.214603 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:49:14.214603 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:49:14.214603 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:49:14.214603 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:49:14.214603 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:49:14.214603 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:49:14.214603 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:49:14.214603 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:49:14.214603 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 10:49:14.214603 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:49:14.219660 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 77/161] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Aug 18 10:49:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:49:14.225596 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fb12ca-e619-4c66-bf02-1c0093620751 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:14.376428 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fb12ca-e619-4c66-bf02-1c0093620751 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:14.395381 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:14.418684 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b951e45-2901-4963-bd32-7fc3fbeb42db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:14.419712 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b951e45-2901-4963-bd32-7fc3fbeb42db None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:14.420198 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b951e45-2901-4963-bd32-7fc3fbeb42db None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:14.420619 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b951e45-2901-4963-bd32-7fc3fbeb42db None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:14.421505 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b951e45-2901-4963-bd32-7fc3fbeb42db None admin] RBAC: Adding query filter params (name=admin) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:49:14.422074 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b951e45-2901-4963-bd32-7fc3fbeb42db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:14.424092 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b951e45-2901-4963-bd32-7fc3fbeb42db None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:14.439424 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 85/162] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 18 10:49:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:14.445218 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17bda16-dc7b-4e61-9360-02cf24b42bf0 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:14.515058 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b951e45-2901-4963-bd32-7fc3fbeb42db None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:14.553866 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:14.592362 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17bda16-dc7b-4e61-9360-02cf24b42bf0 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:14.631652 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1727c4-4f6a-46eb-96af-818382c167be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:14.632319 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1727c4-4f6a-46eb-96af-818382c167be None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:14.632608 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1727c4-4f6a-46eb-96af-818382c167be None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:14.632887 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1727c4-4f6a-46eb-96af-818382c167be None admin] PATH_INFO: `/v3/users/55b16d3a97d74b659d9af679ed207645` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:14.634874 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1727c4-4f6a-46eb-96af-818382c167be None admin] RBAC: Authorizing `identity:get_user(user_id=55b16d3a97d74b659d9af679ed207645)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:14.636466 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1727c4-4f6a-46eb-96af-818382c167be None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:14.638127 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 78/163] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Aug 18 10:49:14 2022] GET /identity/v3/users/55b16d3a97d74b659d9af679ed207645 => generated 247 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:14.644487 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1727c4-4f6a-46eb-96af-818382c167be None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:14.679575 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b951e45-2901-4963-bd32-7fc3fbeb42db None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:14.759564 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1727c4-4f6a-46eb-96af-818382c167be None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:14.796362 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67d9ed2-d3c9-4fb9-b2f6-c013ddfb99ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:14.797004 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67d9ed2-d3c9-4fb9-b2f6-c013ddfb99ea None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:14.797280 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67d9ed2-d3c9-4fb9-b2f6-c013ddfb99ea None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:14.798109 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67d9ed2-d3c9-4fb9-b2f6-c013ddfb99ea None admin] PATH_INFO: `/v3/roles/member` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:14.801291 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698738e0-5d16-4557-871b-8ab2ecf3d5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:14.801925 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698738e0-5d16-4557-871b-8ab2ecf3d5d8 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:14.802203 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698738e0-5d16-4557-871b-8ab2ecf3d5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:14.802471 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698738e0-5d16-4557-871b-8ab2ecf3d5d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:14.823049 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67d9ed2-d3c9-4fb9-b2f6-c013ddfb99ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:49:14.829858 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:14.835601 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-d67d9ed2-d3c9-4fb9-b2f6-c013ddfb99ea None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 10:49:14.835601 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:49:14.835601 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:49:14.835601 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:49:14.835601 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:49:14.835601 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:49:14.835601 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:49:14.835601 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:49:14.835601 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:49:14.835601 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:49:14.835601 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:49:14.835601 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:49:14.835601 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:49:14.835601 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:49:14.835601 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:49:14.835601 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:49:14.836478 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:49:14.836478 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:49:14.836478 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:49:14.836478 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:49:14.836478 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:49:14.836478 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:49:14.836478 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:49:14.836478 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:49:14.836478 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:49:14.836478 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:49:14.836478 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:49:14.836478 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:49:14.836478 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:49:14.836478 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:49:14.836478 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:49:14.836478 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:49:14.837892 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:49:14.837892 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:49:14.837892 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:49:14.837892 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:49:14.837892 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:49:14.837892 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:49:14.837892 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:49:14.837892 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:49:14.837892 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:49:14.837892 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:49:14.837892 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 10:49:14.837892 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:49:14.837892 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 86/164] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 18 10:49:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:49:14.838792 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a21259c-fc37-49c7-a739-5d328db36d05 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:14.838862 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a21259c-fc37-49c7-a739-5d328db36d05 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:14.839543 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a21259c-fc37-49c7-a739-5d328db36d05 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:14.840476 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 87/165] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:49:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:49:14.847748 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a21259c-fc37-49c7-a739-5d328db36d05 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:14.910874 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698738e0-5d16-4557-871b-8ab2ecf3d5d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:14.912485 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698738e0-5d16-4557-871b-8ab2ecf3d5d8 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:14.924137 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:15.033125 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 79/166] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 18 10:49:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 10:49:15.033540 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a21259c-fc37-49c7-a739-5d328db36d05 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:15.038856 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd34170-15b4-4725-95bb-ae58e159420d None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:15.039140 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd34170-15b4-4725-95bb-ae58e159420d None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:15.039471 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd34170-15b4-4725-95bb-ae58e159420d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:15.062870 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-5dd34170-15b4-4725-95bb-ae58e159420d None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:49:15.064235 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-5dd34170-15b4-4725-95bb-ae58e159420d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:49:15.097429 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f575dc-de4c-4fe9-a6c5-3e0ed27be9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:15.098541 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f575dc-de4c-4fe9-a6c5-3e0ed27be9a2 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:15.099021 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f575dc-de4c-4fe9-a6c5-3e0ed27be9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:15.099483 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:15.100650 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f575dc-de4c-4fe9-a6c5-3e0ed27be9a2 None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:15.101652 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f575dc-de4c-4fe9-a6c5-3e0ed27be9a2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:49:15.105987 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f575dc-de4c-4fe9-a6c5-3e0ed27be9a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:15.107999 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f575dc-de4c-4fe9-a6c5-3e0ed27be9a2 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:15.130407 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 88/167] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Aug 18 10:49:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:15.131281 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f575dc-de4c-4fe9-a6c5-3e0ed27be9a2 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:15.183228 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 80/168] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:49:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 10:49:15.184037 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd34170-15b4-4725-95bb-ae58e159420d None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:15.317599 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd34170-15b4-4725-95bb-ae58e159420d None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:15.338255 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f575dc-de4c-4fe9-a6c5-3e0ed27be9a2 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:15.341858 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:15.358506 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e975f9-02ce-403c-a2b3-a3a4ecde406c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:15.359382 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e975f9-02ce-403c-a2b3-a3a4ecde406c None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:15.359662 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e975f9-02ce-403c-a2b3-a3a4ecde406c None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:15.359927 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e975f9-02ce-403c-a2b3-a3a4ecde406c None admin] PATH_INFO: `/v3/users/dbca316ef38e45aeb63de5837094e8ce` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:15.361803 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e975f9-02ce-403c-a2b3-a3a4ecde406c None admin] RBAC: Authorizing `identity:get_user(user_id=dbca316ef38e45aeb63de5837094e8ce)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:15.365543 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e975f9-02ce-403c-a2b3-a3a4ecde406c None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:15.365543 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 81/169] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Aug 18 10:49:15 2022] GET /identity/v3/users/dbca316ef38e45aeb63de5837094e8ce => generated 275 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:15.372093 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e975f9-02ce-403c-a2b3-a3a4ecde406c None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:15.400791 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a51c18e-a950-4451-b1f2-925ff56c954b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:15.401469 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a51c18e-a950-4451-b1f2-925ff56c954b None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:15.402113 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a51c18e-a950-4451-b1f2-925ff56c954b None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:15.402463 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a51c18e-a950-4451-b1f2-925ff56c954b None admin] PATH_INFO: `/v3/projects/db515fd18ab64bc190c7a76ae5f7e632` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:15.403701 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a51c18e-a950-4451-b1f2-925ff56c954b None admin] RBAC: Authorizing `identity:get_project(project_id=db515fd18ab64bc190c7a76ae5f7e632)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:15.405809 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a51c18e-a950-4451-b1f2-925ff56c954b None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:15.407571 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 89/170] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 18 10:49:15 2022] GET /identity/v3/projects/db515fd18ab64bc190c7a76ae5f7e632 => generated 298 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:15.413418 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a51c18e-a950-4451-b1f2-925ff56c954b None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:15.493924 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:15.565113 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a51c18e-a950-4451-b1f2-925ff56c954b None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:15.638267 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420a7902-7b73-4e30-83a2-86c5c2ad262a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:15.638890 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a7902-7b73-4e30-83a2-86c5c2ad262a None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:15.639166 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a7902-7b73-4e30-83a2-86c5c2ad262a None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:15.639447 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a7902-7b73-4e30-83a2-86c5c2ad262a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:15.640190 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420a7902-7b73-4e30-83a2-86c5c2ad262a None admin] RBAC: Adding query filter params (role.id=127fdc7ef05b4e0b98a940b334e5fcab, scope.project.id=db515fd18ab64bc190c7a76ae5f7e632, user.id=55b16d3a97d74b659d9af679ed207645) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:49:15.640501 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420a7902-7b73-4e30-83a2-86c5c2ad262a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:15.641974 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420a7902-7b73-4e30-83a2-86c5c2ad262a None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:15.645212 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e975f9-02ce-403c-a2b3-a3a4ecde406c None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:15.648750 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 90/171] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Aug 18 10:49:15 2022] GET /identity/v3/role_assignments?user.id=55b16d3a97d74b659d9af679ed207645&scope.project.id=db515fd18ab64bc190c7a76ae5f7e632&role.id=127fdc7ef05b4e0b98a940b334e5fcab => generated 608 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:15.650031 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b852f-ee12-4eca-a496-b41c8d13a657 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:15.650321 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b852f-ee12-4eca-a496-b41c8d13a657 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:15.650603 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b852f-ee12-4eca-a496-b41c8d13a657 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:15.657653 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 91/172] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:49:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:49:15.669958 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a238f7-0068-4149-956b-303db85188aa None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:15.670259 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a238f7-0068-4149-956b-303db85188aa None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:15.670516 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a238f7-0068-4149-956b-303db85188aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:15.705696 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-d6a238f7-0068-4149-956b-303db85188aa None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:49:15.707145 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-d6a238f7-0068-4149-956b-303db85188aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:49:15.708594 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4524492-bad5-45cd-9d35-ce22ee906fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:15.709263 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4524492-bad5-45cd-9d35-ce22ee906fc5 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:15.709557 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4524492-bad5-45cd-9d35-ce22ee906fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:15.709876 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4524492-bad5-45cd-9d35-ce22ee906fc5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:15.757987 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:15.794241 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4524492-bad5-45cd-9d35-ce22ee906fc5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:15.795932 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4524492-bad5-45cd-9d35-ce22ee906fc5 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:15.822989 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 92/173] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:49:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 10:49:15.823976 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a238f7-0068-4149-956b-303db85188aa None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:15.834788 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:15.914538 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 82/174] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 18 10:49:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 10:49:15.920848 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4524492-bad5-45cd-9d35-ce22ee906fc5 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:15.992656 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a238f7-0068-4149-956b-303db85188aa None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:16.035866 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4524492-bad5-45cd-9d35-ce22ee906fc5 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:16.066452 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5bb6ec-1fb5-4b7d-aafb-1c69338e363c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:16.067136 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5bb6ec-1fb5-4b7d-aafb-1c69338e363c None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:16.067409 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5bb6ec-1fb5-4b7d-aafb-1c69338e363c None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:16.067694 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5bb6ec-1fb5-4b7d-aafb-1c69338e363c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:16.078288 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d7c39d-a478-45b7-bd3d-d30baa5378c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:16.079184 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d7c39d-a478-45b7-bd3d-d30baa5378c5 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:16.079465 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d7c39d-a478-45b7-bd3d-d30baa5378c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:16.079739 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d7c39d-a478-45b7-bd3d-d30baa5378c5 None admin] PATH_INFO: `/v3/projects/9e375c249e6e487586047ee77015bfe2` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:16.082051 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d7c39d-a478-45b7-bd3d-d30baa5378c5 None admin] RBAC: Authorizing `identity:get_project(project_id=9e375c249e6e487586047ee77015bfe2)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:16.083520 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d7c39d-a478-45b7-bd3d-d30baa5378c5 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:16.086084 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 83/175] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 18 10:49:15 2022] GET /identity/v3/projects/9e375c249e6e487586047ee77015bfe2 => generated 312 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 10:49:16.092719 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5bb6ec-1fb5-4b7d-aafb-1c69338e363c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:49:16.097852 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-3e5bb6ec-1fb5-4b7d-aafb-1c69338e363c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 10:49:16.097852 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:49:16.097852 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:49:16.097852 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:49:16.097852 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:49:16.097852 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:49:16.097852 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:49:16.097852 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:49:16.097852 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:49:16.097852 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:49:16.097852 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:49:16.097852 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:49:16.097852 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:49:16.097852 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:49:16.097852 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:49:16.097852 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:49:16.098732 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:49:16.098732 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:49:16.098732 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:49:16.098732 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:49:16.098732 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:49:16.098732 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:49:16.098732 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:49:16.098732 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:49:16.098732 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:49:16.098732 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:49:16.098732 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:49:16.098732 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:49:16.098732 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:49:16.098732 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:49:16.098732 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:49:16.098732 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:49:16.099506 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:49:16.099506 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:49:16.099506 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:49:16.099506 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:49:16.099506 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:49:16.099506 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:49:16.099506 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:49:16.099506 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:49:16.099506 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:49:16.099506 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:49:16.099506 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 10:49:16.099506 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:49:16.099506 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 93/176] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Aug 18 10:49:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:49:16.101654 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d7c39d-a478-45b7-bd3d-d30baa5378c5 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:16.105832 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:16.112185 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5bb6ec-1fb5-4b7d-aafb-1c69338e363c None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:16.165879 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:16.239942 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d7c39d-a478-45b7-bd3d-d30baa5378c5 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:16.280161 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edc6578-c740-4d7c-a0e3-79e079766a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:16.280815 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc6578-c740-4d7c-a0e3-79e079766a4b None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:16.281097 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc6578-c740-4d7c-a0e3-79e079766a4b None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:16.281411 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc6578-c740-4d7c-a0e3-79e079766a4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:16.282202 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edc6578-c740-4d7c-a0e3-79e079766a4b None admin] RBAC: Adding query filter params (role.id=719e5c62188d4f8a838987d6e72ca8f7, scope.project.id=9e375c249e6e487586047ee77015bfe2, user.id=dbca316ef38e45aeb63de5837094e8ce) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:49:16.282512 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edc6578-c740-4d7c-a0e3-79e079766a4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:16.284006 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edc6578-c740-4d7c-a0e3-79e079766a4b None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:16.290797 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 84/177] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Aug 18 10:49:16 2022] GET /identity/v3/role_assignments?user.id=dbca316ef38e45aeb63de5837094e8ce&scope.project.id=9e375c249e6e487586047ee77015bfe2&role.id=719e5c62188d4f8a838987d6e72ca8f7 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:16.291714 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edc6578-c740-4d7c-a0e3-79e079766a4b None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:16.305085 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5bb6ec-1fb5-4b7d-aafb-1c69338e363c None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:16.367642 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec593746-3098-4ba7-bfbd-506c65e749b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:16.368270 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec593746-3098-4ba7-bfbd-506c65e749b6 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:16.368618 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec593746-3098-4ba7-bfbd-506c65e749b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:16.368895 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec593746-3098-4ba7-bfbd-506c65e749b6 None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:16.369687 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec593746-3098-4ba7-bfbd-506c65e749b6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:49:16.369998 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec593746-3098-4ba7-bfbd-506c65e749b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:16.371430 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec593746-3098-4ba7-bfbd-506c65e749b6 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:16.385498 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 94/178] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 18 10:49:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:16.391321 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec593746-3098-4ba7-bfbd-506c65e749b6 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:16.405819 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:16.459352 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edc6578-c740-4d7c-a0e3-79e079766a4b None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:16.516534 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0946a1eb-ae85-430b-b60b-73b929e4ba73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:16.517191 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0946a1eb-ae85-430b-b60b-73b929e4ba73 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:16.517472 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0946a1eb-ae85-430b-b60b-73b929e4ba73 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:16.517769 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0946a1eb-ae85-430b-b60b-73b929e4ba73 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:16.532362 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:16.536948 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0946a1eb-ae85-430b-b60b-73b929e4ba73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:49:16.545778 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-0946a1eb-ae85-430b-b60b-73b929e4ba73 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 10:49:16.545778 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:49:16.545778 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:49:16.545778 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:49:16.545778 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:49:16.545778 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:49:16.545778 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:49:16.545778 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:49:16.545778 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:49:16.545778 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:49:16.545778 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:49:16.545778 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:49:16.545778 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:49:16.545778 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:49:16.545778 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:49:16.545778 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:49:16.546693 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:49:16.546693 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:49:16.546693 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:49:16.546693 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:49:16.546693 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:49:16.546693 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:49:16.546693 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:49:16.546693 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:49:16.546693 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:49:16.546693 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:49:16.546693 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:49:16.546693 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:49:16.546693 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:49:16.546693 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:49:16.546693 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:49:16.546693 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:49:16.547468 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:49:16.547468 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:49:16.547468 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:49:16.547468 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:49:16.547468 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:49:16.547468 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:49:16.547468 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:49:16.547468 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:49:16.547468 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:49:16.547468 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:49:16.547468 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 10:49:16.547468 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:49:16.547468 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 85/179] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Aug 18 10:49:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:49:16.554865 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0946a1eb-ae85-430b-b60b-73b929e4ba73 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:16.559182 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec593746-3098-4ba7-bfbd-506c65e749b6 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:16.611723 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c2b445-849f-4877-b493-44cea912ea8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:16.612388 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c2b445-849f-4877-b493-44cea912ea8f None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:16.612671 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c2b445-849f-4877-b493-44cea912ea8f None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:16.612950 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c2b445-849f-4877-b493-44cea912ea8f None admin] PATH_INFO: `/v3/users/dbca316ef38e45aeb63de5837094e8ce` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:16.618954 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c2b445-849f-4877-b493-44cea912ea8f None admin] RBAC: Authorizing `identity:get_user(user_id=dbca316ef38e45aeb63de5837094e8ce)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:16.620764 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c2b445-849f-4877-b493-44cea912ea8f None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:16.622923 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 95/180] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Aug 18 10:49:16 2022] GET /identity/v3/users/dbca316ef38e45aeb63de5837094e8ce => generated 275 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 10:49:16.624201 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f2f587-5413-42da-a6e3-3ccb67901df7 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:16.624485 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f2f587-5413-42da-a6e3-3ccb67901df7 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:16.624764 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f2f587-5413-42da-a6e3-3ccb67901df7 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:16.626146 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 96/181] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:49:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:49:16.631664 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204b7aba-f115-41dc-a453-f1fd7ca47748 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:16.631953 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204b7aba-f115-41dc-a453-f1fd7ca47748 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:16.632226 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204b7aba-f115-41dc-a453-f1fd7ca47748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:16.668853 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-204b7aba-f115-41dc-a453-f1fd7ca47748 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:49:16.670156 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-204b7aba-f115-41dc-a453-f1fd7ca47748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:49:16.682651 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0946a1eb-ae85-430b-b60b-73b929e4ba73 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:16.727563 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:16.737691 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642979d6-587c-4b8a-a0bd-a0b3dfa46b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:16.738304 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642979d6-587c-4b8a-a0bd-a0b3dfa46b35 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:16.738581 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642979d6-587c-4b8a-a0bd-a0b3dfa46b35 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:16.738842 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642979d6-587c-4b8a-a0bd-a0b3dfa46b35 None admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:16.739942 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642979d6-587c-4b8a-a0bd-a0b3dfa46b35 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:49:16.740252 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642979d6-587c-4b8a-a0bd-a0b3dfa46b35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:16.741767 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642979d6-587c-4b8a-a0bd-a0b3dfa46b35 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:16.750939 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 86/182] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 18 10:49:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:16.751570 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642979d6-587c-4b8a-a0bd-a0b3dfa46b35 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:16.756953 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 97/183] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:49:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 10:49:16.758568 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b7b6d0-e431-4106-beee-e7baaac6effe None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:16.759064 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b7b6d0-e431-4106-beee-e7baaac6effe None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:16.759513 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b7b6d0-e431-4106-beee-e7baaac6effe None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:16.761636 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 98/184] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:49:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:49:16.762419 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b7b6d0-e431-4106-beee-e7baaac6effe None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:16.866787 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:16.882941 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b7b6d0-e431-4106-beee-e7baaac6effe None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:16.896666 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642979d6-587c-4b8a-a0bd-a0b3dfa46b35 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:16.935350 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d862a7b6-d2a1-4826-92fb-03f28b4fe672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:16.936076 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d862a7b6-d2a1-4826-92fb-03f28b4fe672 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:16.936357 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d862a7b6-d2a1-4826-92fb-03f28b4fe672 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:16.937270 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d862a7b6-d2a1-4826-92fb-03f28b4fe672 None admin] PATH_INFO: `/v3/users/5349daa9fb444c1f8bda15436e7aee57` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:16.942551 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e5c96f-1946-4d6f-9d18-e43ba7d8d640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:16.943453 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e5c96f-1946-4d6f-9d18-e43ba7d8d640 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:16.943935 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e5c96f-1946-4d6f-9d18-e43ba7d8d640 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:16.944427 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e5c96f-1946-4d6f-9d18-e43ba7d8d640 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:16.953781 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d862a7b6-d2a1-4826-92fb-03f28b4fe672 None admin] RBAC: Authorizing `identity:get_user(user_id=5349daa9fb444c1f8bda15436e7aee57)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:16.955251 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d862a7b6-d2a1-4826-92fb-03f28b4fe672 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:16.957878 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 99/185] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Aug 18 10:49:16 2022] GET /identity/v3/users/5349daa9fb444c1f8bda15436e7aee57 => generated 283 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:16.961868 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a39be-7ea5-4728-a76c-2f04f7786776 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:16.963048 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a39be-7ea5-4728-a76c-2f04f7786776 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:16.963753 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a39be-7ea5-4728-a76c-2f04f7786776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:16.983354 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-910a39be-7ea5-4728-a76c-2f04f7786776 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:49:16.984942 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-910a39be-7ea5-4728-a76c-2f04f7786776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:49:17.028777 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:17.047994 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e5c96f-1946-4d6f-9d18-e43ba7d8d640 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:17.050039 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e5c96f-1946-4d6f-9d18-e43ba7d8d640 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:17.080876 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 100/186] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:49:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 10:49:17.081759 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910a39be-7ea5-4728-a76c-2f04f7786776 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:17.159589 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:17.191506 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 87/187] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 18 10:49:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 10:49:17.196219 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910a39be-7ea5-4728-a76c-2f04f7786776 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:17.198539 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e5c96f-1946-4d6f-9d18-e43ba7d8d640 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:17.245759 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8707590-2a59-4f19-8909-3d7794741138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:17.247855 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8707590-2a59-4f19-8909-3d7794741138 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:17.248359 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8707590-2a59-4f19-8909-3d7794741138 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:17.248939 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8707590-2a59-4f19-8909-3d7794741138 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:17.315287 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:17.333997 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e5c96f-1946-4d6f-9d18-e43ba7d8d640 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:17.351960 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8707590-2a59-4f19-8909-3d7794741138 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:17.354742 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8707590-2a59-4f19-8909-3d7794741138 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:17.373199 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d565846-7d76-41eb-86de-d27dfafb99a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:17.373896 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d565846-7d76-41eb-86de-d27dfafb99a5 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:17.374177 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d565846-7d76-41eb-86de-d27dfafb99a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:17.374459 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d565846-7d76-41eb-86de-d27dfafb99a5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:17.385994 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d565846-7d76-41eb-86de-d27dfafb99a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:49:17.390713 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-6d565846-7d76-41eb-86de-d27dfafb99a5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 10:49:17.390713 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:49:17.390713 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:49:17.390713 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:49:17.390713 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:49:17.390713 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:49:17.390713 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:49:17.390713 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:49:17.390713 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:49:17.390713 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:49:17.390713 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:49:17.390713 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:49:17.390713 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:49:17.390713 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:49:17.390713 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:49:17.390713 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:49:17.391576 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:49:17.391576 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:49:17.391576 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:49:17.391576 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:49:17.391576 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:49:17.391576 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:49:17.391576 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:49:17.391576 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:49:17.391576 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:49:17.391576 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:49:17.391576 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:49:17.391576 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:49:17.391576 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:49:17.391576 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:49:17.391576 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:49:17.391576 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:49:17.392415 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:49:17.392415 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:49:17.392415 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:49:17.392415 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:49:17.392415 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:49:17.392415 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:49:17.392415 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:49:17.392415 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:49:17.392415 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:49:17.392415 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:49:17.392415 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 10:49:17.392415 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:49:17.392415 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 88/188] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Aug 18 10:49:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:49:17.393053 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d565846-7d76-41eb-86de-d27dfafb99a5 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:17.434333 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:17.468755 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 101/189] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 18 10:49:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 10:49:17.469631 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8707590-2a59-4f19-8909-3d7794741138 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:17.504064 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d565846-7d76-41eb-86de-d27dfafb99a5 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:17.538665 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55e3886-96f2-4de4-97e4-58c15f21315e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:17.539296 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e3886-96f2-4de4-97e4-58c15f21315e None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:17.539577 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e3886-96f2-4de4-97e4-58c15f21315e None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:17.539854 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e3886-96f2-4de4-97e4-58c15f21315e None admin] PATH_INFO: `/v3/projects/db515fd18ab64bc190c7a76ae5f7e632` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:17.541662 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55e3886-96f2-4de4-97e4-58c15f21315e None admin] RBAC: Authorizing `identity:get_project(project_id=db515fd18ab64bc190c7a76ae5f7e632)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:17.543105 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55e3886-96f2-4de4-97e4-58c15f21315e None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:17.544748 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 89/190] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 18 10:49:17 2022] GET /identity/v3/projects/db515fd18ab64bc190c7a76ae5f7e632 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:17.545533 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55e3886-96f2-4de4-97e4-58c15f21315e None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:17.566308 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:17.569926 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8707590-2a59-4f19-8909-3d7794741138 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:17.605004 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b7ade4-0c0a-41c2-b77f-e0fe64be5690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:17.605678 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b7ade4-0c0a-41c2-b77f-e0fe64be5690 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:17.605989 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b7ade4-0c0a-41c2-b77f-e0fe64be5690 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:17.606251 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b7ade4-0c0a-41c2-b77f-e0fe64be5690 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:17.607379 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b7ade4-0c0a-41c2-b77f-e0fe64be5690 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:17.609079 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b7ade4-0c0a-41c2-b77f-e0fe64be5690 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:17.610525 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 102/191] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:49:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:17.611690 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d782af-0bdb-48b9-8079-0eb7ecb76e6d None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:17.612035 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d782af-0bdb-48b9-8079-0eb7ecb76e6d None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:17.612311 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d782af-0bdb-48b9-8079-0eb7ecb76e6d None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:17.613553 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 103/192] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:49:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:49:17.614277 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d782af-0bdb-48b9-8079-0eb7ecb76e6d None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:17.659951 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55e3886-96f2-4de4-97e4-58c15f21315e None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:17.660377 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:17.695694 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deae1fa9-66d9-4791-8125-a8831aa7034a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:17.696332 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae1fa9-66d9-4791-8125-a8831aa7034a None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:17.696545 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae1fa9-66d9-4791-8125-a8831aa7034a None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:17.696877 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae1fa9-66d9-4791-8125-a8831aa7034a None admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:17.697577 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deae1fa9-66d9-4791-8125-a8831aa7034a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:49:17.697885 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deae1fa9-66d9-4791-8125-a8831aa7034a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:17.699278 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deae1fa9-66d9-4791-8125-a8831aa7034a None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:17.707978 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 90/193] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 18 10:49:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:17.707978 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deae1fa9-66d9-4791-8125-a8831aa7034a None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:17.724072 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d782af-0bdb-48b9-8079-0eb7ecb76e6d None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:17.759785 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9734c84-90de-4881-afb9-981bf1084dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:17.760418 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9734c84-90de-4881-afb9-981bf1084dcc None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:17.760692 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9734c84-90de-4881-afb9-981bf1084dcc None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:17.760963 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9734c84-90de-4881-afb9-981bf1084dcc None admin] PATH_INFO: `/v3/projects/40e4bf42973a49f182b6ddf70bcb3bdf` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:17.762101 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9734c84-90de-4881-afb9-981bf1084dcc None admin] RBAC: Authorizing `identity:get_project(project_id=40e4bf42973a49f182b6ddf70bcb3bdf)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:17.763528 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9734c84-90de-4881-afb9-981bf1084dcc None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:17.765141 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 104/194] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 18 10:49:17 2022] GET /identity/v3/projects/40e4bf42973a49f182b6ddf70bcb3bdf => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:17.765905 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9734c84-90de-4881-afb9-981bf1084dcc None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:17.799905 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:17.819630 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deae1fa9-66d9-4791-8125-a8831aa7034a None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:17.857884 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b40c798-cd9a-472a-bec6-758bab67acc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:17.858480 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b40c798-cd9a-472a-bec6-758bab67acc1 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:17.858763 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b40c798-cd9a-472a-bec6-758bab67acc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:17.859043 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b40c798-cd9a-472a-bec6-758bab67acc1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:17.859779 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b40c798-cd9a-472a-bec6-758bab67acc1 None admin] RBAC: Adding query filter params (role.id=0ecb6b324fc643f3826b2878f2f6174b, scope.project.id=db515fd18ab64bc190c7a76ae5f7e632, user.id=dbca316ef38e45aeb63de5837094e8ce) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:49:17.860088 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b40c798-cd9a-472a-bec6-758bab67acc1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:17.861595 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b40c798-cd9a-472a-bec6-758bab67acc1 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:17.866794 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9734c84-90de-4881-afb9-981bf1084dcc None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:17.867297 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 91/195] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Aug 18 10:49:17 2022] GET /identity/v3/role_assignments?user.id=dbca316ef38e45aeb63de5837094e8ce&scope.project.id=db515fd18ab64bc190c7a76ae5f7e632&role.id=0ecb6b324fc643f3826b2878f2f6174b => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:17.869331 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d526b5ff-d0f0-4a2c-ae59-74e467e5e7ba None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:17.870091 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d526b5ff-d0f0-4a2c-ae59-74e467e5e7ba None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:17.870372 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d526b5ff-d0f0-4a2c-ae59-74e467e5e7ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:17.878452 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:17.891272 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-d526b5ff-d0f0-4a2c-ae59-74e467e5e7ba None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:49:17.892673 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-d526b5ff-d0f0-4a2c-ae59-74e467e5e7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:49:17.913454 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dee4d77-44fb-4166-96f2-efafdae8d547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:17.914126 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dee4d77-44fb-4166-96f2-efafdae8d547 None admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:17.914412 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dee4d77-44fb-4166-96f2-efafdae8d547 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:17.914689 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dee4d77-44fb-4166-96f2-efafdae8d547 None admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:17.916035 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dee4d77-44fb-4166-96f2-efafdae8d547 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:17.917640 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dee4d77-44fb-4166-96f2-efafdae8d547 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:17.944035 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 105/196] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Aug 18 10:49:17 2022] POST /identity/v3/users => generated 297 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 10:49:17.945167 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dee4d77-44fb-4166-96f2-efafdae8d547 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:17.994364 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 92/197] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:49:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 10:49:17.996204 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d526b5ff-d0f0-4a2c-ae59-74e467e5e7ba None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:18.122930 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dee4d77-44fb-4166-96f2-efafdae8d547 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:18.142231 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:18.181671 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd86b814-9e5a-4a2e-bf22-dd93db224040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:18.182260 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86b814-9e5a-4a2e-bf22-dd93db224040 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:18.182528 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86b814-9e5a-4a2e-bf22-dd93db224040 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:18.182797 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86b814-9e5a-4a2e-bf22-dd93db224040 None admin] PATH_INFO: `/v3/users/5349daa9fb444c1f8bda15436e7aee57` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:18.183957 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd86b814-9e5a-4a2e-bf22-dd93db224040 None admin] RBAC: Authorizing `identity:get_user(user_id=5349daa9fb444c1f8bda15436e7aee57)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:18.184057 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d526b5ff-d0f0-4a2c-ae59-74e467e5e7ba None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:18.185405 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd86b814-9e5a-4a2e-bf22-dd93db224040 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:18.187189 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 106/198] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Aug 18 10:49:17 2022] GET /identity/v3/users/5349daa9fb444c1f8bda15436e7aee57 => generated 283 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:18.194215 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd86b814-9e5a-4a2e-bf22-dd93db224040 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:18.246896 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:18.249144 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66801f8b-d2f8-4e73-88ed-42e60958bce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:18.250106 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66801f8b-d2f8-4e73-88ed-42e60958bce0 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:18.250106 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66801f8b-d2f8-4e73-88ed-42e60958bce0 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:18.250381 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66801f8b-d2f8-4e73-88ed-42e60958bce0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:18.251122 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66801f8b-d2f8-4e73-88ed-42e60958bce0 None admin] RBAC: Adding query filter params (role.id=127fdc7ef05b4e0b98a940b334e5fcab, scope.project.id=40e4bf42973a49f182b6ddf70bcb3bdf, user.id=5349daa9fb444c1f8bda15436e7aee57) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:49:18.251596 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66801f8b-d2f8-4e73-88ed-42e60958bce0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:18.253057 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66801f8b-d2f8-4e73-88ed-42e60958bce0 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:18.266954 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 93/199] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Aug 18 10:49:17 2022] GET /identity/v3/role_assignments?user.id=5349daa9fb444c1f8bda15436e7aee57&scope.project.id=40e4bf42973a49f182b6ddf70bcb3bdf&role.id=127fdc7ef05b4e0b98a940b334e5fcab => generated 259 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:18.289143 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66801f8b-d2f8-4e73-88ed-42e60958bce0 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:18.364180 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd86b814-9e5a-4a2e-bf22-dd93db224040 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:18.412480 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6499e654-5844-4d03-82f6-abc93b3af35b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:18.413349 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499e654-5844-4d03-82f6-abc93b3af35b None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:18.413887 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499e654-5844-4d03-82f6-abc93b3af35b None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:18.414329 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499e654-5844-4d03-82f6-abc93b3af35b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:18.439341 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66801f8b-d2f8-4e73-88ed-42e60958bce0 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:18.485230 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f17538-8120-43b4-b0bc-a10e20bc28c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:18.486175 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f17538-8120-43b4-b0bc-a10e20bc28c7 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:18.486768 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f17538-8120-43b4-b0bc-a10e20bc28c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:18.487185 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f17538-8120-43b4-b0bc-a10e20bc28c7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:18.501405 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6499e654-5844-4d03-82f6-abc93b3af35b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:18.502829 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6499e654-5844-4d03-82f6-abc93b3af35b None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:18.504030 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:18.511033 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f17538-8120-43b4-b0bc-a10e20bc28c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:49:18.517278 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-56f17538-8120-43b4-b0bc-a10e20bc28c7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 10:49:18.517278 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:49:18.517278 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:49:18.517278 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:49:18.517278 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:49:18.517278 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:49:18.517278 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:49:18.517278 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:49:18.517278 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:49:18.517278 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:49:18.517278 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:49:18.517278 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:49:18.517278 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:49:18.517278 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:49:18.517278 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:49:18.517278 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:49:18.518253 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:49:18.518253 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:49:18.518253 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:49:18.518253 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:49:18.518253 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:49:18.518253 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:49:18.518253 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:49:18.518253 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:49:18.518253 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:49:18.518253 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:49:18.518253 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:49:18.518253 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:49:18.518253 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:49:18.518253 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:49:18.518253 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:49:18.518253 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:49:18.519162 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:49:18.519162 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:49:18.519162 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:49:18.519162 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:49:18.519162 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:49:18.519162 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:49:18.519162 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:49:18.519162 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:49:18.519162 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:49:18.519162 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:49:18.519162 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 10:49:18.519162 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:49:18.521989 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 94/200] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 18 10:49:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 10:49:18.528797 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f17538-8120-43b4-b0bc-a10e20bc28c7 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:18.559780 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:18.650625 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f17538-8120-43b4-b0bc-a10e20bc28c7 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:18.691354 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a41efab-a910-4e9f-9938-d7b7f552ec71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:18.692662 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a41efab-a910-4e9f-9938-d7b7f552ec71 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:18.693174 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a41efab-a910-4e9f-9938-d7b7f552ec71 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:18.693776 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a41efab-a910-4e9f-9938-d7b7f552ec71 None admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:18.694676 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a41efab-a910-4e9f-9938-d7b7f552ec71 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:49:18.695180 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a41efab-a910-4e9f-9938-d7b7f552ec71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:18.696854 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a41efab-a910-4e9f-9938-d7b7f552ec71 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:18.706705 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 95/201] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Aug 18 10:49:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 10:49:18.717710 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a41efab-a910-4e9f-9938-d7b7f552ec71 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:18.746665 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 107/202] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 18 10:49:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 18 10:49:18.752461 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6499e654-5844-4d03-82f6-abc93b3af35b None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:18.833890 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:18.880129 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a41efab-a910-4e9f-9938-d7b7f552ec71 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:18.920507 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed02215-2193-40fe-a0fd-81b999930226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:18.922108 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed02215-2193-40fe-a0fd-81b999930226 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:18.923100 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed02215-2193-40fe-a0fd-81b999930226 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:18.923599 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed02215-2193-40fe-a0fd-81b999930226 None admin] PATH_INFO: `/v3/users/a02a06e1ca6a47768fbad9958a5a1b39` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:18.925884 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed02215-2193-40fe-a0fd-81b999930226 None admin] RBAC: Authorizing `identity:get_user(user_id=a02a06e1ca6a47768fbad9958a5a1b39)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:18.927607 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed02215-2193-40fe-a0fd-81b999930226 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:18.930427 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 96/203] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Aug 18 10:49:18 2022] GET /identity/v3/users/a02a06e1ca6a47768fbad9958a5a1b39 => generated 289 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:18.938601 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed02215-2193-40fe-a0fd-81b999930226 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:18.961640 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6499e654-5844-4d03-82f6-abc93b3af35b None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:19.023247 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:19.033835 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02db205-a9f3-4dbb-9600-82cd36406884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:19.034479 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02db205-a9f3-4dbb-9600-82cd36406884 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:19.034753 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02db205-a9f3-4dbb-9600-82cd36406884 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:19.035024 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02db205-a9f3-4dbb-9600-82cd36406884 None admin] PATH_INFO: `/v3/projects/40e4bf42973a49f182b6ddf70bcb3bdf` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:19.037115 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02db205-a9f3-4dbb-9600-82cd36406884 None admin] RBAC: Authorizing `identity:get_project(project_id=40e4bf42973a49f182b6ddf70bcb3bdf)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:19.038818 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02db205-a9f3-4dbb-9600-82cd36406884 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:19.042998 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 108/204] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 18 10:49:18 2022] GET /identity/v3/projects/40e4bf42973a49f182b6ddf70bcb3bdf => generated 302 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 10:49:19.048841 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02db205-a9f3-4dbb-9600-82cd36406884 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:19.109760 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed02215-2193-40fe-a0fd-81b999930226 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:19.140753 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:19.174242 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e412b24b-2fd3-47bf-a986-6b444bb2f96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:19.174930 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e412b24b-2fd3-47bf-a986-6b444bb2f96e None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:19.175209 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e412b24b-2fd3-47bf-a986-6b444bb2f96e None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:19.175485 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e412b24b-2fd3-47bf-a986-6b444bb2f96e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:19.197089 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02db205-a9f3-4dbb-9600-82cd36406884 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:19.233529 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad9329b-8b88-49cf-8abd-3745d38a98ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:19.234161 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad9329b-8b88-49cf-8abd-3745d38a98ed None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:19.234436 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad9329b-8b88-49cf-8abd-3745d38a98ed None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:19.234712 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad9329b-8b88-49cf-8abd-3745d38a98ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:19.235482 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad9329b-8b88-49cf-8abd-3745d38a98ed None admin] RBAC: Adding query filter params (role.id=0ecb6b324fc643f3826b2878f2f6174b, scope.project.id=40e4bf42973a49f182b6ddf70bcb3bdf, user.id=5349daa9fb444c1f8bda15436e7aee57) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:49:19.235788 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad9329b-8b88-49cf-8abd-3745d38a98ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:19.237256 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad9329b-8b88-49cf-8abd-3745d38a98ed None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:19.243350 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 109/205] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Aug 18 10:49:19 2022] GET /identity/v3/role_assignments?user.id=5349daa9fb444c1f8bda15436e7aee57&scope.project.id=40e4bf42973a49f182b6ddf70bcb3bdf&role.id=0ecb6b324fc643f3826b2878f2f6174b => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:19.301569 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e412b24b-2fd3-47bf-a986-6b444bb2f96e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:19.302988 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e412b24b-2fd3-47bf-a986-6b444bb2f96e None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:19.417556 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 97/206] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 18 10:49:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 10:49:19.423282 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad9329b-8b88-49cf-8abd-3745d38a98ed None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:19.513245 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:19.567801 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad9329b-8b88-49cf-8abd-3745d38a98ed None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:19.603295 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2a711e-21fc-4034-b87d-bd7e017ff49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:19.603938 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a711e-21fc-4034-b87d-bd7e017ff49e None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:19.604213 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a711e-21fc-4034-b87d-bd7e017ff49e None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:19.604484 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a711e-21fc-4034-b87d-bd7e017ff49e None admin] PATH_INFO: `/v3/projects/db515fd18ab64bc190c7a76ae5f7e632` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:19.605680 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2a711e-21fc-4034-b87d-bd7e017ff49e None admin] RBAC: Authorizing `identity:get_project(project_id=db515fd18ab64bc190c7a76ae5f7e632)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:19.607124 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2a711e-21fc-4034-b87d-bd7e017ff49e None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:19.613677 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 110/207] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 18 10:49:19 2022] GET /identity/v3/projects/db515fd18ab64bc190c7a76ae5f7e632 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:19.615305 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e412b24b-2fd3-47bf-a986-6b444bb2f96e None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:19.651965 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:19.757651 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e412b24b-2fd3-47bf-a986-6b444bb2f96e None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:19.808127 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec19d3b-1181-4190-a4c9-3b9ecd7f2718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:19.808739 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec19d3b-1181-4190-a4c9-3b9ecd7f2718 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:19.809016 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec19d3b-1181-4190-a4c9-3b9ecd7f2718 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:19.809280 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec19d3b-1181-4190-a4c9-3b9ecd7f2718 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:19.810035 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec19d3b-1181-4190-a4c9-3b9ecd7f2718 None admin] RBAC: Adding query filter params (role.id=fcb5eb4c33b24ac9904230e57dec7ec9, scope.project.id=db515fd18ab64bc190c7a76ae5f7e632, user.id=a02a06e1ca6a47768fbad9958a5a1b39) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:49:19.810336 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec19d3b-1181-4190-a4c9-3b9ecd7f2718 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:19.811762 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec19d3b-1181-4190-a4c9-3b9ecd7f2718 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:19.822264 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 98/208] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Aug 18 10:49:19 2022] GET /identity/v3/role_assignments?user.id=a02a06e1ca6a47768fbad9958a5a1b39&scope.project.id=db515fd18ab64bc190c7a76ae5f7e632&role.id=fcb5eb4c33b24ac9904230e57dec7ec9 => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:20.387150 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c0f382-bfa3-4bd5-872b-6ba67fbb1e89 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:20.388281 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c0f382-bfa3-4bd5-872b-6ba67fbb1e89 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:20.388842 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c0f382-bfa3-4bd5-872b-6ba67fbb1e89 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:20.390699 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 111/209] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:49:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:49:20.396449 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1bede-08b9-4d03-ad20-e5900e3bca2e None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:20.397005 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1bede-08b9-4d03-ad20-e5900e3bca2e None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:20.397763 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1bede-08b9-4d03-ad20-e5900e3bca2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:20.417784 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-c4e1bede-08b9-4d03-ad20-e5900e3bca2e None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:49:20.419290 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-c4e1bede-08b9-4d03-ad20-e5900e3bca2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:49:20.499711 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 99/210] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:49:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 10:49:20.544772 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ab3f3-ea38-4617-941b-28b53ac0045e None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:20.546860 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ab3f3-ea38-4617-941b-28b53ac0045e None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:20.546860 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ab3f3-ea38-4617-941b-28b53ac0045e None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:20.547336 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 112/211] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:49:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:49:20.555935 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2800a193-71c6-47d5-bc36-3200f6cb9431 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:20.555935 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2800a193-71c6-47d5-bc36-3200f6cb9431 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:20.555935 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2800a193-71c6-47d5-bc36-3200f6cb9431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:20.572570 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-2800a193-71c6-47d5-bc36-3200f6cb9431 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:49:20.574063 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-2800a193-71c6-47d5-bc36-3200f6cb9431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:49:20.585577 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba8be13-e04f-48c4-9de5-3a2fdbf26b1b None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:20.585577 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba8be13-e04f-48c4-9de5-3a2fdbf26b1b None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:20.585577 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba8be13-e04f-48c4-9de5-3a2fdbf26b1b None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:20.585954 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 113/212] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:49:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 10:49:20.591871 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d7b27a-bfae-47b8-a1df-68753b6ffe15 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:20.592150 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d7b27a-bfae-47b8-a1df-68753b6ffe15 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:20.592421 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d7b27a-bfae-47b8-a1df-68753b6ffe15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:20.594386 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:20.613809 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-31d7b27a-bfae-47b8-a1df-68753b6ffe15 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:49:20.615115 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-31d7b27a-bfae-47b8-a1df-68753b6ffe15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:49:20.651470 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 100/213] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:49:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 10:49:20.693634 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 114/214] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:49:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 10:49:20.779754 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2800a193-71c6-47d5-bc36-3200f6cb9431 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:20.891491 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2800a193-71c6-47d5-bc36-3200f6cb9431 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:20.928687 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f013ee-020b-4802-8173-bf5d05d41c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:20.929318 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f013ee-020b-4802-8173-bf5d05d41c6f None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:20.929620 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f013ee-020b-4802-8173-bf5d05d41c6f None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:20.929893 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f013ee-020b-4802-8173-bf5d05d41c6f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:20.936621 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d7b27a-bfae-47b8-a1df-68753b6ffe15 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:20.941225 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f013ee-020b-4802-8173-bf5d05d41c6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:49:20.946029 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-b9f013ee-020b-4802-8173-bf5d05d41c6f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 10:49:20.946029 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:49:20.946029 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:49:20.946029 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:49:20.946029 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:49:20.946029 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:49:20.946029 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:49:20.946029 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:49:20.946029 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:49:20.946029 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:49:20.946029 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:49:20.946029 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:49:20.946029 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:49:20.946029 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:49:20.946029 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:49:20.946029 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:49:20.948316 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:49:20.948316 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:49:20.948316 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:49:20.948316 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:49:20.948316 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:49:20.948316 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:49:20.948316 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:49:20.948316 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:49:20.948316 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:49:20.948316 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:49:20.948316 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:49:20.948316 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:49:20.948316 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:49:20.948316 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:49:20.948316 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:49:20.948316 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:49:20.949454 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:49:20.949454 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:49:20.949454 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:49:20.949454 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:49:20.949454 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:49:20.949454 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:49:20.949454 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:49:20.949454 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:49:20.949454 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:49:20.949454 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:49:20.949454 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 10:49:20.949454 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:49:20.949454 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 101/215] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 18 10:49:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 10:49:20.953409 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f013ee-020b-4802-8173-bf5d05d41c6f None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:20.971743 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:21.014305 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:21.057794 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d7b27a-bfae-47b8-a1df-68753b6ffe15 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:21.074273 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f013ee-020b-4802-8173-bf5d05d41c6f None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:21.094072 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b7a880-1fdb-41a9-b242-90e31b3762cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:21.094702 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7a880-1fdb-41a9-b242-90e31b3762cc None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:21.094978 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7a880-1fdb-41a9-b242-90e31b3762cc None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:21.095253 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7a880-1fdb-41a9-b242-90e31b3762cc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:21.105308 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b7a880-1fdb-41a9-b242-90e31b3762cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:49:21.109980 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-b1b7a880-1fdb-41a9-b242-90e31b3762cc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 10:49:21.109980 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:49:21.109980 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:49:21.109980 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:49:21.109980 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:49:21.109980 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:49:21.109980 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:49:21.109980 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:49:21.109980 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:49:21.109980 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:49:21.109980 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:49:21.109980 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:49:21.109980 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:49:21.109980 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:49:21.109980 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:49:21.109980 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:49:21.111045 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:49:21.111045 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:49:21.111045 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:49:21.111045 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:49:21.111045 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:49:21.111045 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:49:21.111045 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:49:21.111045 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:49:21.111045 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:49:21.111045 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:49:21.111045 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:49:21.111045 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:49:21.111045 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:49:21.111045 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:49:21.111045 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:49:21.111045 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:49:21.114542 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:49:21.114542 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:49:21.114542 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:49:21.114542 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:49:21.114542 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:49:21.114542 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:49:21.114542 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:49:21.114542 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:49:21.114542 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:49:21.114542 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:49:21.114542 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 10:49:21.114542 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:49:21.114542 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 115/216] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Aug 18 10:49:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:49:21.114542 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b7a880-1fdb-41a9-b242-90e31b3762cc None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:21.120098 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adf01c3-a7eb-468e-968e-68e63ca93030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:21.120709 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf01c3-a7eb-468e-968e-68e63ca93030 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:21.120983 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf01c3-a7eb-468e-968e-68e63ca93030 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:21.121252 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf01c3-a7eb-468e-968e-68e63ca93030 None admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:21.121954 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adf01c3-a7eb-468e-968e-68e63ca93030 None admin] RBAC: Adding query filter params (name=member) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:49:21.122253 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adf01c3-a7eb-468e-968e-68e63ca93030 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:21.123632 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adf01c3-a7eb-468e-968e-68e63ca93030 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:21.138597 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 102/217] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Aug 18 10:49:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 10:49:21.138597 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adf01c3-a7eb-468e-968e-68e63ca93030 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:21.220099 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:21.237821 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b7a880-1fdb-41a9-b242-90e31b3762cc None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:21.247091 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adf01c3-a7eb-468e-968e-68e63ca93030 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:21.263012 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:21.276097 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fe5af7-4b55-4ae3-b30e-939f8b6b40af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:21.276736 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe5af7-4b55-4ae3-b30e-939f8b6b40af None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:21.277013 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe5af7-4b55-4ae3-b30e-939f8b6b40af None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:21.277283 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe5af7-4b55-4ae3-b30e-939f8b6b40af None admin] PATH_INFO: `/v3/domains/default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:21.278428 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fe5af7-4b55-4ae3-b30e-939f8b6b40af None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:21.279870 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fe5af7-4b55-4ae3-b30e-939f8b6b40af None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:21.285654 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 116/218] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:49:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:21.285654 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fe5af7-4b55-4ae3-b30e-939f8b6b40af None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:21.286265 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438717c3-1ff9-41a4-9c18-bfe9cb411fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:21.286880 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438717c3-1ff9-41a4-9c18-bfe9cb411fd5 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:21.287158 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438717c3-1ff9-41a4-9c18-bfe9cb411fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:21.287427 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438717c3-1ff9-41a4-9c18-bfe9cb411fd5 None admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:21.288101 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438717c3-1ff9-41a4-9c18-bfe9cb411fd5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:49:21.288403 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438717c3-1ff9-41a4-9c18-bfe9cb411fd5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:21.289871 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438717c3-1ff9-41a4-9c18-bfe9cb411fd5 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:21.299816 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 103/219] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 18 10:49:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:21.304928 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438717c3-1ff9-41a4-9c18-bfe9cb411fd5 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:21.403754 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fe5af7-4b55-4ae3-b30e-939f8b6b40af None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:21.413975 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438717c3-1ff9-41a4-9c18-bfe9cb411fd5 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:21.442353 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dbea9b-e5bf-4530-aae2-8556550a7cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:21.442985 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dbea9b-e5bf-4530-aae2-8556550a7cfb None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:21.443263 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dbea9b-e5bf-4530-aae2-8556550a7cfb None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:21.443533 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dbea9b-e5bf-4530-aae2-8556550a7cfb None admin] PATH_INFO: `/v3/users/8711340fbde440328dde2518bab45208` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:21.449807 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24135184-7b6c-4a32-9993-3d655770e662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:21.450425 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24135184-7b6c-4a32-9993-3d655770e662 None admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:21.450758 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24135184-7b6c-4a32-9993-3d655770e662 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:21.450976 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24135184-7b6c-4a32-9993-3d655770e662 None admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:21.451636 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24135184-7b6c-4a32-9993-3d655770e662 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:21.453086 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24135184-7b6c-4a32-9993-3d655770e662 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:21.457844 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dbea9b-e5bf-4530-aae2-8556550a7cfb None admin] RBAC: Authorizing `identity:get_user(user_id=8711340fbde440328dde2518bab45208)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:21.459283 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dbea9b-e5bf-4530-aae2-8556550a7cfb None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:21.466256 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 117/220] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Aug 18 10:49:21 2022] GET /identity/v3/users/8711340fbde440328dde2518bab45208 => generated 297 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:21.466256 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dbea9b-e5bf-4530-aae2-8556550a7cfb None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:21.468773 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:21.493946 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 104/221] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Aug 18 10:49:21 2022] POST /identity/v3/users => generated 297 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 10:49:21.495884 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24135184-7b6c-4a32-9993-3d655770e662 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:21.535559 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:21.605552 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dbea9b-e5bf-4530-aae2-8556550a7cfb None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:21.636868 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24135184-7b6c-4a32-9993-3d655770e662 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:21.648859 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1087cd92-af5f-4da1-a44c-e97dadd9fe9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:21.650450 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1087cd92-af5f-4da1-a44c-e97dadd9fe9a None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:21.650929 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1087cd92-af5f-4da1-a44c-e97dadd9fe9a None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:21.651374 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1087cd92-af5f-4da1-a44c-e97dadd9fe9a None admin] PATH_INFO: `/v3/users/5349daa9fb444c1f8bda15436e7aee57` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:21.653592 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1087cd92-af5f-4da1-a44c-e97dadd9fe9a None admin] RBAC: Authorizing `identity:get_user(user_id=5349daa9fb444c1f8bda15436e7aee57)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:21.655291 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1087cd92-af5f-4da1-a44c-e97dadd9fe9a None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:21.657230 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 118/222] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Aug 18 10:49:21 2022] GET /identity/v3/users/5349daa9fb444c1f8bda15436e7aee57 => generated 283 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:21.664031 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1087cd92-af5f-4da1-a44c-e97dadd9fe9a None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:21.681849 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d335b177-5a4f-4313-8093-a98da09ae82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:21.682501 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d335b177-5a4f-4313-8093-a98da09ae82e None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:21.682916 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d335b177-5a4f-4313-8093-a98da09ae82e None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:21.684021 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d335b177-5a4f-4313-8093-a98da09ae82e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:21.767197 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:21.779560 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d335b177-5a4f-4313-8093-a98da09ae82e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:21.781042 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d335b177-5a4f-4313-8093-a98da09ae82e None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:21.802257 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1087cd92-af5f-4da1-a44c-e97dadd9fe9a None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:21.827836 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:21.854296 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87206162-7ff1-4863-bbea-5eea7d4956a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:21.854940 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87206162-7ff1-4863-bbea-5eea7d4956a2 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:21.855216 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87206162-7ff1-4863-bbea-5eea7d4956a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:21.855484 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87206162-7ff1-4863-bbea-5eea7d4956a2 None admin] PATH_INFO: `/v3/projects/40e4bf42973a49f182b6ddf70bcb3bdf` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:21.856642 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87206162-7ff1-4863-bbea-5eea7d4956a2 None admin] RBAC: Authorizing `identity:get_project(project_id=40e4bf42973a49f182b6ddf70bcb3bdf)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:21.858119 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87206162-7ff1-4863-bbea-5eea7d4956a2 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:21.859936 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 119/223] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 18 10:49:21 2022] GET /identity/v3/projects/40e4bf42973a49f182b6ddf70bcb3bdf => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 10:49:21.860893 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd798a1-1130-43fc-95a4-04ccb7a51d58 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:21.861277 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd798a1-1130-43fc-95a4-04ccb7a51d58 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:21.861454 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd798a1-1130-43fc-95a4-04ccb7a51d58 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:21.863570 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 120/224] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:49:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:49:21.867355 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd798a1-1130-43fc-95a4-04ccb7a51d58 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:21.910076 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 105/225] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 18 10:49:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 10:49:21.911417 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698de542-e3ff-4d43-9fd7-54d00be43e84 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:21.911724 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698de542-e3ff-4d43-9fd7-54d00be43e84 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:21.912004 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698de542-e3ff-4d43-9fd7-54d00be43e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:21.932188 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-698de542-e3ff-4d43-9fd7-54d00be43e84 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:49:21.933483 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-698de542-e3ff-4d43-9fd7-54d00be43e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:49:22.001102 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd798a1-1130-43fc-95a4-04ccb7a51d58 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:22.011698 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 106/226] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:49:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 10:49:22.013002 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698de542-e3ff-4d43-9fd7-54d00be43e84 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:22.045203 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:22.053438 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651fe083-a9db-4883-a929-2578aa1b4c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:22.054194 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651fe083-a9db-4883-a929-2578aa1b4c44 None admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:22.054523 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651fe083-a9db-4883-a929-2578aa1b4c44 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:22.054996 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651fe083-a9db-4883-a929-2578aa1b4c44 None admin] PATH_INFO: `/v3/projects/40e4bf42973a49f182b6ddf70bcb3bdf/users/5349daa9fb444c1f8bda15436e7aee57/roles/127fdc7ef05b4e0b98a940b334e5fcab` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:22.058364 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651fe083-a9db-4883-a929-2578aa1b4c44 None admin] RBAC: Authorizing `identity:create_grant(project_id=40e4bf42973a49f182b6ddf70bcb3bdf, user_id=5349daa9fb444c1f8bda15436e7aee57, role_id=127fdc7ef05b4e0b98a940b334e5fcab)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:22.060778 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651fe083-a9db-4883-a929-2578aa1b4c44 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:22.080147 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 121/227] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Aug 18 10:49:21 2022] PUT /identity/v3/projects/40e4bf42973a49f182b6ddf70bcb3bdf/users/5349daa9fb444c1f8bda15436e7aee57/roles/127fdc7ef05b4e0b98a940b334e5fcab => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 10:49:22.145779 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698de542-e3ff-4d43-9fd7-54d00be43e84 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:22.186986 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb8837e-af20-48f8-a715-600af39def87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:22.188016 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb8837e-af20-48f8-a715-600af39def87 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:22.188508 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb8837e-af20-48f8-a715-600af39def87 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:22.188976 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb8837e-af20-48f8-a715-600af39def87 None admin] PATH_INFO: `/v3/projects/40e4bf42973a49f182b6ddf70bcb3bdf` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:22.190415 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb8837e-af20-48f8-a715-600af39def87 None admin] RBAC: Authorizing `identity:get_project(project_id=40e4bf42973a49f182b6ddf70bcb3bdf)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:22.192237 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb8837e-af20-48f8-a715-600af39def87 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:22.194546 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 107/228] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 18 10:49:22 2022] GET /identity/v3/projects/40e4bf42973a49f182b6ddf70bcb3bdf => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:22.205946 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651fe083-a9db-4883-a929-2578aa1b4c44 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:22.278823 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:22.339231 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651fe083-a9db-4883-a929-2578aa1b4c44 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:22.376040 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5fe290-55f6-468e-9ba7-bc2941dc115f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:22.376693 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5fe290-55f6-468e-9ba7-bc2941dc115f None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:22.377038 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5fe290-55f6-468e-9ba7-bc2941dc115f None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:22.377374 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5fe290-55f6-468e-9ba7-bc2941dc115f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:22.378156 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5fe290-55f6-468e-9ba7-bc2941dc115f None admin] RBAC: Adding query filter params (role.id=719e5c62188d4f8a838987d6e72ca8f7, scope.project.id=40e4bf42973a49f182b6ddf70bcb3bdf, user.id=8711340fbde440328dde2518bab45208) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:49:22.378463 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5fe290-55f6-468e-9ba7-bc2941dc115f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:22.379901 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5fe290-55f6-468e-9ba7-bc2941dc115f None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:22.384790 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb8837e-af20-48f8-a715-600af39def87 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:22.386922 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 122/229] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Aug 18 10:49:22 2022] GET /identity/v3/role_assignments?user.id=8711340fbde440328dde2518bab45208&scope.project.id=40e4bf42973a49f182b6ddf70bcb3bdf&role.id=719e5c62188d4f8a838987d6e72ca8f7 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:22.502889 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:22.518593 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb8837e-af20-48f8-a715-600af39def87 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:22.570605 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c7b02b-df20-41d2-9834-4681313111b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:22.571636 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c7b02b-df20-41d2-9834-4681313111b3 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:22.572265 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c7b02b-df20-41d2-9834-4681313111b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:22.572767 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c7b02b-df20-41d2-9834-4681313111b3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:22.583718 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c7b02b-df20-41d2-9834-4681313111b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:49:22.590573 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-50c7b02b-df20-41d2-9834-4681313111b3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 10:49:22.590573 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:49:22.590573 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:49:22.590573 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:49:22.590573 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:49:22.590573 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:49:22.590573 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:49:22.590573 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:49:22.590573 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:49:22.590573 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:49:22.590573 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:49:22.590573 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:49:22.590573 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:49:22.590573 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:49:22.590573 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:49:22.590573 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:49:22.591453 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:49:22.591453 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:49:22.591453 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:49:22.591453 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:49:22.591453 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:49:22.591453 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:49:22.591453 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:49:22.591453 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:49:22.591453 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:49:22.591453 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:49:22.591453 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:49:22.591453 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:49:22.591453 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:49:22.591453 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:49:22.591453 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:49:22.591453 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:49:22.592226 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:49:22.592226 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:49:22.592226 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:49:22.592226 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:49:22.592226 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:49:22.592226 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:49:22.592226 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:49:22.592226 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:49:22.592226 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:49:22.592226 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:49:22.592226 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 10:49:22.592226 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:49:22.594832 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 108/230] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Aug 18 10:49:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:49:22.603394 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5fe290-55f6-468e-9ba7-bc2941dc115f None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:22.745939 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5fe290-55f6-468e-9ba7-bc2941dc115f None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:22.762449 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:22.796207 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150a02ab-f84d-4933-97af-88bf61751f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:22.797286 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150a02ab-f84d-4933-97af-88bf61751f18 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:22.797841 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150a02ab-f84d-4933-97af-88bf61751f18 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:22.798320 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150a02ab-f84d-4933-97af-88bf61751f18 None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:22.799236 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150a02ab-f84d-4933-97af-88bf61751f18 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:49:22.799738 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150a02ab-f84d-4933-97af-88bf61751f18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:22.801317 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150a02ab-f84d-4933-97af-88bf61751f18 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:22.812260 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 123/231] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 18 10:49:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:22.818156 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c7b02b-df20-41d2-9834-4681313111b3 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:22.951935 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c7b02b-df20-41d2-9834-4681313111b3 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:22.990851 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865579f0-c03d-4535-8d9e-ac3849352509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:22.991875 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865579f0-c03d-4535-8d9e-ac3849352509 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:22.992355 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865579f0-c03d-4535-8d9e-ac3849352509 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:22.992822 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865579f0-c03d-4535-8d9e-ac3849352509 None admin] PATH_INFO: `/v3/users/5349daa9fb444c1f8bda15436e7aee57` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:22.994937 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865579f0-c03d-4535-8d9e-ac3849352509 None admin] RBAC: Authorizing `identity:get_user(user_id=5349daa9fb444c1f8bda15436e7aee57)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:22.996721 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865579f0-c03d-4535-8d9e-ac3849352509 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:22.998897 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 109/232] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Aug 18 10:49:22 2022] GET /identity/v3/users/5349daa9fb444c1f8bda15436e7aee57 => generated 283 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:23.004106 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150a02ab-f84d-4933-97af-88bf61751f18 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:23.137006 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150a02ab-f84d-4933-97af-88bf61751f18 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:23.178498 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41770872-20e7-4817-93d5-83b3ad83785d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:23.179155 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41770872-20e7-4817-93d5-83b3ad83785d None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:23.179408 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41770872-20e7-4817-93d5-83b3ad83785d None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:23.179680 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41770872-20e7-4817-93d5-83b3ad83785d None admin] PATH_INFO: `/v3/projects/40e4bf42973a49f182b6ddf70bcb3bdf` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:23.182340 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41770872-20e7-4817-93d5-83b3ad83785d None admin] RBAC: Authorizing `identity:get_project(project_id=40e4bf42973a49f182b6ddf70bcb3bdf)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:23.183794 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41770872-20e7-4817-93d5-83b3ad83785d None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:23.185736 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 124/233] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 18 10:49:23 2022] GET /identity/v3/projects/40e4bf42973a49f182b6ddf70bcb3bdf => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:23.191372 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865579f0-c03d-4535-8d9e-ac3849352509 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:23.244561 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:23.358152 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865579f0-c03d-4535-8d9e-ac3849352509 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:23.402892 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092f2b32-de45-4602-a31e-7c864e3cb8e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:23.403890 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f2b32-de45-4602-a31e-7c864e3cb8e6 None admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:23.404362 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f2b32-de45-4602-a31e-7c864e3cb8e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:23.404824 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f2b32-de45-4602-a31e-7c864e3cb8e6 None admin] PATH_INFO: `/v3/projects/40e4bf42973a49f182b6ddf70bcb3bdf/users/5349daa9fb444c1f8bda15436e7aee57/roles/0ecb6b324fc643f3826b2878f2f6174b` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:23.407202 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092f2b32-de45-4602-a31e-7c864e3cb8e6 None admin] RBAC: Authorizing `identity:create_grant(project_id=40e4bf42973a49f182b6ddf70bcb3bdf, user_id=5349daa9fb444c1f8bda15436e7aee57, role_id=0ecb6b324fc643f3826b2878f2f6174b)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:23.408838 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092f2b32-de45-4602-a31e-7c864e3cb8e6 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:23.431217 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 110/234] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Aug 18 10:49:23 2022] PUT /identity/v3/projects/40e4bf42973a49f182b6ddf70bcb3bdf/users/5349daa9fb444c1f8bda15436e7aee57/roles/0ecb6b324fc643f3826b2878f2f6174b => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 10:49:23.875733 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b249a-4fab-4053-8d47-ee6984c1a244 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:23.876237 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b249a-4fab-4053-8d47-ee6984c1a244 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:23.876309 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b249a-4fab-4053-8d47-ee6984c1a244 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:23.877928 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 125/235] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:49:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:49:23.886166 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee35f3ef-7e6f-46b1-9c9a-82dbefead448 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:23.886606 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee35f3ef-7e6f-46b1-9c9a-82dbefead448 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:23.886892 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee35f3ef-7e6f-46b1-9c9a-82dbefead448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:23.913617 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-ee35f3ef-7e6f-46b1-9c9a-82dbefead448 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:49:23.914842 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-ee35f3ef-7e6f-46b1-9c9a-82dbefead448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:49:24.008157 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 111/236] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:49:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 10:49:24.113401 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d787f6-813a-4f2e-9b8a-9307487d3dd4 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:24.113757 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d787f6-813a-4f2e-9b8a-9307487d3dd4 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:24.113987 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d787f6-813a-4f2e-9b8a-9307487d3dd4 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:24.115342 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 126/237] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:49:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:49:24.121202 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ed2bb-51e5-4e0e-9420-f031d3cbd821 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:24.121491 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ed2bb-51e5-4e0e-9420-f031d3cbd821 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:24.121798 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ed2bb-51e5-4e0e-9420-f031d3cbd821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:24.162122 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-875ed2bb-51e5-4e0e-9420-f031d3cbd821 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:49:24.163258 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-875ed2bb-51e5-4e0e-9420-f031d3cbd821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:49:24.166296 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:24.271132 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 112/238] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:49:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 10:49:24.392134 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d787f6-813a-4f2e-9b8a-9307487d3dd4 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:24.460522 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:24.548840 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d787f6-813a-4f2e-9b8a-9307487d3dd4 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:24.584099 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db42dc61-3abc-4d82-bb9f-ab50f595f652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:24.584733 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42dc61-3abc-4d82-bb9f-ab50f595f652 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:24.585007 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42dc61-3abc-4d82-bb9f-ab50f595f652 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:24.585279 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42dc61-3abc-4d82-bb9f-ab50f595f652 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:24.603212 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db42dc61-3abc-4d82-bb9f-ab50f595f652 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:49:24.608492 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-db42dc61-3abc-4d82-bb9f-ab50f595f652 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 10:49:24.608492 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:49:24.608492 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:49:24.608492 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:49:24.608492 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:49:24.608492 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:49:24.608492 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:49:24.608492 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:49:24.608492 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:49:24.608492 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:49:24.608492 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:49:24.608492 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:49:24.608492 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:49:24.608492 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:49:24.608492 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:49:24.608492 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:49:24.609354 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:49:24.609354 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:49:24.609354 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:49:24.609354 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:49:24.609354 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:49:24.609354 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:49:24.609354 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:49:24.609354 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:49:24.609354 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:49:24.609354 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:49:24.609354 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:49:24.609354 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:49:24.609354 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:49:24.609354 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:49:24.609354 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:49:24.609354 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:49:24.610191 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:49:24.610191 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:49:24.610191 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:49:24.610191 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:49:24.610191 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:49:24.610191 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:49:24.610191 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:49:24.610191 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:49:24.610191 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:49:24.610191 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:49:24.610191 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 10:49:24.610191 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:49:24.610191 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 127/239] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 18 10:49:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:49:24.616851 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875ed2bb-51e5-4e0e-9420-f031d3cbd821 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:24.650652 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db42dc61-3abc-4d82-bb9f-ab50f595f652 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:24.724423 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875ed2bb-51e5-4e0e-9420-f031d3cbd821 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:24.760469 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82ab3d3-6f90-4b9e-b9cd-3275c618a6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:24.761084 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82ab3d3-6f90-4b9e-b9cd-3275c618a6a5 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:24.761363 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82ab3d3-6f90-4b9e-b9cd-3275c618a6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:24.761670 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82ab3d3-6f90-4b9e-b9cd-3275c618a6a5 None admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:24.762400 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82ab3d3-6f90-4b9e-b9cd-3275c618a6a5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:49:24.762704 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82ab3d3-6f90-4b9e-b9cd-3275c618a6a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:24.764139 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82ab3d3-6f90-4b9e-b9cd-3275c618a6a5 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:24.765152 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:24.769714 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:24.773310 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db42dc61-3abc-4d82-bb9f-ab50f595f652 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:24.777949 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 113/240] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Aug 18 10:49:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:24.779566 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82ab3d3-6f90-4b9e-b9cd-3275c618a6a5 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:24.815803 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff21154-8773-4793-a259-cb7b902386f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:24.817053 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff21154-8773-4793-a259-cb7b902386f0 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:24.817584 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff21154-8773-4793-a259-cb7b902386f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:24.818080 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff21154-8773-4793-a259-cb7b902386f0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:24.819435 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff21154-8773-4793-a259-cb7b902386f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:24.821102 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff21154-8773-4793-a259-cb7b902386f0 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:24.823769 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 128/241] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:49:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:24.830021 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc7c465-67f2-4619-9a91-6edf5d56ea10 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:24.830749 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc7c465-67f2-4619-9a91-6edf5d56ea10 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:24.831236 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc7c465-67f2-4619-9a91-6edf5d56ea10 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:24.832818 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 129/242] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:49:24 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:49:24.833906 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc7c465-67f2-4619-9a91-6edf5d56ea10 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:24.909642 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82ab3d3-6f90-4b9e-b9cd-3275c618a6a5 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:24.947869 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05434b1b-2728-42ad-aa3f-1fca9284e46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:24.949066 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05434b1b-2728-42ad-aa3f-1fca9284e46c None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:24.949485 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05434b1b-2728-42ad-aa3f-1fca9284e46c None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:24.949934 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05434b1b-2728-42ad-aa3f-1fca9284e46c None admin] PATH_INFO: `/v3/users/48f75318611b4f56a46a02b8f2a3d039` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:24.960955 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc7c465-67f2-4619-9a91-6edf5d56ea10 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:24.968370 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05434b1b-2728-42ad-aa3f-1fca9284e46c None admin] RBAC: Authorizing `identity:get_user(user_id=48f75318611b4f56a46a02b8f2a3d039)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:24.969903 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05434b1b-2728-42ad-aa3f-1fca9284e46c None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:24.971641 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 114/243] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Aug 18 10:49:24 2022] GET /identity/v3/users/48f75318611b4f56a46a02b8f2a3d039 => generated 297 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:24.972831 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ee0397-2b61-43e4-a0a8-b3607e585f4b None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:24.973142 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ee0397-2b61-43e4-a0a8-b3607e585f4b None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:24.973421 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ee0397-2b61-43e4-a0a8-b3607e585f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:24.992076 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-50ee0397-2b61-43e4-a0a8-b3607e585f4b None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:49:24.993313 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-50ee0397-2b61-43e4-a0a8-b3607e585f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:49:25.000936 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce60939-6998-4bff-b1d7-53df3e180ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:25.001574 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce60939-6998-4bff-b1d7-53df3e180ceb None admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:25.001855 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce60939-6998-4bff-b1d7-53df3e180ceb None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:25.002145 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce60939-6998-4bff-b1d7-53df3e180ceb None admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:25.002779 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce60939-6998-4bff-b1d7-53df3e180ceb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:25.004216 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce60939-6998-4bff-b1d7-53df3e180ceb None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:25.026868 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 130/244] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Aug 18 10:49:24 2022] POST /identity/v3/users => generated 293 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 10:49:25.028548 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14392429-80e1-4ae5-baf7-ce5bacad60cb None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:25.029093 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14392429-80e1-4ae5-baf7-ce5bacad60cb None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:25.029093 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14392429-80e1-4ae5-baf7-ce5bacad60cb None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:25.030709 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 131/245] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:49:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:49:25.031481 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14392429-80e1-4ae5-baf7-ce5bacad60cb None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:25.061093 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:25.073464 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:25.095306 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 115/246] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:49:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 10:49:25.097111 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef65ea-a4d8-4439-be93-884bd6ae85d2 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:25.097663 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef65ea-a4d8-4439-be93-884bd6ae85d2 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:25.098136 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef65ea-a4d8-4439-be93-884bd6ae85d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:25.121385 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-deef65ea-a4d8-4439-be93-884bd6ae85d2 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:49:25.123732 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-deef65ea-a4d8-4439-be93-884bd6ae85d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:49:25.209535 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14392429-80e1-4ae5-baf7-ce5bacad60cb None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:25.210687 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 116/247] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:49:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 10:49:25.254850 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447877ac-1861-45ec-9e91-631737841c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:25.255385 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447877ac-1861-45ec-9e91-631737841c87 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:25.255661 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447877ac-1861-45ec-9e91-631737841c87 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:25.255932 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447877ac-1861-45ec-9e91-631737841c87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:25.329216 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447877ac-1861-45ec-9e91-631737841c87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:25.330715 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447877ac-1861-45ec-9e91-631737841c87 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:25.355663 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:25.435850 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 132/248] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 18 10:49:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 10:49:25.441859 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deef65ea-a4d8-4439-be93-884bd6ae85d2 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:25.464613 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447877ac-1861-45ec-9e91-631737841c87 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:25.580843 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deef65ea-a4d8-4439-be93-884bd6ae85d2 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:25.606190 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:25.608374 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447877ac-1861-45ec-9e91-631737841c87 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:25.631092 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5bafe1-58cc-438e-bd36-6939fdd400e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:25.631746 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5bafe1-58cc-438e-bd36-6939fdd400e5 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:25.632023 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5bafe1-58cc-438e-bd36-6939fdd400e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:25.633232 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5bafe1-58cc-438e-bd36-6939fdd400e5 None admin] PATH_INFO: `/v3/projects/40e4bf42973a49f182b6ddf70bcb3bdf` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:25.635119 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5bafe1-58cc-438e-bd36-6939fdd400e5 None admin] RBAC: Authorizing `identity:get_project(project_id=40e4bf42973a49f182b6ddf70bcb3bdf)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:25.636586 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5bafe1-58cc-438e-bd36-6939fdd400e5 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:25.638301 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 117/249] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 18 10:49:25 2022] GET /identity/v3/projects/40e4bf42973a49f182b6ddf70bcb3bdf => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:25.639153 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5bafe1-58cc-438e-bd36-6939fdd400e5 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:25.641305 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:25.656903 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f27f6e8-da3f-4d78-9f28-5cde42969c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:25.657557 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f27f6e8-da3f-4d78-9f28-5cde42969c78 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:25.657843 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f27f6e8-da3f-4d78-9f28-5cde42969c78 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:25.658122 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f27f6e8-da3f-4d78-9f28-5cde42969c78 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:25.670909 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f27f6e8-da3f-4d78-9f28-5cde42969c78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:49:25.675682 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-2f27f6e8-da3f-4d78-9f28-5cde42969c78 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 10:49:25.675682 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:49:25.675682 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:49:25.675682 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:49:25.675682 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:49:25.675682 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:49:25.675682 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:49:25.675682 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:49:25.675682 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:49:25.675682 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:49:25.675682 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:49:25.675682 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:49:25.675682 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:49:25.675682 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:49:25.675682 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:49:25.675682 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:49:25.676738 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:49:25.676738 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:49:25.676738 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:49:25.676738 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:49:25.676738 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:49:25.676738 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:49:25.676738 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:49:25.676738 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:49:25.676738 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:49:25.676738 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:49:25.676738 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:49:25.676738 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:49:25.676738 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:49:25.676738 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:49:25.676738 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:49:25.676738 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:49:25.677614 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:49:25.677614 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:49:25.677614 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:49:25.677614 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:49:25.677614 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:49:25.677614 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:49:25.677614 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:49:25.677614 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:49:25.677614 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:49:25.677614 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:49:25.677614 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 10:49:25.677614 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:49:25.677614 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 133/250] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Aug 18 10:49:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 10:49:25.678319 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f27f6e8-da3f-4d78-9f28-5cde42969c78 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:25.780430 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5bafe1-58cc-438e-bd36-6939fdd400e5 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:25.799423 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f27f6e8-da3f-4d78-9f28-5cde42969c78 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:25.827654 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50d2493-19f2-4aad-8f6e-8f89b4f9bf4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:25.828291 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d2493-19f2-4aad-8f6e-8f89b4f9bf4a None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:25.828573 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d2493-19f2-4aad-8f6e-8f89b4f9bf4a None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:25.828844 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d2493-19f2-4aad-8f6e-8f89b4f9bf4a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:25.846124 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50d2493-19f2-4aad-8f6e-8f89b4f9bf4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:49:25.848817 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2880cb4-530a-4c8d-a86b-8981947524b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:25.849882 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2880cb4-530a-4c8d-a86b-8981947524b1 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:25.850170 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2880cb4-530a-4c8d-a86b-8981947524b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:25.850446 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2880cb4-530a-4c8d-a86b-8981947524b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:25.851189 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2880cb4-530a-4c8d-a86b-8981947524b1 None admin] RBAC: Adding query filter params (role.id=fcb5eb4c33b24ac9904230e57dec7ec9, scope.project.id=40e4bf42973a49f182b6ddf70bcb3bdf, user.id=48f75318611b4f56a46a02b8f2a3d039) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:49:25.851502 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2880cb4-530a-4c8d-a86b-8981947524b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:25.853566 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2880cb4-530a-4c8d-a86b-8981947524b1 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:25.854012 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-b50d2493-19f2-4aad-8f6e-8f89b4f9bf4a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 10:49:25.854012 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:49:25.854012 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:49:25.854012 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:49:25.854012 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:49:25.854012 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:49:25.854012 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:49:25.854012 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:49:25.854012 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:49:25.854012 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:49:25.854012 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:49:25.854012 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:49:25.854012 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:49:25.854012 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:49:25.854012 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:49:25.854012 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:49:25.854871 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:49:25.854871 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:49:25.854871 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:49:25.854871 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:49:25.854871 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:49:25.854871 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:49:25.854871 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:49:25.854871 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:49:25.854871 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:49:25.854871 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:49:25.854871 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:49:25.854871 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:49:25.854871 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:49:25.854871 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:49:25.854871 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:49:25.854871 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:49:25.855661 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:49:25.855661 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:49:25.855661 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:49:25.855661 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:49:25.855661 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:49:25.855661 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:49:25.855661 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:49:25.855661 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:49:25.855661 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:49:25.855661 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:49:25.855661 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 10:49:25.855661 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:49:25.858098 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 118/251] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 18 10:49:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:49:25.859780 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50d2493-19f2-4aad-8f6e-8f89b4f9bf4a None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:25.865549 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 134/252] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Aug 18 10:49:25 2022] GET /identity/v3/role_assignments?user.id=48f75318611b4f56a46a02b8f2a3d039&scope.project.id=40e4bf42973a49f182b6ddf70bcb3bdf&role.id=fcb5eb4c33b24ac9904230e57dec7ec9 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:25.865549 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2880cb4-530a-4c8d-a86b-8981947524b1 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:25.924305 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:25.989228 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:25.997458 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2880cb4-530a-4c8d-a86b-8981947524b1 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:26.039463 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1d9853-fe38-45f3-b222-30536f9f049e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:26.040884 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d9853-fe38-45f3-b222-30536f9f049e None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:26.041509 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d9853-fe38-45f3-b222-30536f9f049e None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:26.041509 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d9853-fe38-45f3-b222-30536f9f049e None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:26.042054 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1d9853-fe38-45f3-b222-30536f9f049e None admin] RBAC: Adding query filter params (name=member) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:49:26.042355 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1d9853-fe38-45f3-b222-30536f9f049e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:26.043731 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1d9853-fe38-45f3-b222-30536f9f049e None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:26.055304 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 135/253] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Aug 18 10:49:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:26.063719 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1d9853-fe38-45f3-b222-30536f9f049e None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:26.113507 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50d2493-19f2-4aad-8f6e-8f89b4f9bf4a None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:26.163655 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daa12bc-10b2-4d68-9f4a-e314b60bc357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:26.164620 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa12bc-10b2-4d68-9f4a-e314b60bc357 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:26.165945 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa12bc-10b2-4d68-9f4a-e314b60bc357 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:26.166930 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa12bc-10b2-4d68-9f4a-e314b60bc357 None admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:26.167809 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daa12bc-10b2-4d68-9f4a-e314b60bc357 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:49:26.171174 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daa12bc-10b2-4d68-9f4a-e314b60bc357 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:26.172844 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daa12bc-10b2-4d68-9f4a-e314b60bc357 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:26.186398 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 119/254] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 18 10:49:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:26.188058 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d308d9-4137-43b1-8984-7245265c365d None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:26.188636 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d308d9-4137-43b1-8984-7245265c365d None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:26.189109 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d308d9-4137-43b1-8984-7245265c365d None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:26.190567 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 120/255] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:49:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:49:26.196310 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe14e54c-962e-4bc8-89d5-0f420b4d21fc None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:26.196896 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe14e54c-962e-4bc8-89d5-0f420b4d21fc None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:26.197380 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe14e54c-962e-4bc8-89d5-0f420b4d21fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:26.235574 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-fe14e54c-962e-4bc8-89d5-0f420b4d21fc None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:49:26.237116 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-fe14e54c-962e-4bc8-89d5-0f420b4d21fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:49:26.270196 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1d9853-fe38-45f3-b222-30536f9f049e None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:26.284517 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:26.332793 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca87dd7-9848-43b9-aa7e-c4930ac8a773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:26.334878 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca87dd7-9848-43b9-aa7e-c4930ac8a773 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:26.335391 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca87dd7-9848-43b9-aa7e-c4930ac8a773 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:26.336627 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca87dd7-9848-43b9-aa7e-c4930ac8a773 None admin] PATH_INFO: `/v3/users/8711340fbde440328dde2518bab45208` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:26.338767 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca87dd7-9848-43b9-aa7e-c4930ac8a773 None admin] RBAC: Authorizing `identity:get_user(user_id=8711340fbde440328dde2518bab45208)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:26.340589 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca87dd7-9848-43b9-aa7e-c4930ac8a773 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:26.344621 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 136/256] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Aug 18 10:49:26 2022] GET /identity/v3/users/8711340fbde440328dde2518bab45208 => generated 297 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:26.346298 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca87dd7-9848-43b9-aa7e-c4930ac8a773 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:26.362949 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 121/257] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:49:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 10:49:26.364158 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe14e54c-962e-4bc8-89d5-0f420b4d21fc None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:26.441866 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:26.493992 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca87dd7-9848-43b9-aa7e-c4930ac8a773 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:26.536172 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c21ece-c613-481c-ad29-3ef58060ef8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:26.536986 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c21ece-c613-481c-ad29-3ef58060ef8f None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:26.538196 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c21ece-c613-481c-ad29-3ef58060ef8f None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:26.542002 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c21ece-c613-481c-ad29-3ef58060ef8f None admin] PATH_INFO: `/v3/users/5349daa9fb444c1f8bda15436e7aee57` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:26.543838 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c21ece-c613-481c-ad29-3ef58060ef8f None admin] RBAC: Authorizing `identity:get_user(user_id=5349daa9fb444c1f8bda15436e7aee57)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:26.545321 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c21ece-c613-481c-ad29-3ef58060ef8f None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:26.549896 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 137/258] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Aug 18 10:49:26 2022] GET /identity/v3/users/5349daa9fb444c1f8bda15436e7aee57 => generated 283 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:26.558612 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c21ece-c613-481c-ad29-3ef58060ef8f None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:26.582635 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe14e54c-962e-4bc8-89d5-0f420b4d21fc None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:26.624102 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:26.667160 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec75f6c-c07a-4d89-b81f-1d932133b9a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:26.668050 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec75f6c-c07a-4d89-b81f-1d932133b9a7 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:26.668472 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec75f6c-c07a-4d89-b81f-1d932133b9a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:26.668903 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec75f6c-c07a-4d89-b81f-1d932133b9a7 None admin] PATH_INFO: `/v3/projects/40e4bf42973a49f182b6ddf70bcb3bdf` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:26.674239 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec75f6c-c07a-4d89-b81f-1d932133b9a7 None admin] RBAC: Authorizing `identity:get_project(project_id=40e4bf42973a49f182b6ddf70bcb3bdf)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:26.675873 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec75f6c-c07a-4d89-b81f-1d932133b9a7 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:26.677741 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 122/259] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 18 10:49:26 2022] GET /identity/v3/projects/40e4bf42973a49f182b6ddf70bcb3bdf => generated 302 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:26.682330 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c21ece-c613-481c-ad29-3ef58060ef8f None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:26.683477 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec75f6c-c07a-4d89-b81f-1d932133b9a7 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:26.717831 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7ebc2c-f8b1-4645-918a-0390cefb2b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:26.718615 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7ebc2c-f8b1-4645-918a-0390cefb2b6f None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:26.719039 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7ebc2c-f8b1-4645-918a-0390cefb2b6f None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:26.719404 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7ebc2c-f8b1-4645-918a-0390cefb2b6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:26.837723 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7ebc2c-f8b1-4645-918a-0390cefb2b6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:26.839409 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7ebc2c-f8b1-4645-918a-0390cefb2b6f None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:26.845595 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec75f6c-c07a-4d89-b81f-1d932133b9a7 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:26.864932 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:26.917451 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14e4250-51f5-4b8e-8ec9-df850febe0c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:26.918059 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e4250-51f5-4b8e-8ec9-df850febe0c7 None admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:26.918334 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e4250-51f5-4b8e-8ec9-df850febe0c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:26.918599 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e4250-51f5-4b8e-8ec9-df850febe0c7 None admin] PATH_INFO: `/v3/projects/40e4bf42973a49f182b6ddf70bcb3bdf/users/8711340fbde440328dde2518bab45208/roles/719e5c62188d4f8a838987d6e72ca8f7` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:26.922696 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14e4250-51f5-4b8e-8ec9-df850febe0c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=40e4bf42973a49f182b6ddf70bcb3bdf, user_id=8711340fbde440328dde2518bab45208, role_id=719e5c62188d4f8a838987d6e72ca8f7)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:26.924145 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14e4250-51f5-4b8e-8ec9-df850febe0c7 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:26.930258 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:26.947220 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 123/260] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Aug 18 10:49:26 2022] PUT /identity/v3/projects/40e4bf42973a49f182b6ddf70bcb3bdf/users/8711340fbde440328dde2518bab45208/roles/719e5c62188d4f8a838987d6e72ca8f7 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 10:49:26.948054 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14e4250-51f5-4b8e-8ec9-df850febe0c7 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:27.020823 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 138/261] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 18 10:49:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 10:49:27.027697 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7ebc2c-f8b1-4645-918a-0390cefb2b6f None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:27.179905 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14e4250-51f5-4b8e-8ec9-df850febe0c7 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:27.211168 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7ebc2c-f8b1-4645-918a-0390cefb2b6f None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:27.236638 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49c6e20-abe9-4c2c-a863-67468d86c604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:27.237708 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c6e20-abe9-4c2c-a863-67468d86c604 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:27.238392 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c6e20-abe9-4c2c-a863-67468d86c604 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:27.238864 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c6e20-abe9-4c2c-a863-67468d86c604 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:27.261792 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49c6e20-abe9-4c2c-a863-67468d86c604 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:49:27.267828 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-f49c6e20-abe9-4c2c-a863-67468d86c604 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 10:49:27.267828 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:49:27.267828 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:49:27.267828 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:49:27.267828 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:49:27.267828 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:49:27.267828 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:49:27.267828 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:49:27.267828 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:49:27.267828 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:49:27.267828 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:49:27.267828 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:49:27.267828 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:49:27.267828 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:49:27.267828 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:49:27.267828 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:49:27.268760 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:49:27.268760 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:49:27.268760 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:49:27.268760 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:49:27.268760 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:49:27.268760 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:49:27.268760 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:49:27.268760 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:49:27.268760 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:49:27.268760 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:49:27.268760 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:49:27.268760 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:49:27.268760 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:49:27.268760 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:49:27.268760 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:49:27.268760 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:49:27.269579 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:49:27.269579 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:49:27.269579 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:49:27.269579 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:49:27.269579 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:49:27.269579 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:49:27.269579 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:49:27.269579 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:49:27.269579 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:49:27.269579 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:49:27.269579 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 10:49:27.269579 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:49:27.271964 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 124/262] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Aug 18 10:49:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:49:27.278317 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49c6e20-abe9-4c2c-a863-67468d86c604 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:27.312050 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4d35b1-32e3-4530-bb40-2577edd974c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:27.313047 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d35b1-32e3-4530-bb40-2577edd974c5 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:27.313552 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d35b1-32e3-4530-bb40-2577edd974c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:27.314059 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d35b1-32e3-4530-bb40-2577edd974c5 None admin] PATH_INFO: `/v3/projects/40e4bf42973a49f182b6ddf70bcb3bdf` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:27.316646 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4d35b1-32e3-4530-bb40-2577edd974c5 None admin] RBAC: Authorizing `identity:get_project(project_id=40e4bf42973a49f182b6ddf70bcb3bdf)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:27.318420 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4d35b1-32e3-4530-bb40-2577edd974c5 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:27.322734 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 139/263] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 18 10:49:27 2022] GET /identity/v3/projects/40e4bf42973a49f182b6ddf70bcb3bdf => generated 302 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 10:49:27.328406 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:27.338693 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4d35b1-32e3-4530-bb40-2577edd974c5 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:27.354528 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:27.493619 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49c6e20-abe9-4c2c-a863-67468d86c604 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:27.521348 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4d35b1-32e3-4530-bb40-2577edd974c5 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:27.568051 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1d0702-c282-4721-ae96-0ce757a6db29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:27.568673 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1d0702-c282-4721-ae96-0ce757a6db29 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:27.568957 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1d0702-c282-4721-ae96-0ce757a6db29 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:27.569226 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1d0702-c282-4721-ae96-0ce757a6db29 None admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:27.569923 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1d0702-c282-4721-ae96-0ce757a6db29 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:49:27.570226 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1d0702-c282-4721-ae96-0ce757a6db29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:27.572145 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1d0702-c282-4721-ae96-0ce757a6db29 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:27.591983 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 125/264] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 18 10:49:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 10:49:27.598186 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1d0702-c282-4721-ae96-0ce757a6db29 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:27.600031 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b1b377-1b98-46d4-b149-8f846e0698ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:27.600648 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b1b377-1b98-46d4-b149-8f846e0698ea None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:27.600926 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b1b377-1b98-46d4-b149-8f846e0698ea None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:27.601198 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b1b377-1b98-46d4-b149-8f846e0698ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:27.601967 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b1b377-1b98-46d4-b149-8f846e0698ea None admin] RBAC: Adding query filter params (role.id=127fdc7ef05b4e0b98a940b334e5fcab, scope.project.id=40e4bf42973a49f182b6ddf70bcb3bdf, user.id=5349daa9fb444c1f8bda15436e7aee57) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:49:27.602280 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b1b377-1b98-46d4-b149-8f846e0698ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:27.604454 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b1b377-1b98-46d4-b149-8f846e0698ea None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:27.611279 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 140/265] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Aug 18 10:49:27 2022] GET /identity/v3/role_assignments?user.id=5349daa9fb444c1f8bda15436e7aee57&scope.project.id=40e4bf42973a49f182b6ddf70bcb3bdf&role.id=127fdc7ef05b4e0b98a940b334e5fcab => generated 608 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 10:49:27.722748 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:27.747892 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1d0702-c282-4721-ae96-0ce757a6db29 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:27.807009 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde4c0eb-c7bf-4c98-92fa-427cbbe2220e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:27.807685 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde4c0eb-c7bf-4c98-92fa-427cbbe2220e None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:27.807962 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde4c0eb-c7bf-4c98-92fa-427cbbe2220e None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:27.808239 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde4c0eb-c7bf-4c98-92fa-427cbbe2220e None admin] PATH_INFO: `/v3/users/5349daa9fb444c1f8bda15436e7aee57` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:27.809625 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde4c0eb-c7bf-4c98-92fa-427cbbe2220e None admin] RBAC: Authorizing `identity:get_user(user_id=5349daa9fb444c1f8bda15436e7aee57)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:27.811284 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde4c0eb-c7bf-4c98-92fa-427cbbe2220e None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:27.813376 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 126/266] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Aug 18 10:49:27 2022] GET /identity/v3/users/5349daa9fb444c1f8bda15436e7aee57 => generated 283 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:27.819225 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b1b377-1b98-46d4-b149-8f846e0698ea None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:27.912956 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3487583f-427b-48e1-8c73-84899670dc5c None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:27.913294 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3487583f-427b-48e1-8c73-84899670dc5c None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:27.913536 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3487583f-427b-48e1-8c73-84899670dc5c None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:27.915574 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 127/267] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:49:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:49:27.920915 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b6d64c-ab87-48c3-a594-345a7836ffec None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:27.921259 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b6d64c-ab87-48c3-a594-345a7836ffec None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:27.921561 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b6d64c-ab87-48c3-a594-345a7836ffec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:27.937889 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:27.970774 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-02b6d64c-ab87-48c3-a594-345a7836ffec None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:49:27.971986 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-02b6d64c-ab87-48c3-a594-345a7836ffec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:49:27.975913 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b1b377-1b98-46d4-b149-8f846e0698ea None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:28.043295 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f7ecd5-ee76-4eee-a1f7-f5bdc8b6dc55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:28.043890 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f7ecd5-ee76-4eee-a1f7-f5bdc8b6dc55 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:28.044115 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f7ecd5-ee76-4eee-a1f7-f5bdc8b6dc55 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:28.044360 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f7ecd5-ee76-4eee-a1f7-f5bdc8b6dc55 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:28.133260 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 128/268] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:49:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 10:49:28.176934 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f7ecd5-ee76-4eee-a1f7-f5bdc8b6dc55 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:28.178802 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f7ecd5-ee76-4eee-a1f7-f5bdc8b6dc55 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:28.303736 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:28.330298 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 141/269] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 18 10:49:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 10:49:28.336392 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b6d64c-ab87-48c3-a594-345a7836ffec None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:28.433264 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:28.449819 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b6d64c-ab87-48c3-a594-345a7836ffec None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:28.485912 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f7ecd5-ee76-4eee-a1f7-f5bdc8b6dc55 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:28.507927 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd513dd-e1e5-40ac-a8da-3f6726cc517b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:28.508599 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd513dd-e1e5-40ac-a8da-3f6726cc517b None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:28.508880 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd513dd-e1e5-40ac-a8da-3f6726cc517b None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:28.509152 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd513dd-e1e5-40ac-a8da-3f6726cc517b None admin] PATH_INFO: `/v3/projects/40e4bf42973a49f182b6ddf70bcb3bdf` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:28.511166 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd513dd-e1e5-40ac-a8da-3f6726cc517b None admin] RBAC: Authorizing `identity:get_project(project_id=40e4bf42973a49f182b6ddf70bcb3bdf)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:28.512617 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd513dd-e1e5-40ac-a8da-3f6726cc517b None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:28.516855 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 129/270] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 18 10:49:28 2022] GET /identity/v3/projects/40e4bf42973a49f182b6ddf70bcb3bdf => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:28.522736 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd513dd-e1e5-40ac-a8da-3f6726cc517b None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:28.620379 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f7ecd5-ee76-4eee-a1f7-f5bdc8b6dc55 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:28.661846 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd513dd-e1e5-40ac-a8da-3f6726cc517b None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:28.663945 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033f2c9c-3d12-49de-b980-45c5634fd059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:28.665726 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f2c9c-3d12-49de-b980-45c5634fd059 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:28.666043 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f2c9c-3d12-49de-b980-45c5634fd059 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:28.666314 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f2c9c-3d12-49de-b980-45c5634fd059 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:28.681818 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033f2c9c-3d12-49de-b980-45c5634fd059 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:49:28.686626 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-033f2c9c-3d12-49de-b980-45c5634fd059 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 10:49:28.686626 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:49:28.686626 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:49:28.686626 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:49:28.686626 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:49:28.686626 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:49:28.686626 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:49:28.686626 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:49:28.686626 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:49:28.686626 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:49:28.686626 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:49:28.686626 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:49:28.686626 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:49:28.686626 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:49:28.686626 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:49:28.686626 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:49:28.687536 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:49:28.687536 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:49:28.687536 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:49:28.687536 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:49:28.687536 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:49:28.687536 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:49:28.687536 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:49:28.687536 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:49:28.687536 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:49:28.687536 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:49:28.687536 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:49:28.687536 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:49:28.687536 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:49:28.687536 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:49:28.687536 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:49:28.687536 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:49:28.688537 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:49:28.688537 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:49:28.688537 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:49:28.688537 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:49:28.688537 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:49:28.688537 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:49:28.688537 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:49:28.688537 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:49:28.688537 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:49:28.688537 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:49:28.688537 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 10:49:28.688537 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:49:28.688537 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 142/271] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 18 10:49:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:49:28.694022 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8634349d-58c1-448b-a301-cef5b1ef2124 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:28.694400 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8634349d-58c1-448b-a301-cef5b1ef2124 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:28.694637 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8634349d-58c1-448b-a301-cef5b1ef2124 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:28.696239 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 143/272] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:49:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:49:28.705961 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c24202-a1db-4e91-a1b6-0884d3fd6de4 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:28.705961 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c24202-a1db-4e91-a1b6-0884d3fd6de4 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:28.705961 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c24202-a1db-4e91-a1b6-0884d3fd6de4 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:28.705961 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 144/273] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:49:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:49:28.705961 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c24202-a1db-4e91-a1b6-0884d3fd6de4 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:28.718526 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a3e6f1-7a83-438b-8e7c-95672f5530b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:28.719143 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a3e6f1-7a83-438b-8e7c-95672f5530b5 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:28.719422 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a3e6f1-7a83-438b-8e7c-95672f5530b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:28.719690 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a3e6f1-7a83-438b-8e7c-95672f5530b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:28.720422 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a3e6f1-7a83-438b-8e7c-95672f5530b5 None admin] RBAC: Adding query filter params (role.id=0ecb6b324fc643f3826b2878f2f6174b, scope.project.id=40e4bf42973a49f182b6ddf70bcb3bdf, user.id=5349daa9fb444c1f8bda15436e7aee57) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:49:28.720728 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a3e6f1-7a83-438b-8e7c-95672f5530b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:28.722199 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a3e6f1-7a83-438b-8e7c-95672f5530b5 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:28.737546 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 130/274] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Aug 18 10:49:28 2022] GET /identity/v3/role_assignments?user.id=5349daa9fb444c1f8bda15436e7aee57&scope.project.id=40e4bf42973a49f182b6ddf70bcb3bdf&role.id=0ecb6b324fc643f3826b2878f2f6174b => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:28.737546 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c626c9-a189-4be9-8b9c-5a458deabf04 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:28.737546 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c626c9-a189-4be9-8b9c-5a458deabf04 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:28.737546 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c626c9-a189-4be9-8b9c-5a458deabf04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:28.750098 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-98c626c9-a189-4be9-8b9c-5a458deabf04 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:49:28.750830 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:28.751530 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-98c626c9-a189-4be9-8b9c-5a458deabf04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:49:28.767821 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:28.835232 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 131/275] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:49:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 10:49:28.842685 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6334e0c-3d9d-4dac-bf86-c6a450f4f9cc None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:28.843099 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6334e0c-3d9d-4dac-bf86-c6a450f4f9cc None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:28.843471 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6334e0c-3d9d-4dac-bf86-c6a450f4f9cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:28.847755 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c24202-a1db-4e91-a1b6-0884d3fd6de4 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:28.886753 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-b6334e0c-3d9d-4dac-bf86-c6a450f4f9cc None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:49:28.888032 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-b6334e0c-3d9d-4dac-bf86-c6a450f4f9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:49:28.895934 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea013eb9-49af-4346-8869-166e48ca40a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:28.896866 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea013eb9-49af-4346-8869-166e48ca40a0 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:28.897656 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea013eb9-49af-4346-8869-166e48ca40a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:28.898153 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea013eb9-49af-4346-8869-166e48ca40a0 None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:28.899067 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea013eb9-49af-4346-8869-166e48ca40a0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:49:28.899977 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea013eb9-49af-4346-8869-166e48ca40a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:28.901482 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea013eb9-49af-4346-8869-166e48ca40a0 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:28.911252 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 145/276] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Aug 18 10:49:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:28.917369 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea013eb9-49af-4346-8869-166e48ca40a0 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:28.991134 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 132/277] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:49:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 10:49:29.053933 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:29.057610 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea013eb9-49af-4346-8869-166e48ca40a0 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:29.093409 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60ece79-01d3-448f-962e-9710362ff01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:29.094071 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ece79-01d3-448f-962e-9710362ff01b None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:29.094346 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ece79-01d3-448f-962e-9710362ff01b None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:29.094621 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ece79-01d3-448f-962e-9710362ff01b None admin] PATH_INFO: `/v3/users/42bb4b6c894e4d3f8e29eda6b88ff361` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:29.109749 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60ece79-01d3-448f-962e-9710362ff01b None admin] RBAC: Authorizing `identity:get_user(user_id=42bb4b6c894e4d3f8e29eda6b88ff361)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:29.111276 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60ece79-01d3-448f-962e-9710362ff01b None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:29.113251 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 146/278] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Aug 18 10:49:28 2022] GET /identity/v3/users/42bb4b6c894e4d3f8e29eda6b88ff361 => generated 293 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:29.119561 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6334e0c-3d9d-4dac-bf86-c6a450f4f9cc None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:29.172722 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60ece79-01d3-448f-962e-9710362ff01b None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:29.216532 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:29.240804 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6334e0c-3d9d-4dac-bf86-c6a450f4f9cc None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:29.281542 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac2b715-d1e5-4530-b783-dadd1d1bacec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:29.282527 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac2b715-d1e5-4530-b783-dadd1d1bacec None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:29.283005 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac2b715-d1e5-4530-b783-dadd1d1bacec None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:29.283484 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac2b715-d1e5-4530-b783-dadd1d1bacec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:29.284176 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60ece79-01d3-448f-962e-9710362ff01b None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:29.284625 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac2b715-d1e5-4530-b783-dadd1d1bacec None admin] RBAC: Adding query filter params (role.id=719e5c62188d4f8a838987d6e72ca8f7, user.id=42bb4b6c894e4d3f8e29eda6b88ff361, scope.system=all) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:49:29.285142 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac2b715-d1e5-4530-b783-dadd1d1bacec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:29.287029 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac2b715-d1e5-4530-b783-dadd1d1bacec None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:29.292973 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 133/279] 10.222.0.15 () {56 vars in 1308 bytes} [Thu Aug 18 10:49:29 2022] GET /identity/v3/role_assignments?user.id=42bb4b6c894e4d3f8e29eda6b88ff361&scope.system=all&role.id=719e5c62188d4f8a838987d6e72ca8f7 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:29.300123 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac2b715-d1e5-4530-b783-dadd1d1bacec None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:29.324208 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51322ffa-daac-4293-b1c8-8770d3a402c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:29.324863 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51322ffa-daac-4293-b1c8-8770d3a402c1 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:29.325140 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51322ffa-daac-4293-b1c8-8770d3a402c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:29.325411 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51322ffa-daac-4293-b1c8-8770d3a402c1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:29.327187 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51322ffa-daac-4293-b1c8-8770d3a402c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:29.329068 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51322ffa-daac-4293-b1c8-8770d3a402c1 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:29.332175 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 147/280] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:49:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 10:49:29.338481 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51322ffa-daac-4293-b1c8-8770d3a402c1 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:29.390024 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:29.424142 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac2b715-d1e5-4530-b783-dadd1d1bacec None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:29.456068 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51322ffa-daac-4293-b1c8-8770d3a402c1 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:29.462862 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e0f6ea-135b-4609-aca8-6a1df044c67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:29.463489 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e0f6ea-135b-4609-aca8-6a1df044c67a None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:29.463765 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e0f6ea-135b-4609-aca8-6a1df044c67a None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:29.464034 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e0f6ea-135b-4609-aca8-6a1df044c67a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:29.475907 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e0f6ea-135b-4609-aca8-6a1df044c67a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:49:29.480969 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-53e0f6ea-135b-4609-aca8-6a1df044c67a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 10:49:29.480969 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:49:29.480969 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:49:29.480969 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:49:29.480969 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:49:29.480969 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:49:29.480969 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:49:29.480969 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:49:29.480969 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:49:29.480969 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:49:29.480969 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:49:29.480969 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:49:29.480969 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:49:29.480969 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:49:29.480969 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:49:29.480969 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:49:29.481871 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:49:29.481871 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:49:29.481871 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:49:29.481871 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:49:29.481871 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:49:29.481871 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:49:29.481871 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:49:29.481871 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:49:29.481871 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:49:29.481871 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:49:29.481871 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:49:29.481871 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:49:29.481871 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:49:29.481871 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:49:29.481871 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:49:29.481871 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:49:29.482658 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:49:29.482658 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:49:29.482658 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:49:29.482658 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:49:29.482658 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:49:29.482658 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:49:29.482658 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:49:29.482658 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:49:29.482658 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:49:29.482658 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:49:29.482658 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 10:49:29.482658 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:49:29.483255 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 134/281] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 18 10:49:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 10:49:29.488044 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e0f6ea-135b-4609-aca8-6a1df044c67a None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:29.491583 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:29.506187 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44619a3-6572-4021-bc1f-7d6ed6b04d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:29.507153 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44619a3-6572-4021-bc1f-7d6ed6b04d5b None admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:29.507621 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44619a3-6572-4021-bc1f-7d6ed6b04d5b None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:29.508082 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44619a3-6572-4021-bc1f-7d6ed6b04d5b None admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:29.509508 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44619a3-6572-4021-bc1f-7d6ed6b04d5b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:29.511186 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44619a3-6572-4021-bc1f-7d6ed6b04d5b None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:29.535228 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 148/282] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Aug 18 10:49:29 2022] POST /identity/v3/users => generated 293 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 10:49:29.587588 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0912bbf-042e-417d-b7b2-83244e164732 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:29.588425 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0912bbf-042e-417d-b7b2-83244e164732 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:29.589103 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0912bbf-042e-417d-b7b2-83244e164732 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:29.591089 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 149/283] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:49:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:49:29.597145 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadac64f-0d0b-4695-b737-6d594dae0921 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:29.597785 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadac64f-0d0b-4695-b737-6d594dae0921 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:29.598265 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadac64f-0d0b-4695-b737-6d594dae0921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:29.613234 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e0f6ea-135b-4609-aca8-6a1df044c67a None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:29.619683 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-dadac64f-0d0b-4695-b737-6d594dae0921 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:49:29.621380 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-dadac64f-0d0b-4695-b737-6d594dae0921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:49:29.655262 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40610ec5-b70b-41ea-b1ac-c64a3bbeb326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:29.655966 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40610ec5-b70b-41ea-b1ac-c64a3bbeb326 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:29.656248 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40610ec5-b70b-41ea-b1ac-c64a3bbeb326 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:29.656527 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40610ec5-b70b-41ea-b1ac-c64a3bbeb326 None admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:29.657215 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40610ec5-b70b-41ea-b1ac-c64a3bbeb326 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:49:29.657542 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40610ec5-b70b-41ea-b1ac-c64a3bbeb326 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:29.659133 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40610ec5-b70b-41ea-b1ac-c64a3bbeb326 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:29.669428 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 135/284] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Aug 18 10:49:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 10:49:29.675356 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40610ec5-b70b-41ea-b1ac-c64a3bbeb326 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:29.715389 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 150/285] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:49:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 10:49:29.796789 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:29.850713 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40610ec5-b70b-41ea-b1ac-c64a3bbeb326 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:29.888810 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee46a00-4270-4f87-9e51-43369711c824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:29.889444 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee46a00-4270-4f87-9e51-43369711c824 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:29.889748 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee46a00-4270-4f87-9e51-43369711c824 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:29.890017 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee46a00-4270-4f87-9e51-43369711c824 None admin] PATH_INFO: `/v3/users/48f75318611b4f56a46a02b8f2a3d039` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:29.891269 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee46a00-4270-4f87-9e51-43369711c824 None admin] RBAC: Authorizing `identity:get_user(user_id=48f75318611b4f56a46a02b8f2a3d039)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:29.892776 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee46a00-4270-4f87-9e51-43369711c824 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:29.894622 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 136/286] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Aug 18 10:49:29 2022] GET /identity/v3/users/48f75318611b4f56a46a02b8f2a3d039 => generated 297 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 10:49:29.901430 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadac64f-0d0b-4695-b737-6d594dae0921 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:29.921303 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:30.026007 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee46a00-4270-4f87-9e51-43369711c824 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:30.055667 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadac64f-0d0b-4695-b737-6d594dae0921 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:30.097362 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b04bd5-49e5-4693-ac08-e4bd8b91674e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:30.098748 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b04bd5-49e5-4693-ac08-e4bd8b91674e None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:30.099026 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b04bd5-49e5-4693-ac08-e4bd8b91674e None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:30.099294 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b04bd5-49e5-4693-ac08-e4bd8b91674e None admin] PATH_INFO: `/v3/projects/40e4bf42973a49f182b6ddf70bcb3bdf` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:30.100421 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b04bd5-49e5-4693-ac08-e4bd8b91674e None admin] RBAC: Authorizing `identity:get_project(project_id=40e4bf42973a49f182b6ddf70bcb3bdf)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:30.102532 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b04bd5-49e5-4693-ac08-e4bd8b91674e None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:30.107534 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 151/287] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 18 10:49:29 2022] GET /identity/v3/projects/40e4bf42973a49f182b6ddf70bcb3bdf => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:30.114289 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b04bd5-49e5-4693-ac08-e4bd8b91674e None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:30.221973 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:30.227693 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee46a00-4270-4f87-9e51-43369711c824 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:30.248275 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b04bd5-49e5-4693-ac08-e4bd8b91674e None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:30.270642 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:30.277952 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d2ba28-2637-41ee-b00a-d5574d257a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:30.279370 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d2ba28-2637-41ee-b00a-d5574d257a8e None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:30.279830 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d2ba28-2637-41ee-b00a-d5574d257a8e None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:30.280529 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d2ba28-2637-41ee-b00a-d5574d257a8e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:30.295932 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7198c777-06ab-4e7c-9dcd-86842186bd22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:30.296455 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d2ba28-2637-41ee-b00a-d5574d257a8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:49:30.296772 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198c777-06ab-4e7c-9dcd-86842186bd22 None admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:30.297125 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198c777-06ab-4e7c-9dcd-86842186bd22 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:30.297472 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198c777-06ab-4e7c-9dcd-86842186bd22 None admin] PATH_INFO: `/v3/projects/40e4bf42973a49f182b6ddf70bcb3bdf/users/48f75318611b4f56a46a02b8f2a3d039/roles/fcb5eb4c33b24ac9904230e57dec7ec9` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:30.299528 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7198c777-06ab-4e7c-9dcd-86842186bd22 None admin] RBAC: Authorizing `identity:create_grant(project_id=40e4bf42973a49f182b6ddf70bcb3bdf, user_id=48f75318611b4f56a46a02b8f2a3d039, role_id=fcb5eb4c33b24ac9904230e57dec7ec9)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:30.301027 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7198c777-06ab-4e7c-9dcd-86842186bd22 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:30.303089 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-e9d2ba28-2637-41ee-b00a-d5574d257a8e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 10:49:30.303089 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:49:30.303089 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:49:30.303089 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:49:30.303089 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:49:30.303089 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:49:30.303089 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:49:30.303089 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:49:30.303089 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:49:30.303089 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:49:30.303089 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:49:30.303089 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:49:30.303089 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:49:30.303089 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:49:30.303089 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:49:30.303089 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:49:30.303939 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:49:30.303939 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:49:30.303939 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:49:30.303939 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:49:30.303939 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:49:30.303939 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:49:30.303939 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:49:30.303939 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:49:30.303939 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:49:30.303939 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:49:30.303939 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:49:30.303939 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:49:30.303939 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:49:30.303939 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:49:30.303939 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:49:30.303939 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:49:30.304705 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:49:30.304705 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:49:30.304705 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:49:30.304705 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:49:30.304705 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:49:30.304705 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:49:30.304705 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:49:30.304705 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:49:30.304705 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:49:30.304705 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:49:30.304705 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 10:49:30.304705 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:49:30.308570 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 137/288] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 18 10:49:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 10:49:30.314818 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d2ba28-2637-41ee-b00a-d5574d257a8e None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:30.330309 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 152/289] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Aug 18 10:49:30 2022] PUT /identity/v3/projects/40e4bf42973a49f182b6ddf70bcb3bdf/users/48f75318611b4f56a46a02b8f2a3d039/roles/fcb5eb4c33b24ac9904230e57dec7ec9 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 10:49:30.436376 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d2ba28-2637-41ee-b00a-d5574d257a8e None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:30.478479 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f125d494-f97c-4010-80fd-11126cbc60aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:30.479420 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f125d494-f97c-4010-80fd-11126cbc60aa None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:30.479871 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f125d494-f97c-4010-80fd-11126cbc60aa None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:30.480279 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f125d494-f97c-4010-80fd-11126cbc60aa None admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:30.481105 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f125d494-f97c-4010-80fd-11126cbc60aa None admin] RBAC: Adding query filter params (name=member) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:49:30.481575 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f125d494-f97c-4010-80fd-11126cbc60aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:30.483163 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f125d494-f97c-4010-80fd-11126cbc60aa None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:30.493824 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 138/290] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Aug 18 10:49:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 10:49:30.499731 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7198c777-06ab-4e7c-9dcd-86842186bd22 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:30.615678 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7198c777-06ab-4e7c-9dcd-86842186bd22 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:30.654660 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c139ad-790b-4ee9-8a6e-d7711e4181b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:30.655535 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c139ad-790b-4ee9-8a6e-d7711e4181b3 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:30.655975 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c139ad-790b-4ee9-8a6e-d7711e4181b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:30.656384 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c139ad-790b-4ee9-8a6e-d7711e4181b3 None admin] PATH_INFO: `/v3/users/8711340fbde440328dde2518bab45208` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:30.657680 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c139ad-790b-4ee9-8a6e-d7711e4181b3 None admin] RBAC: Authorizing `identity:get_user(user_id=8711340fbde440328dde2518bab45208)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:30.659248 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c139ad-790b-4ee9-8a6e-d7711e4181b3 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:30.660965 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 153/291] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Aug 18 10:49:30 2022] GET /identity/v3/users/8711340fbde440328dde2518bab45208 => generated 297 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:30.667266 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f125d494-f97c-4010-80fd-11126cbc60aa None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:30.730122 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:30.778154 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f125d494-f97c-4010-80fd-11126cbc60aa None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:30.814486 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316de593-b87b-4d2b-9911-24244b510a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:30.815395 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316de593-b87b-4d2b-9911-24244b510a61 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:30.815845 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316de593-b87b-4d2b-9911-24244b510a61 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:30.816256 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316de593-b87b-4d2b-9911-24244b510a61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:30.889600 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316de593-b87b-4d2b-9911-24244b510a61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:30.891295 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316de593-b87b-4d2b-9911-24244b510a61 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:30.949404 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:30.996341 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 139/292] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 18 10:49:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 10:49:31.002075 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c139ad-790b-4ee9-8a6e-d7711e4181b3 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:31.012879 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:31.132423 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c139ad-790b-4ee9-8a6e-d7711e4181b3 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:31.179170 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282e9638-6191-430b-b17d-4d2ed6b0cd20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:31.179737 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282e9638-6191-430b-b17d-4d2ed6b0cd20 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:31.180011 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282e9638-6191-430b-b17d-4d2ed6b0cd20 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:31.180277 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282e9638-6191-430b-b17d-4d2ed6b0cd20 None admin] PATH_INFO: `/v3/projects/40e4bf42973a49f182b6ddf70bcb3bdf` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:31.181964 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282e9638-6191-430b-b17d-4d2ed6b0cd20 None admin] RBAC: Authorizing `identity:get_project(project_id=40e4bf42973a49f182b6ddf70bcb3bdf)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:31.183593 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282e9638-6191-430b-b17d-4d2ed6b0cd20 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:31.185255 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 154/293] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 18 10:49:31 2022] GET /identity/v3/projects/40e4bf42973a49f182b6ddf70bcb3bdf => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 10:49:31.191182 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316de593-b87b-4d2b-9911-24244b510a61 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:31.300103 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316de593-b87b-4d2b-9911-24244b510a61 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:31.335237 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16cf55f-6623-4268-a311-d15dc8ba6d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:31.335844 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16cf55f-6623-4268-a311-d15dc8ba6d78 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:31.336118 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16cf55f-6623-4268-a311-d15dc8ba6d78 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:31.336386 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16cf55f-6623-4268-a311-d15dc8ba6d78 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:31.338126 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16cf55f-6623-4268-a311-d15dc8ba6d78 None admin] RBAC: Adding query filter params (role.id=719e5c62188d4f8a838987d6e72ca8f7, scope.project.id=40e4bf42973a49f182b6ddf70bcb3bdf, user.id=8711340fbde440328dde2518bab45208) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:49:31.338126 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16cf55f-6623-4268-a311-d15dc8ba6d78 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:31.339516 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16cf55f-6623-4268-a311-d15dc8ba6d78 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:31.345831 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 140/294] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Aug 18 10:49:31 2022] GET /identity/v3/role_assignments?user.id=8711340fbde440328dde2518bab45208&scope.project.id=40e4bf42973a49f182b6ddf70bcb3bdf&role.id=719e5c62188d4f8a838987d6e72ca8f7 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:31.577460 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396eec40-b319-4b83-8792-5e60c72c916b None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:31.577850 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396eec40-b319-4b83-8792-5e60c72c916b None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:31.578032 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396eec40-b319-4b83-8792-5e60c72c916b None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:31.579515 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 155/295] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:49:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:49:31.584938 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4500af9-00ba-4a48-87e8-b893b3093764 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:31.585402 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4500af9-00ba-4a48-87e8-b893b3093764 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:31.585477 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4500af9-00ba-4a48-87e8-b893b3093764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:31.607889 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-c4500af9-00ba-4a48-87e8-b893b3093764 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:49:31.609178 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-c4500af9-00ba-4a48-87e8-b893b3093764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:49:31.624156 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:31.681766 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 141/296] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:49:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 10:49:32.002804 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396eec40-b319-4b83-8792-5e60c72c916b None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:32.087303 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:32.115899 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396eec40-b319-4b83-8792-5e60c72c916b None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:32.152359 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289df0da-13c5-4c22-9a73-c07de16fceeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:32.153129 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289df0da-13c5-4c22-9a73-c07de16fceeb None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:32.153285 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289df0da-13c5-4c22-9a73-c07de16fceeb None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:32.153508 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289df0da-13c5-4c22-9a73-c07de16fceeb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:32.164112 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289df0da-13c5-4c22-9a73-c07de16fceeb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:49:32.169759 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-289df0da-13c5-4c22-9a73-c07de16fceeb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 10:49:32.169759 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:49:32.169759 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:49:32.169759 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:49:32.169759 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:49:32.169759 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:49:32.169759 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:49:32.169759 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:49:32.169759 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:49:32.169759 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:49:32.169759 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:49:32.169759 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:49:32.169759 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:49:32.169759 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:49:32.169759 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:49:32.169759 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:49:32.172149 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:49:32.172149 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:49:32.172149 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:49:32.172149 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:49:32.172149 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:49:32.172149 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:49:32.172149 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:49:32.172149 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:49:32.172149 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:49:32.172149 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:49:32.172149 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:49:32.172149 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:49:32.172149 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:49:32.172149 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:49:32.172149 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:49:32.172149 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:49:32.174129 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:49:32.174129 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:49:32.174129 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:49:32.174129 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:49:32.174129 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:49:32.174129 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:49:32.174129 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:49:32.174129 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:49:32.174129 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:49:32.174129 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:49:32.174129 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 10:49:32.174129 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:49:32.174129 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 156/297] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 18 10:49:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:49:32.184640 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4500af9-00ba-4a48-87e8-b893b3093764 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:32.211193 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b6202a-4851-4322-85ba-edef54b26598 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:32.211483 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b6202a-4851-4322-85ba-edef54b26598 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:32.212330 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b6202a-4851-4322-85ba-edef54b26598 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:32.216570 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 157/298] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:49:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:49:32.219761 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93612267-bb53-4422-a292-b4125373a0e4 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:32.220051 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93612267-bb53-4422-a292-b4125373a0e4 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:32.220329 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93612267-bb53-4422-a292-b4125373a0e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:32.241459 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-93612267-bb53-4422-a292-b4125373a0e4 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:49:32.242696 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-93612267-bb53-4422-a292-b4125373a0e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:49:32.314408 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4500af9-00ba-4a48-87e8-b893b3093764 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:32.349608 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 158/299] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:49:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 10:49:32.362680 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcda7e7-8fca-4384-abb5-f8f994242879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:32.363610 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcda7e7-8fca-4384-abb5-f8f994242879 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:32.364134 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcda7e7-8fca-4384-abb5-f8f994242879 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:32.364608 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcda7e7-8fca-4384-abb5-f8f994242879 None admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:32.365473 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcda7e7-8fca-4384-abb5-f8f994242879 None admin] RBAC: Adding query filter params (name=member) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:49:32.366005 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcda7e7-8fca-4384-abb5-f8f994242879 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:32.367592 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcda7e7-8fca-4384-abb5-f8f994242879 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:32.378255 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 142/300] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Aug 18 10:49:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:32.385497 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93612267-bb53-4422-a292-b4125373a0e4 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:32.459686 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:32.475603 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f5ad7-515c-42a3-adea-b8426f630187 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:32.476215 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f5ad7-515c-42a3-adea-b8426f630187 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:32.476725 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f5ad7-515c-42a3-adea-b8426f630187 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:32.479288 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 143/301] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:49:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:49:32.486845 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b1d1d8-28f2-4300-ad6e-b1f8806bbc98 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:32.487377 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b1d1d8-28f2-4300-ad6e-b1f8806bbc98 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:32.487854 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b1d1d8-28f2-4300-ad6e-b1f8806bbc98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:32.505564 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93612267-bb53-4422-a292-b4125373a0e4 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:32.508029 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-a1b1d1d8-28f2-4300-ad6e-b1f8806bbc98 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:49:32.510732 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-a1b1d1d8-28f2-4300-ad6e-b1f8806bbc98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:49:32.514188 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:32.543966 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2007b8b7-8f1c-4201-825d-f46b24eee243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:32.544612 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007b8b7-8f1c-4201-825d-f46b24eee243 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:32.544892 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007b8b7-8f1c-4201-825d-f46b24eee243 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:32.545163 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007b8b7-8f1c-4201-825d-f46b24eee243 None admin] PATH_INFO: `/v3/users/42bb4b6c894e4d3f8e29eda6b88ff361` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:32.546381 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2007b8b7-8f1c-4201-825d-f46b24eee243 None admin] RBAC: Authorizing `identity:get_user(user_id=42bb4b6c894e4d3f8e29eda6b88ff361)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:32.547813 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2007b8b7-8f1c-4201-825d-f46b24eee243 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:32.549737 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 159/302] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Aug 18 10:49:32 2022] GET /identity/v3/users/42bb4b6c894e4d3f8e29eda6b88ff361 => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:32.554818 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2007b8b7-8f1c-4201-825d-f46b24eee243 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:32.606491 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 144/303] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:49:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 10:49:32.646210 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b1d1d8-28f2-4300-ad6e-b1f8806bbc98 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:32.672008 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2007b8b7-8f1c-4201-825d-f46b24eee243 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:32.704479 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:32.710396 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c585c68-f3de-4267-8da1-ed8b2c63d738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:32.711176 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c585c68-f3de-4267-8da1-ed8b2c63d738 None admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:32.712152 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c585c68-f3de-4267-8da1-ed8b2c63d738 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:32.712904 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c585c68-f3de-4267-8da1-ed8b2c63d738 None admin] PATH_INFO: `/v3/system/users/42bb4b6c894e4d3f8e29eda6b88ff361/roles/719e5c62188d4f8a838987d6e72ca8f7` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:32.714396 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c585c68-f3de-4267-8da1-ed8b2c63d738 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=42bb4b6c894e4d3f8e29eda6b88ff361, role_id=719e5c62188d4f8a838987d6e72ca8f7)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:32.715623 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c585c68-f3de-4267-8da1-ed8b2c63d738 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:32.726760 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 160/304] 10.222.0.15 () {58 vars in 1334 bytes} [Thu Aug 18 10:49:32 2022] PUT /identity/v3/system/users/42bb4b6c894e4d3f8e29eda6b88ff361/roles/719e5c62188d4f8a838987d6e72ca8f7 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 10:49:32.792771 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b1d1d8-28f2-4300-ad6e-b1f8806bbc98 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:32.836337 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e616b760-6c62-4236-991e-d2073f519327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:32.838156 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e616b760-6c62-4236-991e-d2073f519327 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:32.838346 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e616b760-6c62-4236-991e-d2073f519327 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:32.838597 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e616b760-6c62-4236-991e-d2073f519327 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:32.848001 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:32.852782 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e616b760-6c62-4236-991e-d2073f519327 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:49:32.858761 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-e616b760-6c62-4236-991e-d2073f519327 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 10:49:32.858761 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:49:32.858761 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:49:32.858761 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:49:32.858761 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:49:32.858761 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:49:32.858761 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:49:32.858761 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:49:32.858761 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:49:32.858761 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:49:32.858761 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:49:32.858761 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:49:32.858761 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:49:32.858761 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:49:32.858761 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:49:32.858761 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:49:32.859661 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:49:32.859661 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:49:32.859661 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:49:32.859661 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:49:32.859661 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:49:32.859661 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:49:32.859661 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:49:32.859661 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:49:32.859661 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:49:32.859661 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:49:32.859661 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:49:32.859661 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:49:32.859661 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:49:32.859661 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:49:32.859661 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:49:32.859661 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:49:32.860535 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:49:32.860535 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:49:32.860535 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:49:32.860535 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:49:32.860535 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:49:32.860535 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:49:32.860535 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:49:32.860535 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:49:32.860535 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:49:32.860535 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:49:32.860535 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 10:49:32.860535 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:49:32.860535 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 145/305] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 18 10:49:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:49:32.865681 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c585c68-f3de-4267-8da1-ed8b2c63d738 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:32.903042 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e616b760-6c62-4236-991e-d2073f519327 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:32.997381 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c585c68-f3de-4267-8da1-ed8b2c63d738 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:33.023093 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e616b760-6c62-4236-991e-d2073f519327 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:33.042208 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354c854a-615e-4af3-806a-9a7b8abf5c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:33.043417 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c854a-615e-4af3-806a-9a7b8abf5c05 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:33.043847 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c854a-615e-4af3-806a-9a7b8abf5c05 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:33.044374 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c854a-615e-4af3-806a-9a7b8abf5c05 None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:33.045343 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354c854a-615e-4af3-806a-9a7b8abf5c05 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:49:33.045979 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354c854a-615e-4af3-806a-9a7b8abf5c05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:33.047748 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354c854a-615e-4af3-806a-9a7b8abf5c05 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:33.058867 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 161/306] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Aug 18 10:49:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:33.060379 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a56733-d965-404b-a5ca-edbe60f81305 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:33.060696 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a56733-d965-404b-a5ca-edbe60f81305 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:33.060944 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a56733-d965-404b-a5ca-edbe60f81305 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:33.062402 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 162/307] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:49:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:49:33.064369 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a56733-d965-404b-a5ca-edbe60f81305 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:33.073860 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac52d437-dc94-4d95-b4a6-bd436dc37d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:33.074500 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac52d437-dc94-4d95-b4a6-bd436dc37d82 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:33.074772 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac52d437-dc94-4d95-b4a6-bd436dc37d82 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:33.075038 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac52d437-dc94-4d95-b4a6-bd436dc37d82 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:33.076215 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac52d437-dc94-4d95-b4a6-bd436dc37d82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:33.077707 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac52d437-dc94-4d95-b4a6-bd436dc37d82 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:33.079436 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 146/308] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:49:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 10:49:33.084925 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c3abd-5c9d-47e1-90b7-ab0d91ed0a90 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:33.085211 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c3abd-5c9d-47e1-90b7-ab0d91ed0a90 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:33.085483 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c3abd-5c9d-47e1-90b7-ab0d91ed0a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:33.104353 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-305c3abd-5c9d-47e1-90b7-ab0d91ed0a90 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:49:33.105621 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-305c3abd-5c9d-47e1-90b7-ab0d91ed0a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:49:33.138408 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:33.180131 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:33.197638 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 147/309] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:49:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 10:49:33.197638 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305c3abd-5c9d-47e1-90b7-ab0d91ed0a90 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:33.204808 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a56733-d965-404b-a5ca-edbe60f81305 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:33.254200 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743de3e0-8c4b-47fe-8a47-4618555581ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:33.255133 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743de3e0-8c4b-47fe-8a47-4618555581ce None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:33.255415 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743de3e0-8c4b-47fe-8a47-4618555581ce None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:33.255685 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743de3e0-8c4b-47fe-8a47-4618555581ce None admin] PATH_INFO: `/v3/users/19458ea38fae494490aa5129dfb959d7` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:33.272210 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743de3e0-8c4b-47fe-8a47-4618555581ce None admin] RBAC: Authorizing `identity:get_user(user_id=19458ea38fae494490aa5129dfb959d7)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:33.274663 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743de3e0-8c4b-47fe-8a47-4618555581ce None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:33.277740 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 163/310] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Aug 18 10:49:33 2022] GET /identity/v3/users/19458ea38fae494490aa5129dfb959d7 => generated 293 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 10:49:33.282677 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743de3e0-8c4b-47fe-8a47-4618555581ce None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:33.302203 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305c3abd-5c9d-47e1-90b7-ab0d91ed0a90 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:33.348775 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c065f0-669d-4e52-b743-046f3096e896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:33.349488 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c065f0-669d-4e52-b743-046f3096e896 None admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:33.349789 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c065f0-669d-4e52-b743-046f3096e896 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:33.350062 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c065f0-669d-4e52-b743-046f3096e896 None admin] PATH_INFO: `/v3/groups` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:33.350688 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c065f0-669d-4e52-b743-046f3096e896 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:33.352299 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c065f0-669d-4e52-b743-046f3096e896 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:33.377557 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 148/311] 10.222.0.15 () {60 vars in 1134 bytes} [Thu Aug 18 10:49:33 2022] POST /identity/v3/groups => generated 229 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 10:49:33.426115 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743de3e0-8c4b-47fe-8a47-4618555581ce None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:33.447740 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:33.469397 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791f700a-71c9-4368-aec6-eb1664df2efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:33.470327 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791f700a-71c9-4368-aec6-eb1664df2efa None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:33.470757 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791f700a-71c9-4368-aec6-eb1664df2efa None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:33.471176 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791f700a-71c9-4368-aec6-eb1664df2efa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:33.472061 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791f700a-71c9-4368-aec6-eb1664df2efa None admin] RBAC: Adding query filter params (role.id=fcb5eb4c33b24ac9904230e57dec7ec9, user.id=19458ea38fae494490aa5129dfb959d7, scope.system=all) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:49:33.472516 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791f700a-71c9-4368-aec6-eb1664df2efa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:33.474385 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791f700a-71c9-4368-aec6-eb1664df2efa None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:33.481467 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 164/312] 10.222.0.15 () {56 vars in 1308 bytes} [Thu Aug 18 10:49:33 2022] GET /identity/v3/role_assignments?user.id=19458ea38fae494490aa5129dfb959d7&scope.system=all&role.id=fcb5eb4c33b24ac9904230e57dec7ec9 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:33.496687 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c065f0-669d-4e52-b743-046f3096e896 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:33.570791 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:33.626314 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c065f0-669d-4e52-b743-046f3096e896 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:33.664466 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fb9491-b69e-4409-9611-727613992334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:33.665723 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb9491-b69e-4409-9611-727613992334 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:33.666010 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb9491-b69e-4409-9611-727613992334 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:33.666280 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb9491-b69e-4409-9611-727613992334 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:33.677310 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fb9491-b69e-4409-9611-727613992334 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:49:33.683085 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-15fb9491-b69e-4409-9611-727613992334 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 10:49:33.683085 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:49:33.683085 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:49:33.683085 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:49:33.683085 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:49:33.683085 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:49:33.683085 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:49:33.683085 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:49:33.683085 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:49:33.683085 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:49:33.683085 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:49:33.683085 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:49:33.683085 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:49:33.683085 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:49:33.683085 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:49:33.683085 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:49:33.683953 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:49:33.683953 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:49:33.683953 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:49:33.683953 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:49:33.683953 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:49:33.683953 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:49:33.683953 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:49:33.683953 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:49:33.683953 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:49:33.683953 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:49:33.683953 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:49:33.683953 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:49:33.683953 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:49:33.683953 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:49:33.683953 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:49:33.683953 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:49:33.684740 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:49:33.684740 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:49:33.684740 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:49:33.684740 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:49:33.684740 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:49:33.684740 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:49:33.684740 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:49:33.684740 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:49:33.684740 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:49:33.684740 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:49:33.684740 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 10:49:33.684740 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:49:33.684740 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 149/313] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 18 10:49:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:49:33.691823 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791f700a-71c9-4368-aec6-eb1664df2efa None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:33.800501 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791f700a-71c9-4368-aec6-eb1664df2efa None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:33.837866 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7342c76-3915-41e6-a5d5-9cd4944ee253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:33.839076 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7342c76-3915-41e6-a5d5-9cd4944ee253 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:33.839353 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7342c76-3915-41e6-a5d5-9cd4944ee253 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:33.839624 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7342c76-3915-41e6-a5d5-9cd4944ee253 None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:33.840297 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7342c76-3915-41e6-a5d5-9cd4944ee253 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:49:33.840598 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7342c76-3915-41e6-a5d5-9cd4944ee253 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:33.842024 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7342c76-3915-41e6-a5d5-9cd4944ee253 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:33.851056 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 165/314] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Aug 18 10:49:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:33.857616 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fb9491-b69e-4409-9611-727613992334 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:33.972424 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fb9491-b69e-4409-9611-727613992334 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:33.990639 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:34.008932 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f869ce5b-2587-4f9a-819c-e61ec1dc2a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:34.009796 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f869ce5b-2587-4f9a-819c-e61ec1dc2a46 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:34.010083 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f869ce5b-2587-4f9a-819c-e61ec1dc2a46 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:34.010363 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f869ce5b-2587-4f9a-819c-e61ec1dc2a46 None admin] PATH_INFO: `/v3/users/48f75318611b4f56a46a02b8f2a3d039` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:34.011535 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f869ce5b-2587-4f9a-819c-e61ec1dc2a46 None admin] RBAC: Authorizing `identity:get_user(user_id=48f75318611b4f56a46a02b8f2a3d039)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:34.013001 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f869ce5b-2587-4f9a-819c-e61ec1dc2a46 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:34.014634 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 150/315] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Aug 18 10:49:33 2022] GET /identity/v3/users/48f75318611b4f56a46a02b8f2a3d039 => generated 297 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:34.020682 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7342c76-3915-41e6-a5d5-9cd4944ee253 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:34.069940 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:34.127875 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7342c76-3915-41e6-a5d5-9cd4944ee253 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:34.165329 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e8ff8f-1af7-4f76-b2f4-59f8fcb6bcbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:34.165983 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e8ff8f-1af7-4f76-b2f4-59f8fcb6bcbd None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:34.166263 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e8ff8f-1af7-4f76-b2f4-59f8fcb6bcbd None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:34.166540 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e8ff8f-1af7-4f76-b2f4-59f8fcb6bcbd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:34.240119 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e8ff8f-1af7-4f76-b2f4-59f8fcb6bcbd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:34.241687 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e8ff8f-1af7-4f76-b2f4-59f8fcb6bcbd None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:34.285892 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:34.346235 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 166/316] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 18 10:49:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 10:49:34.352319 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f869ce5b-2587-4f9a-819c-e61ec1dc2a46 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:34.463179 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f869ce5b-2587-4f9a-819c-e61ec1dc2a46 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:34.507488 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6deeb19-58b2-4227-bb6e-ebb4904713ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:34.508044 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6deeb19-58b2-4227-bb6e-ebb4904713ad None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:34.508341 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6deeb19-58b2-4227-bb6e-ebb4904713ad None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:34.509255 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6deeb19-58b2-4227-bb6e-ebb4904713ad None admin] PATH_INFO: `/v3/projects/40e4bf42973a49f182b6ddf70bcb3bdf` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:34.510432 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6deeb19-58b2-4227-bb6e-ebb4904713ad None admin] RBAC: Authorizing `identity:get_project(project_id=40e4bf42973a49f182b6ddf70bcb3bdf)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:34.511885 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6deeb19-58b2-4227-bb6e-ebb4904713ad None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:34.514068 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 151/317] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 18 10:49:34 2022] GET /identity/v3/projects/40e4bf42973a49f182b6ddf70bcb3bdf => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:34.519885 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e8ff8f-1af7-4f76-b2f4-59f8fcb6bcbd None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:34.637891 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e8ff8f-1af7-4f76-b2f4-59f8fcb6bcbd None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:34.676817 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd80dd96-1d31-462d-8066-ceafa68179e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:34.677444 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd80dd96-1d31-462d-8066-ceafa68179e6 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:34.677752 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd80dd96-1d31-462d-8066-ceafa68179e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:34.678029 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd80dd96-1d31-462d-8066-ceafa68179e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:34.678760 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd80dd96-1d31-462d-8066-ceafa68179e6 None admin] RBAC: Adding query filter params (role.id=fcb5eb4c33b24ac9904230e57dec7ec9, scope.project.id=40e4bf42973a49f182b6ddf70bcb3bdf, user.id=48f75318611b4f56a46a02b8f2a3d039) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:49:34.679065 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd80dd96-1d31-462d-8066-ceafa68179e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:34.680566 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd80dd96-1d31-462d-8066-ceafa68179e6 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:34.693695 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 167/318] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Aug 18 10:49:34 2022] GET /identity/v3/role_assignments?user.id=48f75318611b4f56a46a02b8f2a3d039&scope.project.id=40e4bf42973a49f182b6ddf70bcb3bdf&role.id=fcb5eb4c33b24ac9904230e57dec7ec9 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:34.765223 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d240a-4505-45b3-a652-53101698e9a8 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:34.765738 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d240a-4505-45b3-a652-53101698e9a8 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:34.765738 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d240a-4505-45b3-a652-53101698e9a8 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:34.767427 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 152/319] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:49:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:49:34.773590 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a516626-7ca4-4fe5-bd5d-68d51fbddba8 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:34.773899 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a516626-7ca4-4fe5-bd5d-68d51fbddba8 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:34.774758 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a516626-7ca4-4fe5-bd5d-68d51fbddba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:34.789318 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:34.795891 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-4a516626-7ca4-4fe5-bd5d-68d51fbddba8 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:49:34.797126 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-4a516626-7ca4-4fe5-bd5d-68d51fbddba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:49:34.873203 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 168/320] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:49:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 10:49:35.154936 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58d240a-4505-45b3-a652-53101698e9a8 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:35.217721 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:35.269881 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58d240a-4505-45b3-a652-53101698e9a8 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:35.306318 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b7b87f-07f9-44ef-b4bb-cd9f19d81a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:35.306944 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b7b87f-07f9-44ef-b4bb-cd9f19d81a72 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:35.307220 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b7b87f-07f9-44ef-b4bb-cd9f19d81a72 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:35.307489 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b7b87f-07f9-44ef-b4bb-cd9f19d81a72 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:35.317755 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b7b87f-07f9-44ef-b4bb-cd9f19d81a72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:49:35.323387 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-63b7b87f-07f9-44ef-b4bb-cd9f19d81a72 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 10:49:35.323387 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:49:35.323387 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:49:35.323387 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:49:35.323387 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:49:35.323387 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:49:35.323387 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:49:35.323387 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:49:35.323387 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:49:35.323387 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:49:35.323387 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:49:35.323387 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:49:35.323387 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:49:35.323387 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:49:35.323387 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:49:35.323387 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:49:35.324365 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:49:35.324365 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:49:35.324365 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:49:35.324365 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:49:35.324365 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:49:35.324365 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:49:35.324365 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:49:35.324365 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:49:35.324365 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:49:35.324365 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:49:35.324365 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:49:35.324365 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:49:35.324365 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:49:35.324365 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:49:35.324365 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:49:35.324365 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:49:35.325314 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:49:35.325314 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:49:35.325314 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:49:35.325314 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:49:35.325314 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:49:35.325314 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:49:35.325314 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:49:35.325314 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:49:35.325314 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:49:35.325314 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:49:35.325314 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 10:49:35.325314 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:49:35.325314 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 153/321] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 18 10:49:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:49:35.331245 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a516626-7ca4-4fe5-bd5d-68d51fbddba8 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:35.449038 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a516626-7ca4-4fe5-bd5d-68d51fbddba8 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:35.474481 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7299eea6-1f26-4927-97cb-290d69fc8f9e None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:35.474967 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7299eea6-1f26-4927-97cb-290d69fc8f9e None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:35.475893 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7299eea6-1f26-4927-97cb-290d69fc8f9e None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:35.478557 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 154/322] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:49:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:49:35.485336 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f416f30f-9a84-47b6-8814-f14b5a9c47ab None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:35.485728 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f416f30f-9a84-47b6-8814-f14b5a9c47ab None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:35.486180 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f416f30f-9a84-47b6-8814-f14b5a9c47ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:35.494246 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8efa202-6d5c-4c8e-b158-1f58f83ee086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:35.495054 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8efa202-6d5c-4c8e-b158-1f58f83ee086 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:35.495346 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8efa202-6d5c-4c8e-b158-1f58f83ee086 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:35.495633 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8efa202-6d5c-4c8e-b158-1f58f83ee086 None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:35.496325 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8efa202-6d5c-4c8e-b158-1f58f83ee086 None admin] RBAC: Adding query filter params (name=member) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:49:35.496632 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8efa202-6d5c-4c8e-b158-1f58f83ee086 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:35.498079 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8efa202-6d5c-4c8e-b158-1f58f83ee086 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:35.500681 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:35.507490 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 169/323] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Aug 18 10:49:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:35.507645 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-f416f30f-9a84-47b6-8814-f14b5a9c47ab None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:49:35.509338 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-f416f30f-9a84-47b6-8814-f14b5a9c47ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:49:35.509942 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d2eff-32d4-43ef-8c5c-3728483ccfd5 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:35.510233 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d2eff-32d4-43ef-8c5c-3728483ccfd5 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:35.510510 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d2eff-32d4-43ef-8c5c-3728483ccfd5 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:35.511745 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 170/324] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:49:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:49:35.513759 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734d2eff-32d4-43ef-8c5c-3728483ccfd5 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:35.579107 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 155/325] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:49:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 10:49:35.580406 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c6d60-44e6-4283-8ae8-709f3751e0d8 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:35.580692 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c6d60-44e6-4283-8ae8-709f3751e0d8 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:35.580956 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c6d60-44e6-4283-8ae8-709f3751e0d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:35.602161 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-968c6d60-44e6-4283-8ae8-709f3751e0d8 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:49:35.604192 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-968c6d60-44e6-4283-8ae8-709f3751e0d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:49:35.631711 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734d2eff-32d4-43ef-8c5c-3728483ccfd5 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:35.651126 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:35.672083 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aafeeb-1850-4902-a8d0-f367714f4fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:35.672732 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aafeeb-1850-4902-a8d0-f367714f4fc1 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:35.673008 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aafeeb-1850-4902-a8d0-f367714f4fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:35.673283 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aafeeb-1850-4902-a8d0-f367714f4fc1 None admin] PATH_INFO: `/v3/users/42bb4b6c894e4d3f8e29eda6b88ff361` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:35.674436 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aafeeb-1850-4902-a8d0-f367714f4fc1 None admin] RBAC: Authorizing `identity:get_user(user_id=42bb4b6c894e4d3f8e29eda6b88ff361)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:35.675869 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aafeeb-1850-4902-a8d0-f367714f4fc1 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:35.677735 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 171/326] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Aug 18 10:49:35 2022] GET /identity/v3/users/42bb4b6c894e4d3f8e29eda6b88ff361 => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 10:49:35.683360 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aafeeb-1850-4902-a8d0-f367714f4fc1 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:35.686231 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 156/327] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:49:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 10:49:35.755858 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:35.792855 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aafeeb-1850-4902-a8d0-f367714f4fc1 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:35.827497 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3715e53c-0ed4-44d7-81c6-cf69edb5d1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:35.828127 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3715e53c-0ed4-44d7-81c6-cf69edb5d1c3 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:35.828400 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3715e53c-0ed4-44d7-81c6-cf69edb5d1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:35.828670 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3715e53c-0ed4-44d7-81c6-cf69edb5d1c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:35.829392 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3715e53c-0ed4-44d7-81c6-cf69edb5d1c3 None admin] RBAC: Adding query filter params (role.id=719e5c62188d4f8a838987d6e72ca8f7, user.id=42bb4b6c894e4d3f8e29eda6b88ff361, scope.system=all) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:49:35.829722 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3715e53c-0ed4-44d7-81c6-cf69edb5d1c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:35.831133 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3715e53c-0ed4-44d7-81c6-cf69edb5d1c3 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:35.842645 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 172/328] 10.222.0.15 () {56 vars in 1308 bytes} [Thu Aug 18 10:49:35 2022] GET /identity/v3/role_assignments?user.id=42bb4b6c894e4d3f8e29eda6b88ff361&scope.system=all&role.id=719e5c62188d4f8a838987d6e72ca8f7 => generated 510 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 10:49:35.845296 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968c6d60-44e6-4283-8ae8-709f3751e0d8 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:35.964105 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3715e53c-0ed4-44d7-81c6-cf69edb5d1c3 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:35.964943 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968c6d60-44e6-4283-8ae8-709f3751e0d8 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:36.006324 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e14b154-9bef-4375-92e9-be85bf1b48a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:36.006887 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14b154-9bef-4375-92e9-be85bf1b48a5 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:36.007163 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14b154-9bef-4375-92e9-be85bf1b48a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:36.007437 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14b154-9bef-4375-92e9-be85bf1b48a5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:36.018931 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e14b154-9bef-4375-92e9-be85bf1b48a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:49:36.023893 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-1e14b154-9bef-4375-92e9-be85bf1b48a5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 10:49:36.023893 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:49:36.023893 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:49:36.023893 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:49:36.023893 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:49:36.023893 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:49:36.023893 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:49:36.023893 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:49:36.023893 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:49:36.023893 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:49:36.023893 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:49:36.023893 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:49:36.023893 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:49:36.023893 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:49:36.023893 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:49:36.023893 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:49:36.024837 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:49:36.024837 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:49:36.024837 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:49:36.024837 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:49:36.024837 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:49:36.024837 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:49:36.024837 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:49:36.024837 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:49:36.024837 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:49:36.024837 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:49:36.024837 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:49:36.024837 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:49:36.024837 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:49:36.024837 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:49:36.024837 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:49:36.024837 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:49:36.025810 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:49:36.025810 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:49:36.025810 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:49:36.025810 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:49:36.025810 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:49:36.025810 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:49:36.025810 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:49:36.025810 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:49:36.025810 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:49:36.025810 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:49:36.025810 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 10:49:36.025810 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:49:36.025810 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 157/329] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 18 10:49:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:49:36.031102 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e14b154-9bef-4375-92e9-be85bf1b48a5 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:36.074794 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:36.083357 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3715e53c-0ed4-44d7-81c6-cf69edb5d1c3 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:36.106291 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:36.118302 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3defb28f-26ce-4a23-8b98-8beed6747096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:36.119173 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3defb28f-26ce-4a23-8b98-8beed6747096 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:36.119465 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3defb28f-26ce-4a23-8b98-8beed6747096 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:36.119739 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3defb28f-26ce-4a23-8b98-8beed6747096 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:36.120925 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3defb28f-26ce-4a23-8b98-8beed6747096 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:36.122396 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3defb28f-26ce-4a23-8b98-8beed6747096 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:36.123979 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 173/330] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:49:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 10:49:36.129356 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3defb28f-26ce-4a23-8b98-8beed6747096 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:36.145410 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e14b154-9bef-4375-92e9-be85bf1b48a5 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:36.179786 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2ad917-5d51-41c3-816d-4e18044fca08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:36.181139 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2ad917-5d51-41c3-816d-4e18044fca08 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:36.181313 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2ad917-5d51-41c3-816d-4e18044fca08 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:36.181571 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2ad917-5d51-41c3-816d-4e18044fca08 None admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:36.182230 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2ad917-5d51-41c3-816d-4e18044fca08 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:49:36.182525 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2ad917-5d51-41c3-816d-4e18044fca08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:36.183934 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2ad917-5d51-41c3-816d-4e18044fca08 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:36.196694 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 158/331] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Aug 18 10:49:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:36.198107 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2ad917-5d51-41c3-816d-4e18044fca08 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:36.235270 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3defb28f-26ce-4a23-8b98-8beed6747096 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:36.269987 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e228188-1d08-4a53-974d-bb6d9341e519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:36.270518 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e228188-1d08-4a53-974d-bb6d9341e519 None admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:36.270794 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e228188-1d08-4a53-974d-bb6d9341e519 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:36.271070 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e228188-1d08-4a53-974d-bb6d9341e519 None admin] PATH_INFO: `/v3/groups` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:36.271698 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e228188-1d08-4a53-974d-bb6d9341e519 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:36.273376 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e228188-1d08-4a53-974d-bb6d9341e519 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:36.291260 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 174/332] 10.222.0.15 () {60 vars in 1134 bytes} [Thu Aug 18 10:49:36 2022] POST /identity/v3/groups => generated 226 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 10:49:36.304657 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:36.313333 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2ad917-5d51-41c3-816d-4e18044fca08 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:36.352667 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e685a43-ca7c-4e3f-9b41-6507306fd252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:36.353334 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e685a43-ca7c-4e3f-9b41-6507306fd252 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:36.353644 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e685a43-ca7c-4e3f-9b41-6507306fd252 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:36.353922 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e685a43-ca7c-4e3f-9b41-6507306fd252 None admin] PATH_INFO: `/v3/users/19458ea38fae494490aa5129dfb959d7` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:36.355135 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e685a43-ca7c-4e3f-9b41-6507306fd252 None admin] RBAC: Authorizing `identity:get_user(user_id=19458ea38fae494490aa5129dfb959d7)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:36.356618 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e685a43-ca7c-4e3f-9b41-6507306fd252 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:36.358312 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 159/333] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Aug 18 10:49:36 2022] GET /identity/v3/users/19458ea38fae494490aa5129dfb959d7 => generated 293 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 10:49:36.364359 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e228188-1d08-4a53-974d-bb6d9341e519 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:36.422262 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:36.474486 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e228188-1d08-4a53-974d-bb6d9341e519 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:36.509250 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fe8b09-2b8b-491e-abc9-9e39aef6d4e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:36.509937 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe8b09-2b8b-491e-abc9-9e39aef6d4e6 None admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:36.510217 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe8b09-2b8b-491e-abc9-9e39aef6d4e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:36.510492 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe8b09-2b8b-491e-abc9-9e39aef6d4e6 None admin] PATH_INFO: `/v3/system/users/19458ea38fae494490aa5129dfb959d7/roles/fcb5eb4c33b24ac9904230e57dec7ec9` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:36.511982 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fe8b09-2b8b-491e-abc9-9e39aef6d4e6 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=19458ea38fae494490aa5129dfb959d7, role_id=fcb5eb4c33b24ac9904230e57dec7ec9)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:36.513366 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fe8b09-2b8b-491e-abc9-9e39aef6d4e6 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:36.522560 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 175/334] 10.222.0.15 () {58 vars in 1334 bytes} [Thu Aug 18 10:49:36 2022] PUT /identity/v3/system/users/19458ea38fae494490aa5129dfb959d7/roles/fcb5eb4c33b24ac9904230e57dec7ec9 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 10:49:38.610297 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a55e5d-5b72-475f-8823-0ee3752b47f2 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:38.610804 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a55e5d-5b72-475f-8823-0ee3752b47f2 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:38.610878 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a55e5d-5b72-475f-8823-0ee3752b47f2 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:38.612543 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 160/335] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:49:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:49:38.617826 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad61bac-3f6e-4ad0-9ac5-7a6a45b38efd None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:38.619379 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad61bac-3f6e-4ad0-9ac5-7a6a45b38efd None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:38.619669 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad61bac-3f6e-4ad0-9ac5-7a6a45b38efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:38.637353 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8cfce6-2806-4690-ba3b-ec51d66bb042 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:38.638006 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8cfce6-2806-4690-ba3b-ec51d66bb042 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:38.638483 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8cfce6-2806-4690-ba3b-ec51d66bb042 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:38.640042 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 161/336] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:49:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:49:38.645177 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2adfab8-66a9-42ce-961e-1ef068cca80d None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:38.645838 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2adfab8-66a9-42ce-961e-1ef068cca80d None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:38.646315 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2adfab8-66a9-42ce-961e-1ef068cca80d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:38.646780 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-bad61bac-3f6e-4ad0-9ac5-7a6a45b38efd None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:49:38.648249 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-bad61bac-3f6e-4ad0-9ac5-7a6a45b38efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:49:38.682685 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-c2adfab8-66a9-42ce-961e-1ef068cca80d None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:49:38.684503 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-c2adfab8-66a9-42ce-961e-1ef068cca80d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:49:38.771085 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 176/337] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:49:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 10:49:38.809724 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 162/338] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:49:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 10:49:39.044335 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cdd3c4-5567-4860-80da-9bc63751c967 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:39.044705 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cdd3c4-5567-4860-80da-9bc63751c967 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:39.044882 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cdd3c4-5567-4860-80da-9bc63751c967 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:39.046585 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 177/339] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:49:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:49:39.051903 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa516047-d623-4893-beed-cc1ec93c70a5 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:39.052490 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa516047-d623-4893-beed-cc1ec93c70a5 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:39.052976 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa516047-d623-4893-beed-cc1ec93c70a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:39.079835 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-aa516047-d623-4893-beed-cc1ec93c70a5 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:49:39.081354 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-aa516047-d623-4893-beed-cc1ec93c70a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:49:39.169333 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 163/340] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:49:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 10:49:39.216503 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cdd3c4-5567-4860-80da-9bc63751c967 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:39.243771 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa516047-d623-4893-beed-cc1ec93c70a5 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:39.294287 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:39.308503 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:39.406332 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cdd3c4-5567-4860-80da-9bc63751c967 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:39.462874 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddfcbc0-7636-404b-b5a0-c2ba9093cd16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:39.463519 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddfcbc0-7636-404b-b5a0-c2ba9093cd16 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:39.463797 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddfcbc0-7636-404b-b5a0-c2ba9093cd16 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:39.464068 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddfcbc0-7636-404b-b5a0-c2ba9093cd16 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:39.481987 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa516047-d623-4893-beed-cc1ec93c70a5 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:39.487077 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddfcbc0-7636-404b-b5a0-c2ba9093cd16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:49:39.491793 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-3ddfcbc0-7636-404b-b5a0-c2ba9093cd16 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 10:49:39.491793 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:49:39.491793 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:49:39.491793 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:49:39.491793 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:49:39.491793 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:49:39.491793 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:49:39.491793 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:49:39.491793 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:49:39.491793 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:49:39.491793 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:49:39.491793 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:49:39.491793 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:49:39.491793 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:49:39.491793 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:49:39.491793 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:49:39.492689 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:49:39.492689 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:49:39.492689 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:49:39.492689 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:49:39.492689 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:49:39.492689 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:49:39.492689 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:49:39.492689 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:49:39.492689 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:49:39.492689 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:49:39.492689 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:49:39.492689 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:49:39.492689 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:49:39.492689 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:49:39.492689 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:49:39.492689 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:49:39.493492 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:49:39.493492 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:49:39.493492 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:49:39.493492 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:49:39.493492 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:49:39.493492 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:49:39.493492 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:49:39.493492 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:49:39.493492 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:49:39.493492 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:49:39.493492 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 10:49:39.493492 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:49:39.502869 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 178/341] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 18 10:49:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:49:39.508938 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddfcbc0-7636-404b-b5a0-c2ba9093cd16 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:39.551071 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429cb00c-99b8-4dc5-97b7-06f3ebe59387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:39.551733 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429cb00c-99b8-4dc5-97b7-06f3ebe59387 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:39.552014 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429cb00c-99b8-4dc5-97b7-06f3ebe59387 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:39.552290 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429cb00c-99b8-4dc5-97b7-06f3ebe59387 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:39.582546 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429cb00c-99b8-4dc5-97b7-06f3ebe59387 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:49:39.588019 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-429cb00c-99b8-4dc5-97b7-06f3ebe59387 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 10:49:39.588019 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:49:39.588019 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:49:39.588019 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:49:39.588019 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:49:39.588019 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:49:39.588019 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:49:39.588019 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:49:39.588019 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:49:39.588019 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:49:39.588019 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:49:39.588019 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:49:39.588019 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:49:39.588019 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:49:39.588019 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:49:39.588019 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:49:39.588925 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:49:39.588925 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:49:39.588925 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:49:39.588925 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:49:39.588925 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:49:39.588925 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:49:39.588925 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:49:39.588925 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:49:39.588925 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:49:39.588925 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:49:39.588925 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:49:39.588925 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:49:39.588925 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:49:39.588925 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:49:39.588925 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:49:39.588925 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:49:39.589732 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:49:39.589732 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:49:39.589732 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:49:39.589732 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:49:39.589732 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:49:39.589732 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:49:39.589732 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:49:39.589732 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:49:39.589732 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:49:39.589732 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:49:39.589732 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 10:49:39.589732 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:49:39.597993 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 164/342] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 18 10:49:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 10:49:39.598942 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429cb00c-99b8-4dc5-97b7-06f3ebe59387 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:39.673849 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddfcbc0-7636-404b-b5a0-c2ba9093cd16 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:39.683291 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:39.735956 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:39.736626 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20860ffb-79f3-4dd9-b9b2-68f50c8b9899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:39.738333 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20860ffb-79f3-4dd9-b9b2-68f50c8b9899 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:39.738441 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20860ffb-79f3-4dd9-b9b2-68f50c8b9899 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:39.738663 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20860ffb-79f3-4dd9-b9b2-68f50c8b9899 None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:39.739390 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20860ffb-79f3-4dd9-b9b2-68f50c8b9899 None admin] RBAC: Adding query filter params (name=member) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:49:39.739695 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20860ffb-79f3-4dd9-b9b2-68f50c8b9899 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:39.741094 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20860ffb-79f3-4dd9-b9b2-68f50c8b9899 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:39.757935 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 179/343] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Aug 18 10:49:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:39.760454 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429cb00c-99b8-4dc5-97b7-06f3ebe59387 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:39.762761 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20860ffb-79f3-4dd9-b9b2-68f50c8b9899 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:39.803574 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7083306-5241-48a3-be2c-730ab6d38981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:39.804669 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7083306-5241-48a3-be2c-730ab6d38981 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:39.805799 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7083306-5241-48a3-be2c-730ab6d38981 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:39.806279 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7083306-5241-48a3-be2c-730ab6d38981 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:39.818564 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7083306-5241-48a3-be2c-730ab6d38981 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:49:39.824655 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-b7083306-5241-48a3-be2c-730ab6d38981 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 10:49:39.824655 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:49:39.824655 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:49:39.824655 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:49:39.824655 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:49:39.824655 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:49:39.824655 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:49:39.824655 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:49:39.824655 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:49:39.824655 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:49:39.824655 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:49:39.824655 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:49:39.824655 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:49:39.824655 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:49:39.824655 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:49:39.824655 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:49:39.825604 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:49:39.825604 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:49:39.825604 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:49:39.825604 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:49:39.825604 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:49:39.825604 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:49:39.825604 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:49:39.825604 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:49:39.825604 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:49:39.825604 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:49:39.825604 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:49:39.825604 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:49:39.825604 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:49:39.825604 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:49:39.825604 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:49:39.825604 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:49:39.826407 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:49:39.826407 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:49:39.826407 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:49:39.826407 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:49:39.826407 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:49:39.826407 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:49:39.826407 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:49:39.826407 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:49:39.826407 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:49:39.826407 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:49:39.826407 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 10:49:39.826407 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:49:39.828857 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 165/344] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Aug 18 10:49:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:49:39.830044 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7083306-5241-48a3-be2c-730ab6d38981 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:39.885061 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20860ffb-79f3-4dd9-b9b2-68f50c8b9899 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:39.929019 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3991dccf-f838-4f99-9e72-b4444563927b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:39.929691 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3991dccf-f838-4f99-9e72-b4444563927b None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:39.929976 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3991dccf-f838-4f99-9e72-b4444563927b None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:39.930850 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3991dccf-f838-4f99-9e72-b4444563927b None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:39.932224 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3991dccf-f838-4f99-9e72-b4444563927b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:49:39.932535 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3991dccf-f838-4f99-9e72-b4444563927b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:39.933937 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3991dccf-f838-4f99-9e72-b4444563927b None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:39.943807 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 180/345] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Aug 18 10:49:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:39.945126 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f9ac6-aa31-4d5d-b349-1447791b2dd1 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:39.945419 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f9ac6-aa31-4d5d-b349-1447791b2dd1 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:39.946095 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f9ac6-aa31-4d5d-b349-1447791b2dd1 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:39.948062 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 181/346] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:49:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:49:39.948819 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13f9ac6-aa31-4d5d-b349-1447791b2dd1 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:39.960221 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7083306-5241-48a3-be2c-730ab6d38981 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:39.981874 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:40.004132 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a035486-be5d-4b01-94e0-140e8e847ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:40.005087 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a035486-be5d-4b01-94e0-140e8e847ab6 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:40.005590 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a035486-be5d-4b01-94e0-140e8e847ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:40.006100 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a035486-be5d-4b01-94e0-140e8e847ab6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:40.023977 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:40.058642 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13f9ac6-aa31-4d5d-b349-1447791b2dd1 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:40.095541 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa558b0-c0e6-4315-af69-4143b332cf7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:40.095541 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa558b0-c0e6-4315-af69-4143b332cf7e None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:40.095838 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa558b0-c0e6-4315-af69-4143b332cf7e None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:40.096142 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa558b0-c0e6-4315-af69-4143b332cf7e None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:40.096669 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa558b0-c0e6-4315-af69-4143b332cf7e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:49:40.097023 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa558b0-c0e6-4315-af69-4143b332cf7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:40.097495 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a035486-be5d-4b01-94e0-140e8e847ab6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:40.098564 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa558b0-c0e6-4315-af69-4143b332cf7e None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:40.099472 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a035486-be5d-4b01-94e0-140e8e847ab6 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:40.107800 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 182/347] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 18 10:49:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:40.108911 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa558b0-c0e6-4315-af69-4143b332cf7e None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:40.208455 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:40.217314 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa558b0-c0e6-4315-af69-4143b332cf7e None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:40.238055 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 166/348] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 18 10:49:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 10:49:40.239820 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a90a08e-1006-4829-afc6-be0881c83686 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:40.240304 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a90a08e-1006-4829-afc6-be0881c83686 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:40.240776 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a90a08e-1006-4829-afc6-be0881c83686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:40.257478 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceee4059-8ce1-4872-96a4-e14a89f3b83a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:40.258161 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee4059-8ce1-4872-96a4-e14a89f3b83a None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:40.258536 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee4059-8ce1-4872-96a4-e14a89f3b83a None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:40.259546 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee4059-8ce1-4872-96a4-e14a89f3b83a None admin] PATH_INFO: `/v3/users/19458ea38fae494490aa5129dfb959d7` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:40.261431 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceee4059-8ce1-4872-96a4-e14a89f3b83a None admin] RBAC: Authorizing `identity:get_user(user_id=19458ea38fae494490aa5129dfb959d7)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:40.262318 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-3a90a08e-1006-4829-afc6-be0881c83686 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:49:40.262923 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceee4059-8ce1-4872-96a4-e14a89f3b83a None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:40.263950 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-3a90a08e-1006-4829-afc6-be0881c83686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:49:40.264893 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 183/349] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Aug 18 10:49:40 2022] GET /identity/v3/users/19458ea38fae494490aa5129dfb959d7 => generated 293 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:40.265764 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceee4059-8ce1-4872-96a4-e14a89f3b83a None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:40.312941 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:40.354083 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 167/350] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:49:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 10:49:40.355313 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a90a08e-1006-4829-afc6-be0881c83686 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:40.381076 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceee4059-8ce1-4872-96a4-e14a89f3b83a None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:40.423549 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6fa287-d287-4c0d-afe6-fef7b5499f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:40.424170 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6fa287-d287-4c0d-afe6-fef7b5499f25 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:40.424459 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6fa287-d287-4c0d-afe6-fef7b5499f25 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:40.424725 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6fa287-d287-4c0d-afe6-fef7b5499f25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:40.458248 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:40.486753 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a90a08e-1006-4829-afc6-be0881c83686 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:40.505614 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6fa287-d287-4c0d-afe6-fef7b5499f25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:40.506233 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6fa287-d287-4c0d-afe6-fef7b5499f25 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:40.543618 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475f5722-988c-4e5c-96e6-7a6b2dc6f7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:40.544562 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475f5722-988c-4e5c-96e6-7a6b2dc6f7e9 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:40.545067 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475f5722-988c-4e5c-96e6-7a6b2dc6f7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:40.545501 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475f5722-988c-4e5c-96e6-7a6b2dc6f7e9 None admin] PATH_INFO: `/v3/projects/db515fd18ab64bc190c7a76ae5f7e632` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:40.546869 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475f5722-988c-4e5c-96e6-7a6b2dc6f7e9 None admin] RBAC: Authorizing `identity:get_project(project_id=db515fd18ab64bc190c7a76ae5f7e632)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:40.548517 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475f5722-988c-4e5c-96e6-7a6b2dc6f7e9 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:40.554607 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 168/351] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 18 10:49:40 2022] GET /identity/v3/projects/db515fd18ab64bc190c7a76ae5f7e632 => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:40.555707 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475f5722-988c-4e5c-96e6-7a6b2dc6f7e9 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:40.622127 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 184/352] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 18 10:49:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 10:49:40.622127 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6fa287-d287-4c0d-afe6-fef7b5499f25 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:40.626433 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:40.687850 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:40.730797 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475f5722-988c-4e5c-96e6-7a6b2dc6f7e9 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:40.734737 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6fa287-d287-4c0d-afe6-fef7b5499f25 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:40.774577 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3d999d-cf75-48a9-a60d-17d674e65314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:40.775523 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d999d-cf75-48a9-a60d-17d674e65314 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:40.775903 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d999d-cf75-48a9-a60d-17d674e65314 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:40.776281 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d999d-cf75-48a9-a60d-17d674e65314 None admin] PATH_INFO: `/v3/groups/318311d8271846a293a8abcf31026380` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:40.776753 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60855521-8c8e-4245-be5d-a380bcd98fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:40.777559 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60855521-8c8e-4245-be5d-a380bcd98fe4 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:40.777845 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60855521-8c8e-4245-be5d-a380bcd98fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:40.778117 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60855521-8c8e-4245-be5d-a380bcd98fe4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:40.779145 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60855521-8c8e-4245-be5d-a380bcd98fe4 None admin] RBAC: Adding query filter params (role.id=fcb5eb4c33b24ac9904230e57dec7ec9, user.id=19458ea38fae494490aa5129dfb959d7, scope.system=all) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:49:40.779454 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60855521-8c8e-4245-be5d-a380bcd98fe4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:40.782147 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60855521-8c8e-4245-be5d-a380bcd98fe4 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:40.782943 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3d999d-cf75-48a9-a60d-17d674e65314 None admin] RBAC: Authorizing `identity:get_group(group_id=318311d8271846a293a8abcf31026380)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:40.784385 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3d999d-cf75-48a9-a60d-17d674e65314 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:40.786094 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 185/353] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Aug 18 10:49:40 2022] GET /identity/v3/groups/318311d8271846a293a8abcf31026380 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:40.787055 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3d999d-cf75-48a9-a60d-17d674e65314 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:40.798486 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 169/354] 10.222.0.15 () {56 vars in 1308 bytes} [Thu Aug 18 10:49:40 2022] GET /identity/v3/role_assignments?user.id=19458ea38fae494490aa5129dfb959d7&scope.system=all&role.id=fcb5eb4c33b24ac9904230e57dec7ec9 => generated 510 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:40.799748 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b0856e-1c97-4d71-bff4-d557330211e9 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:40.800027 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b0856e-1c97-4d71-bff4-d557330211e9 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:40.800298 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b0856e-1c97-4d71-bff4-d557330211e9 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:40.801542 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 170/355] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:49:40 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:49:40.802298 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b0856e-1c97-4d71-bff4-d557330211e9 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:40.933459 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3d999d-cf75-48a9-a60d-17d674e65314 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:40.953847 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:40.964267 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b0856e-1c97-4d71-bff4-d557330211e9 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:40.969869 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:40.988100 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230dd1d0-25c9-41e0-b684-0b02593e1d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:40.988765 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230dd1d0-25c9-41e0-b684-0b02593e1d1b None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:40.989046 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230dd1d0-25c9-41e0-b684-0b02593e1d1b None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:40.989321 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230dd1d0-25c9-41e0-b684-0b02593e1d1b None admin] PATH_INFO: `/v3/projects/db515fd18ab64bc190c7a76ae5f7e632` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:40.990629 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230dd1d0-25c9-41e0-b684-0b02593e1d1b None admin] RBAC: Authorizing `identity:get_project(project_id=db515fd18ab64bc190c7a76ae5f7e632)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:40.992329 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230dd1d0-25c9-41e0-b684-0b02593e1d1b None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:40.995150 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 186/356] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 18 10:49:40 2022] GET /identity/v3/projects/db515fd18ab64bc190c7a76ae5f7e632 => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:40.995150 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230dd1d0-25c9-41e0-b684-0b02593e1d1b None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:41.015241 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225ae3ce-0aa5-49fa-8bad-fcb3b37f096d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:41.015884 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225ae3ce-0aa5-49fa-8bad-fcb3b37f096d None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:41.016162 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225ae3ce-0aa5-49fa-8bad-fcb3b37f096d None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:41.016436 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225ae3ce-0aa5-49fa-8bad-fcb3b37f096d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:41.032285 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225ae3ce-0aa5-49fa-8bad-fcb3b37f096d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:49:41.037591 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-225ae3ce-0aa5-49fa-8bad-fcb3b37f096d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 10:49:41.037591 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:49:41.037591 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:49:41.037591 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:49:41.037591 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:49:41.037591 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:49:41.037591 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:49:41.037591 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:49:41.037591 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:49:41.037591 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:49:41.037591 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:49:41.037591 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:49:41.037591 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:49:41.037591 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:49:41.037591 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:49:41.037591 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:49:41.038486 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:49:41.038486 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:49:41.038486 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:49:41.038486 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:49:41.038486 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:49:41.038486 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:49:41.038486 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:49:41.038486 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:49:41.038486 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:49:41.038486 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:49:41.038486 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:49:41.038486 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:49:41.038486 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:49:41.038486 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:49:41.038486 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:49:41.038486 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:49:41.039269 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:49:41.039269 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:49:41.039269 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:49:41.039269 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:49:41.039269 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:49:41.039269 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:49:41.039269 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:49:41.039269 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:49:41.039269 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:49:41.039269 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:49:41.039269 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 10:49:41.039269 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:49:41.039269 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 171/357] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 18 10:49:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:49:41.040460 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caea955b-da71-4229-b1f8-63936cc6e274 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:41.040460 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caea955b-da71-4229-b1f8-63936cc6e274 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:41.040680 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caea955b-da71-4229-b1f8-63936cc6e274 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:41.041970 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 172/358] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:49:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:49:41.043005 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86828c2-8b3b-4b99-a9a3-b4c10e186e8b None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:41.043280 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86828c2-8b3b-4b99-a9a3-b4c10e186e8b None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:41.044772 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86828c2-8b3b-4b99-a9a3-b4c10e186e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:41.066535 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-f86828c2-8b3b-4b99-a9a3-b4c10e186e8b None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:49:41.067743 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-f86828c2-8b3b-4b99-a9a3-b4c10e186e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:49:41.120548 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230dd1d0-25c9-41e0-b684-0b02593e1d1b None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:41.149266 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 173/359] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:49:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 10:49:41.149266 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86828c2-8b3b-4b99-a9a3-b4c10e186e8b None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:41.164792 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755c6791-0f1a-4957-9c9a-5114004de0be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:41.165403 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c6791-0f1a-4957-9c9a-5114004de0be None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:41.165814 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c6791-0f1a-4957-9c9a-5114004de0be None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:41.166093 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c6791-0f1a-4957-9c9a-5114004de0be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:41.166824 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755c6791-0f1a-4957-9c9a-5114004de0be None admin] RBAC: Adding query filter params (group.id=318311d8271846a293a8abcf31026380, role.id=719e5c62188d4f8a838987d6e72ca8f7, scope.project.id=db515fd18ab64bc190c7a76ae5f7e632) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:49:41.167251 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755c6791-0f1a-4957-9c9a-5114004de0be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:41.168853 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755c6791-0f1a-4957-9c9a-5114004de0be None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:41.177685 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 187/360] 10.222.0.15 () {56 vars in 1376 bytes} [Thu Aug 18 10:49:40 2022] GET /identity/v3/role_assignments?group.id=318311d8271846a293a8abcf31026380&scope.project.id=db515fd18ab64bc190c7a76ae5f7e632&role.id=719e5c62188d4f8a838987d6e72ca8f7 => generated 260 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:41.177685 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755c6791-0f1a-4957-9c9a-5114004de0be None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:41.279424 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:41.295381 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:41.310524 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86828c2-8b3b-4b99-a9a3-b4c10e186e8b None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:41.335553 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755c6791-0f1a-4957-9c9a-5114004de0be None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:41.366455 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b396aef-b651-46db-a06c-cda54f713b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:41.367093 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b396aef-b651-46db-a06c-cda54f713b54 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:41.367427 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b396aef-b651-46db-a06c-cda54f713b54 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:41.367661 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b396aef-b651-46db-a06c-cda54f713b54 None admin] PATH_INFO: `/v3/groups/318311d8271846a293a8abcf31026380` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:41.368795 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b396aef-b651-46db-a06c-cda54f713b54 None admin] RBAC: Authorizing `identity:get_group(group_id=318311d8271846a293a8abcf31026380)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:41.370331 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b396aef-b651-46db-a06c-cda54f713b54 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:41.371915 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 174/361] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Aug 18 10:49:41 2022] GET /identity/v3/groups/318311d8271846a293a8abcf31026380 => generated 226 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:41.377967 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba3345f-ac21-4df0-b1d1-2febbd0ba86f None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:41.378231 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba3345f-ac21-4df0-b1d1-2febbd0ba86f None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:41.378461 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba3345f-ac21-4df0-b1d1-2febbd0ba86f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:41.382908 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5540a3-df58-4b7c-8766-019f9b361b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:41.383912 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5540a3-df58-4b7c-8766-019f9b361b48 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:41.384388 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5540a3-df58-4b7c-8766-019f9b361b48 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:41.384852 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5540a3-df58-4b7c-8766-019f9b361b48 None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:41.385799 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5540a3-df58-4b7c-8766-019f9b361b48 None admin] RBAC: Adding query filter params (name=member) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:49:41.386344 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5540a3-df58-4b7c-8766-019f9b361b48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:41.388014 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5540a3-df58-4b7c-8766-019f9b361b48 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:41.397276 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 188/362] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Aug 18 10:49:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:41.397723 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-cba3345f-ac21-4df0-b1d1-2febbd0ba86f None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:49:41.398775 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5540a3-df58-4b7c-8766-019f9b361b48 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:41.399720 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-cba3345f-ac21-4df0-b1d1-2febbd0ba86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:49:41.490154 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 175/363] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:49:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 10:49:41.491039 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba3345f-ac21-4df0-b1d1-2febbd0ba86f None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:41.531958 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5540a3-df58-4b7c-8766-019f9b361b48 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:41.554880 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:41.577372 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7952acf-3e78-4d43-b173-996f4d8a5b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:41.578687 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7952acf-3e78-4d43-b173-996f4d8a5b3d None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:41.579592 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7952acf-3e78-4d43-b173-996f4d8a5b3d None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:41.580314 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7952acf-3e78-4d43-b173-996f4d8a5b3d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:41.581482 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7952acf-3e78-4d43-b173-996f4d8a5b3d None admin] RBAC: Adding query filter params (group.id=318311d8271846a293a8abcf31026380, role.id=0ecb6b324fc643f3826b2878f2f6174b, scope.project.id=db515fd18ab64bc190c7a76ae5f7e632) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:49:41.582420 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7952acf-3e78-4d43-b173-996f4d8a5b3d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:41.584359 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7952acf-3e78-4d43-b173-996f4d8a5b3d None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:41.593622 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 189/364] 10.222.0.15 () {56 vars in 1376 bytes} [Thu Aug 18 10:49:41 2022] GET /identity/v3/role_assignments?group.id=318311d8271846a293a8abcf31026380&scope.project.id=db515fd18ab64bc190c7a76ae5f7e632&role.id=0ecb6b324fc643f3826b2878f2f6174b => generated 260 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:41.595964 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7952acf-3e78-4d43-b173-996f4d8a5b3d None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:41.641499 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:41.669659 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba3345f-ac21-4df0-b1d1-2febbd0ba86f None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:41.725250 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d665ff-ef2b-46ae-98ef-86887942d6e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:41.726256 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d665ff-ef2b-46ae-98ef-86887942d6e7 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:41.726730 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d665ff-ef2b-46ae-98ef-86887942d6e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:41.727723 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d665ff-ef2b-46ae-98ef-86887942d6e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:41.826925 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d665ff-ef2b-46ae-98ef-86887942d6e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:41.829923 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d665ff-ef2b-46ae-98ef-86887942d6e7 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:41.830833 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7952acf-3e78-4d43-b173-996f4d8a5b3d None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:41.882229 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30850e7-68ea-4b89-86aa-fa84b68b4c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:41.886498 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30850e7-68ea-4b89-86aa-fa84b68b4c2d None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:41.886872 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30850e7-68ea-4b89-86aa-fa84b68b4c2d None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:41.887222 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30850e7-68ea-4b89-86aa-fa84b68b4c2d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:41.902765 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30850e7-68ea-4b89-86aa-fa84b68b4c2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:49:41.909744 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-f30850e7-68ea-4b89-86aa-fa84b68b4c2d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 10:49:41.909744 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:49:41.909744 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:49:41.909744 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:49:41.909744 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:49:41.909744 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:49:41.909744 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:49:41.909744 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:49:41.909744 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:49:41.909744 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:49:41.909744 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:49:41.909744 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:49:41.909744 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:49:41.909744 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:49:41.909744 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:49:41.909744 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:49:41.910858 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:49:41.910858 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:49:41.910858 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:49:41.910858 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:49:41.910858 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:49:41.910858 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:49:41.910858 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:49:41.910858 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:49:41.910858 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:49:41.910858 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:49:41.910858 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:49:41.910858 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:49:41.910858 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:49:41.910858 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:49:41.910858 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:49:41.910858 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:49:41.911869 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:49:41.911869 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:49:41.911869 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:49:41.911869 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:49:41.911869 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:49:41.911869 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:49:41.911869 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:49:41.911869 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:49:41.911869 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:49:41.911869 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:49:41.911869 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 10:49:41.911869 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:49:41.913335 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 190/365] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Aug 18 10:49:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:49:41.916321 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30850e7-68ea-4b89-86aa-fa84b68b4c2d None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:41.964341 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:41.980489 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 176/366] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 18 10:49:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 10:49:41.982693 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d665ff-ef2b-46ae-98ef-86887942d6e7 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:42.000169 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:42.088801 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30850e7-68ea-4b89-86aa-fa84b68b4c2d None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:42.117168 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d665ff-ef2b-46ae-98ef-86887942d6e7 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:42.133181 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70477e4-36ba-4ffb-afbc-c4cd5cb75d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:42.134412 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70477e4-36ba-4ffb-afbc-c4cd5cb75d07 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:42.134902 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70477e4-36ba-4ffb-afbc-c4cd5cb75d07 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:42.135250 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70477e4-36ba-4ffb-afbc-c4cd5cb75d07 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:42.148522 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70477e4-36ba-4ffb-afbc-c4cd5cb75d07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:49:42.154673 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-a70477e4-36ba-4ffb-afbc-c4cd5cb75d07 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 10:49:42.154673 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:49:42.154673 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:49:42.154673 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:49:42.154673 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:49:42.154673 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:49:42.154673 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:49:42.154673 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:49:42.154673 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:49:42.154673 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:49:42.154673 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:49:42.154673 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:49:42.154673 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:49:42.154673 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:49:42.154673 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:49:42.154673 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:49:42.155581 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:49:42.155581 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:49:42.155581 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:49:42.155581 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:49:42.155581 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:49:42.155581 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:49:42.155581 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:49:42.155581 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:49:42.155581 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:49:42.155581 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:49:42.155581 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:49:42.155581 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:49:42.155581 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:49:42.155581 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:49:42.155581 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:49:42.155581 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:49:42.156367 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:49:42.156367 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:49:42.156367 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:49:42.156367 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:49:42.156367 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:49:42.156367 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:49:42.156367 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:49:42.156367 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:49:42.156367 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:49:42.156367 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:49:42.156367 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 10:49:42.156367 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:49:42.156367 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 191/367] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Aug 18 10:49:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:49:42.162247 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70477e4-36ba-4ffb-afbc-c4cd5cb75d07 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:42.166588 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cdd296-2379-4dcd-b99d-df5dcbd91be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:42.167626 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cdd296-2379-4dcd-b99d-df5dcbd91be7 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:42.168980 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cdd296-2379-4dcd-b99d-df5dcbd91be7 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:42.169465 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cdd296-2379-4dcd-b99d-df5dcbd91be7 None admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:42.170360 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cdd296-2379-4dcd-b99d-df5dcbd91be7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:49:42.170833 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cdd296-2379-4dcd-b99d-df5dcbd91be7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:42.172463 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cdd296-2379-4dcd-b99d-df5dcbd91be7 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:42.184539 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 177/368] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 18 10:49:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:42.186039 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cdd296-2379-4dcd-b99d-df5dcbd91be7 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:42.271714 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:42.322062 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70477e4-36ba-4ffb-afbc-c4cd5cb75d07 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:42.324892 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:42.359014 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cdd296-2379-4dcd-b99d-df5dcbd91be7 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:42.373728 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2836fff-2991-44aa-8fd6-92435cbd42a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:42.374969 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2836fff-2991-44aa-8fd6-92435cbd42a9 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:42.375397 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2836fff-2991-44aa-8fd6-92435cbd42a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:42.376143 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2836fff-2991-44aa-8fd6-92435cbd42a9 None admin] PATH_INFO: `/v3/projects/40e4bf42973a49f182b6ddf70bcb3bdf` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:42.377770 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2836fff-2991-44aa-8fd6-92435cbd42a9 None admin] RBAC: Authorizing `identity:get_project(project_id=40e4bf42973a49f182b6ddf70bcb3bdf)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:42.379526 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2836fff-2991-44aa-8fd6-92435cbd42a9 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:42.383041 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 192/369] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 18 10:49:42 2022] GET /identity/v3/projects/40e4bf42973a49f182b6ddf70bcb3bdf => generated 302 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:42.384656 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2836fff-2991-44aa-8fd6-92435cbd42a9 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:42.417645 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74348aa3-daec-4890-af28-8512c81a6a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:42.419171 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74348aa3-daec-4890-af28-8512c81a6a42 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:42.419171 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74348aa3-daec-4890-af28-8512c81a6a42 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:42.419171 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74348aa3-daec-4890-af28-8512c81a6a42 None admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:42.419875 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74348aa3-daec-4890-af28-8512c81a6a42 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:49:42.422918 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74348aa3-daec-4890-af28-8512c81a6a42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:42.424345 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74348aa3-daec-4890-af28-8512c81a6a42 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:42.442374 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 178/370] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 18 10:49:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:42.448008 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74348aa3-daec-4890-af28-8512c81a6a42 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:42.548189 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2836fff-2991-44aa-8fd6-92435cbd42a9 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:42.617023 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8fb52b-0cee-4081-95ed-21a87ab8db47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:42.618163 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8fb52b-0cee-4081-95ed-21a87ab8db47 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:42.618827 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8fb52b-0cee-4081-95ed-21a87ab8db47 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:42.619275 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8fb52b-0cee-4081-95ed-21a87ab8db47 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:42.621902 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74348aa3-daec-4890-af28-8512c81a6a42 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:42.644603 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:42.672440 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:42.675701 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f73a706-54a0-4c6b-a1cf-988c0154ad7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:42.676606 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73a706-54a0-4c6b-a1cf-988c0154ad7f None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:42.677130 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73a706-54a0-4c6b-a1cf-988c0154ad7f None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:42.677568 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73a706-54a0-4c6b-a1cf-988c0154ad7f None admin] PATH_INFO: `/v3/groups/318311d8271846a293a8abcf31026380` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:42.678867 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f73a706-54a0-4c6b-a1cf-988c0154ad7f None admin] RBAC: Authorizing `identity:get_group(group_id=318311d8271846a293a8abcf31026380)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:42.681704 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f73a706-54a0-4c6b-a1cf-988c0154ad7f None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:42.683791 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 179/371] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Aug 18 10:49:42 2022] GET /identity/v3/groups/318311d8271846a293a8abcf31026380 => generated 226 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:42.686140 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f73a706-54a0-4c6b-a1cf-988c0154ad7f None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:42.709328 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8fb52b-0cee-4081-95ed-21a87ab8db47 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:42.711045 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8fb52b-0cee-4081-95ed-21a87ab8db47 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:42.827079 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f73a706-54a0-4c6b-a1cf-988c0154ad7f None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:42.839552 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 193/372] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 18 10:49:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 10:49:42.841105 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8fb52b-0cee-4081-95ed-21a87ab8db47 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:42.878102 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f38fd6-9d05-4b69-9e4d-86fcc0c09fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:42.879016 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f38fd6-9d05-4b69-9e4d-86fcc0c09fa6 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:42.879607 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f38fd6-9d05-4b69-9e4d-86fcc0c09fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:42.880071 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f38fd6-9d05-4b69-9e4d-86fcc0c09fa6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:42.934373 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:42.956670 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:42.974406 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8fb52b-0cee-4081-95ed-21a87ab8db47 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:42.989967 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f38fd6-9d05-4b69-9e4d-86fcc0c09fa6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:42.996252 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f38fd6-9d05-4b69-9e4d-86fcc0c09fa6 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:43.023416 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ad7b1a-df6d-4277-8c6e-0283991e1ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:43.025067 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad7b1a-df6d-4277-8c6e-0283991e1ca0 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:43.025657 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad7b1a-df6d-4277-8c6e-0283991e1ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:43.026112 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad7b1a-df6d-4277-8c6e-0283991e1ca0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:43.027405 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ad7b1a-df6d-4277-8c6e-0283991e1ca0 None admin] RBAC: Adding query filter params (group.id=318311d8271846a293a8abcf31026380, role.id=719e5c62188d4f8a838987d6e72ca8f7, scope.project.id=40e4bf42973a49f182b6ddf70bcb3bdf) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:49:43.027898 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ad7b1a-df6d-4277-8c6e-0283991e1ca0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:43.029553 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ad7b1a-df6d-4277-8c6e-0283991e1ca0 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:43.035763 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 194/373] 10.222.0.15 () {56 vars in 1376 bytes} [Thu Aug 18 10:49:42 2022] GET /identity/v3/role_assignments?group.id=318311d8271846a293a8abcf31026380&scope.project.id=40e4bf42973a49f182b6ddf70bcb3bdf&role.id=719e5c62188d4f8a838987d6e72ca8f7 => generated 260 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:43.036852 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ad7b1a-df6d-4277-8c6e-0283991e1ca0 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:43.192530 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ad7b1a-df6d-4277-8c6e-0283991e1ca0 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:43.238143 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 180/374] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 18 10:49:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 554 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 10:49:43.244684 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f38fd6-9d05-4b69-9e4d-86fcc0c09fa6 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:43.263248 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8fa7dc-ed0f-40fd-8d4f-d5aafe376ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:43.263893 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8fa7dc-ed0f-40fd-8d4f-d5aafe376ace None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:43.264176 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8fa7dc-ed0f-40fd-8d4f-d5aafe376ace None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:43.264453 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8fa7dc-ed0f-40fd-8d4f-d5aafe376ace None admin] PATH_INFO: `/v3/projects/8a5400fd95e746d7a23658c890ad84cd` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:43.266344 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8fa7dc-ed0f-40fd-8d4f-d5aafe376ace None admin] RBAC: Authorizing `identity:get_project(project_id=8a5400fd95e746d7a23658c890ad84cd)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:43.267797 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8fa7dc-ed0f-40fd-8d4f-d5aafe376ace None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:43.273657 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 195/375] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 18 10:49:43 2022] GET /identity/v3/projects/8a5400fd95e746d7a23658c890ad84cd => generated 344 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:43.277361 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8fa7dc-ed0f-40fd-8d4f-d5aafe376ace None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:43.280921 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:43.369388 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:43.404276 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f38fd6-9d05-4b69-9e4d-86fcc0c09fa6 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:43.447817 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8fa7dc-ed0f-40fd-8d4f-d5aafe376ace None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:43.487162 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4f9180-835c-41aa-a616-9f822149321c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:43.488112 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f9180-835c-41aa-a616-9f822149321c None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:43.488509 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f9180-835c-41aa-a616-9f822149321c None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:43.488873 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f9180-835c-41aa-a616-9f822149321c None admin] PATH_INFO: `/v3/projects/40e4bf42973a49f182b6ddf70bcb3bdf` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:43.489345 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b42e098-6dfb-412b-b48b-b79a08da6d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:43.490154 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42e098-6dfb-412b-b48b-b79a08da6d51 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:43.490392 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4f9180-835c-41aa-a616-9f822149321c None admin] RBAC: Authorizing `identity:get_project(project_id=40e4bf42973a49f182b6ddf70bcb3bdf)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:43.490770 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42e098-6dfb-412b-b48b-b79a08da6d51 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:43.491177 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42e098-6dfb-412b-b48b-b79a08da6d51 None admin] PATH_INFO: `/v3/groups/5b0c70710f494d7bb598b2711c3669cd` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:43.492136 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4f9180-835c-41aa-a616-9f822149321c None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:43.497445 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b42e098-6dfb-412b-b48b-b79a08da6d51 None admin] RBAC: Authorizing `identity:get_group(group_id=5b0c70710f494d7bb598b2711c3669cd)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:43.499209 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b42e098-6dfb-412b-b48b-b79a08da6d51 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:43.500028 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 181/376] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 18 10:49:43 2022] GET /identity/v3/projects/40e4bf42973a49f182b6ddf70bcb3bdf => generated 302 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 10:49:43.501549 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 196/377] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Aug 18 10:49:43 2022] GET /identity/v3/groups/5b0c70710f494d7bb598b2711c3669cd => generated 229 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:43.511728 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4f9180-835c-41aa-a616-9f822149321c None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:43.513034 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b42e098-6dfb-412b-b48b-b79a08da6d51 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:43.663911 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:43.715682 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b42e098-6dfb-412b-b48b-b79a08da6d51 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:43.716470 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4f9180-835c-41aa-a616-9f822149321c None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:43.754840 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0cea9c-7b2c-4a32-99df-51b918e11a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:43.755886 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0cea9c-7b2c-4a32-99df-51b918e11a19 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:43.756315 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0cea9c-7b2c-4a32-99df-51b918e11a19 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:43.756648 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0cea9c-7b2c-4a32-99df-51b918e11a19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:43.757436 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0cea9c-7b2c-4a32-99df-51b918e11a19 None admin] RBAC: Adding query filter params (group.id=5b0c70710f494d7bb598b2711c3669cd, role.id=127fdc7ef05b4e0b98a940b334e5fcab, scope.project.id=8a5400fd95e746d7a23658c890ad84cd) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:49:43.757820 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0cea9c-7b2c-4a32-99df-51b918e11a19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:43.759844 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0cea9c-7b2c-4a32-99df-51b918e11a19 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:43.767792 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 197/378] 10.222.0.15 () {56 vars in 1376 bytes} [Thu Aug 18 10:49:43 2022] GET /identity/v3/role_assignments?group.id=5b0c70710f494d7bb598b2711c3669cd&scope.project.id=8a5400fd95e746d7a23658c890ad84cd&role.id=127fdc7ef05b4e0b98a940b334e5fcab => generated 260 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:43.770402 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83beac0f-bb46-4bcb-a639-a997f8406481 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:43.770811 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83beac0f-bb46-4bcb-a639-a997f8406481 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:43.771094 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83beac0f-bb46-4bcb-a639-a997f8406481 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:43.772839 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 198/379] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:49:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:49:43.781843 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9720ef7c-8657-4eff-84f6-26848720443f None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:43.782168 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9720ef7c-8657-4eff-84f6-26848720443f None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:43.782418 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9720ef7c-8657-4eff-84f6-26848720443f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:43.785669 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516d177a-21ca-435a-aa12-b9881e9eb9ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:43.786311 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d177a-21ca-435a-aa12-b9881e9eb9ee None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:43.786589 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d177a-21ca-435a-aa12-b9881e9eb9ee None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:43.786860 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d177a-21ca-435a-aa12-b9881e9eb9ee None admin] PATH_INFO: `/v3/groups/318311d8271846a293a8abcf31026380` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:43.788524 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516d177a-21ca-435a-aa12-b9881e9eb9ee None admin] RBAC: Authorizing `identity:get_group(group_id=318311d8271846a293a8abcf31026380)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:43.791153 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516d177a-21ca-435a-aa12-b9881e9eb9ee None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:43.793228 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 182/380] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Aug 18 10:49:43 2022] GET /identity/v3/groups/318311d8271846a293a8abcf31026380 => generated 226 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:43.799347 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516d177a-21ca-435a-aa12-b9881e9eb9ee None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:43.815102 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-9720ef7c-8657-4eff-84f6-26848720443f None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:49:43.816371 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-9720ef7c-8657-4eff-84f6-26848720443f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:49:43.842761 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:43.951136 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 199/381] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:49:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 10:49:43.973570 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516d177a-21ca-435a-aa12-b9881e9eb9ee None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:44.011909 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a9fb4c-1047-49a8-b411-2649944766b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:44.012529 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a9fb4c-1047-49a8-b411-2649944766b7 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:44.012808 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a9fb4c-1047-49a8-b411-2649944766b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:44.013081 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a9fb4c-1047-49a8-b411-2649944766b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:44.013850 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a9fb4c-1047-49a8-b411-2649944766b7 None admin] RBAC: Adding query filter params (group.id=318311d8271846a293a8abcf31026380, role.id=0ecb6b324fc643f3826b2878f2f6174b, scope.project.id=40e4bf42973a49f182b6ddf70bcb3bdf) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:49:44.014160 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a9fb4c-1047-49a8-b411-2649944766b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:44.015587 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a9fb4c-1047-49a8-b411-2649944766b7 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:44.021807 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 183/382] 10.222.0.15 () {56 vars in 1376 bytes} [Thu Aug 18 10:49:43 2022] GET /identity/v3/role_assignments?group.id=318311d8271846a293a8abcf31026380&scope.project.id=40e4bf42973a49f182b6ddf70bcb3bdf&role.id=0ecb6b324fc643f3826b2878f2f6174b => generated 260 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:44.152865 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d481efbe-909a-4e81-a5ce-94e4c84c1374 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:44.153151 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d481efbe-909a-4e81-a5ce-94e4c84c1374 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:44.153432 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d481efbe-909a-4e81-a5ce-94e4c84c1374 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:44.155079 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 200/383] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:49:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:49:44.160191 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c0f155-51fc-4620-89ed-59d5d9f23288 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:44.160477 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c0f155-51fc-4620-89ed-59d5d9f23288 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:44.160750 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c0f155-51fc-4620-89ed-59d5d9f23288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:44.182228 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-33c0f155-51fc-4620-89ed-59d5d9f23288 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:49:44.183460 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-33c0f155-51fc-4620-89ed-59d5d9f23288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:49:44.272090 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 184/384] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:49:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 10:49:44.299987 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d481efbe-909a-4e81-a5ce-94e4c84c1374 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:44.369229 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:44.416525 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d481efbe-909a-4e81-a5ce-94e4c84c1374 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:44.455156 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e7d9e1-02ab-4aa4-a4a4-9365dc074710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:44.455796 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e7d9e1-02ab-4aa4-a4a4-9365dc074710 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:44.456074 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e7d9e1-02ab-4aa4-a4a4-9365dc074710 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:44.456346 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e7d9e1-02ab-4aa4-a4a4-9365dc074710 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:44.469420 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e7d9e1-02ab-4aa4-a4a4-9365dc074710 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:49:44.474514 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-d2e7d9e1-02ab-4aa4-a4a4-9365dc074710 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 10:49:44.474514 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:49:44.474514 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:49:44.474514 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:49:44.474514 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:49:44.474514 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:49:44.474514 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:49:44.474514 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:49:44.474514 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:49:44.474514 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:49:44.474514 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:49:44.474514 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:49:44.474514 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:49:44.474514 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:49:44.474514 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:49:44.474514 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:49:44.475413 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:49:44.475413 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:49:44.475413 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:49:44.475413 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:49:44.475413 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:49:44.475413 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:49:44.475413 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:49:44.475413 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:49:44.475413 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:49:44.475413 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:49:44.475413 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:49:44.475413 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:49:44.475413 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:49:44.475413 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:49:44.475413 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:49:44.475413 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:49:44.476189 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:49:44.476189 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:49:44.476189 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:49:44.476189 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:49:44.476189 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:49:44.476189 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:49:44.476189 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:49:44.476189 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:49:44.476189 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:49:44.476189 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:49:44.476189 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 10:49:44.476189 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:49:44.478713 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 201/385] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 18 10:49:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:49:44.484750 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c0f155-51fc-4620-89ed-59d5d9f23288 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:44.512256 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:44.578895 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e7d9e1-02ab-4aa4-a4a4-9365dc074710 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:44.649499 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c0f155-51fc-4620-89ed-59d5d9f23288 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:44.705097 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e7d9e1-02ab-4aa4-a4a4-9365dc074710 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:44.726235 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:44.728535 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799c2aa3-4919-449b-b40d-6e52cb1ea146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:44.730391 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c2aa3-4919-449b-b40d-6e52cb1ea146 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:44.730907 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c2aa3-4919-449b-b40d-6e52cb1ea146 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:44.731381 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c2aa3-4919-449b-b40d-6e52cb1ea146 None admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:44.732265 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799c2aa3-4919-449b-b40d-6e52cb1ea146 None admin] RBAC: Adding query filter params (name=member) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:49:44.732769 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799c2aa3-4919-449b-b40d-6e52cb1ea146 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:44.734410 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799c2aa3-4919-449b-b40d-6e52cb1ea146 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:44.752174 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 185/386] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Aug 18 10:49:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:44.759731 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799c2aa3-4919-449b-b40d-6e52cb1ea146 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:44.775213 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b487d6b9-149c-41ce-8d5d-d3366a912611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:44.775869 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487d6b9-149c-41ce-8d5d-d3366a912611 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:44.776143 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487d6b9-149c-41ce-8d5d-d3366a912611 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:44.776412 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487d6b9-149c-41ce-8d5d-d3366a912611 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:44.814459 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b487d6b9-149c-41ce-8d5d-d3366a912611 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:49:44.825284 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-b487d6b9-149c-41ce-8d5d-d3366a912611 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 10:49:44.825284 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:49:44.825284 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:49:44.825284 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:49:44.825284 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:49:44.825284 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:49:44.825284 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:49:44.825284 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:49:44.825284 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:49:44.825284 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:49:44.825284 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:49:44.825284 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:49:44.825284 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:49:44.825284 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:49:44.825284 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:49:44.825284 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:49:44.826256 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:49:44.826256 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:49:44.826256 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:49:44.826256 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:49:44.826256 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:49:44.826256 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:49:44.826256 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:49:44.826256 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:49:44.826256 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:49:44.826256 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:49:44.826256 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:49:44.826256 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:49:44.826256 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:49:44.826256 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:49:44.826256 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:49:44.826256 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:49:44.827025 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:49:44.827025 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:49:44.827025 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:49:44.827025 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:49:44.827025 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:49:44.827025 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:49:44.827025 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:49:44.827025 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:49:44.827025 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:49:44.827025 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:49:44.827025 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 10:49:44.827025 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:49:44.832108 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 202/387] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Aug 18 10:49:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 10:49:44.842414 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b487d6b9-149c-41ce-8d5d-d3366a912611 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:44.949899 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:44.983247 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799c2aa3-4919-449b-b40d-6e52cb1ea146 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:45.050511 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b487d6b9-149c-41ce-8d5d-d3366a912611 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:45.054289 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bedab78-a11d-4510-8fe5-e2fe39216f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:45.054976 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bedab78-a11d-4510-8fe5-e2fe39216f4d None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:45.055262 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bedab78-a11d-4510-8fe5-e2fe39216f4d None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:45.055539 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bedab78-a11d-4510-8fe5-e2fe39216f4d None admin] PATH_INFO: `/v3/groups/318311d8271846a293a8abcf31026380` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:45.056946 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bedab78-a11d-4510-8fe5-e2fe39216f4d None admin] RBAC: Authorizing `identity:get_group(group_id=318311d8271846a293a8abcf31026380)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:45.058421 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bedab78-a11d-4510-8fe5-e2fe39216f4d None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:45.060501 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 186/388] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Aug 18 10:49:44 2022] GET /identity/v3/groups/318311d8271846a293a8abcf31026380 => generated 226 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:45.065975 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bedab78-a11d-4510-8fe5-e2fe39216f4d None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:45.088275 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472d2ecd-56c8-42d2-870c-54ca35ad94ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:45.088810 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d2ecd-56c8-42d2-870c-54ca35ad94ad None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:45.089086 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d2ecd-56c8-42d2-870c-54ca35ad94ad None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:45.089360 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d2ecd-56c8-42d2-870c-54ca35ad94ad None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:45.090123 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472d2ecd-56c8-42d2-870c-54ca35ad94ad None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:49:45.090424 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472d2ecd-56c8-42d2-870c-54ca35ad94ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:45.091862 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472d2ecd-56c8-42d2-870c-54ca35ad94ad None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:45.103138 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 203/389] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 18 10:49:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 10:49:45.110229 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472d2ecd-56c8-42d2-870c-54ca35ad94ad None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:45.198005 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:45.264479 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bedab78-a11d-4510-8fe5-e2fe39216f4d None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:45.314606 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472d2ecd-56c8-42d2-870c-54ca35ad94ad None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:45.320372 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f45cf08-926c-472f-8aad-1b08397cd505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:45.322624 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f45cf08-926c-472f-8aad-1b08397cd505 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:45.327322 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f45cf08-926c-472f-8aad-1b08397cd505 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:45.327846 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f45cf08-926c-472f-8aad-1b08397cd505 None admin] PATH_INFO: `/v3/projects/db515fd18ab64bc190c7a76ae5f7e632` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:45.329372 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f45cf08-926c-472f-8aad-1b08397cd505 None admin] RBAC: Authorizing `identity:get_project(project_id=db515fd18ab64bc190c7a76ae5f7e632)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:45.331455 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f45cf08-926c-472f-8aad-1b08397cd505 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:45.334985 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 187/390] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 18 10:49:45 2022] GET /identity/v3/projects/db515fd18ab64bc190c7a76ae5f7e632 => generated 298 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:45.343067 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f45cf08-926c-472f-8aad-1b08397cd505 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:45.377886 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:45.396047 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74459b96-47f0-40c0-bf0f-f33331b7e39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:45.396688 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74459b96-47f0-40c0-bf0f-f33331b7e39f None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:45.396970 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74459b96-47f0-40c0-bf0f-f33331b7e39f None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:45.397247 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74459b96-47f0-40c0-bf0f-f33331b7e39f None admin] PATH_INFO: `/v3/groups/318311d8271846a293a8abcf31026380` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:45.400474 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74459b96-47f0-40c0-bf0f-f33331b7e39f None admin] RBAC: Authorizing `identity:get_group(group_id=318311d8271846a293a8abcf31026380)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:45.402929 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74459b96-47f0-40c0-bf0f-f33331b7e39f None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:45.406577 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 204/391] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Aug 18 10:49:45 2022] GET /identity/v3/groups/318311d8271846a293a8abcf31026380 => generated 226 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:45.413632 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74459b96-47f0-40c0-bf0f-f33331b7e39f None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:45.553551 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f45cf08-926c-472f-8aad-1b08397cd505 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:45.563761 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74459b96-47f0-40c0-bf0f-f33331b7e39f None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:45.577433 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:45.604713 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c1ef6f-f9dd-4fa4-94ad-f867eb74c781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:45.605266 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1ef6f-f9dd-4fa4-94ad-f867eb74c781 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:45.605563 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1ef6f-f9dd-4fa4-94ad-f867eb74c781 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:45.605845 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1ef6f-f9dd-4fa4-94ad-f867eb74c781 None admin] PATH_INFO: `/v3/projects/db515fd18ab64bc190c7a76ae5f7e632` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:45.609198 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c1ef6f-f9dd-4fa4-94ad-f867eb74c781 None admin] RBAC: Authorizing `identity:get_project(project_id=db515fd18ab64bc190c7a76ae5f7e632)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:45.610678 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c1ef6f-f9dd-4fa4-94ad-f867eb74c781 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:45.612911 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 205/392] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 18 10:49:45 2022] GET /identity/v3/projects/db515fd18ab64bc190c7a76ae5f7e632 => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:45.617023 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1f0660-7043-48a6-ab46-5c56e66b4e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:45.617778 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f0660-7043-48a6-ab46-5c56e66b4e3a None admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:45.618059 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f0660-7043-48a6-ab46-5c56e66b4e3a None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:45.618335 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f0660-7043-48a6-ab46-5c56e66b4e3a None admin] PATH_INFO: `/v3/projects/db515fd18ab64bc190c7a76ae5f7e632/groups/318311d8271846a293a8abcf31026380/roles/719e5c62188d4f8a838987d6e72ca8f7` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:45.620101 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c1ef6f-f9dd-4fa4-94ad-f867eb74c781 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:45.627767 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1f0660-7043-48a6-ab46-5c56e66b4e3a None admin] RBAC: Authorizing `identity:create_grant(project_id=db515fd18ab64bc190c7a76ae5f7e632, group_id=318311d8271846a293a8abcf31026380, role_id=719e5c62188d4f8a838987d6e72ca8f7)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:45.629217 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1f0660-7043-48a6-ab46-5c56e66b4e3a None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:45.655802 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 188/393] 10.222.0.15 () {58 vars in 1442 bytes} [Thu Aug 18 10:49:45 2022] PUT /identity/v3/projects/db515fd18ab64bc190c7a76ae5f7e632/groups/318311d8271846a293a8abcf31026380/roles/719e5c62188d4f8a838987d6e72ca8f7 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 10:49:45.662474 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582dd347-2796-4b25-bef6-a7dc0e16aa94 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:45.662789 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582dd347-2796-4b25-bef6-a7dc0e16aa94 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:45.663020 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582dd347-2796-4b25-bef6-a7dc0e16aa94 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:45.665918 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 189/394] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:49:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:49:45.674783 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f4e916-5967-4217-9e01-a6382fb9c113 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:45.675107 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f4e916-5967-4217-9e01-a6382fb9c113 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:45.675329 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f4e916-5967-4217-9e01-a6382fb9c113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:45.714483 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-96f4e916-5967-4217-9e01-a6382fb9c113 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:49:45.718061 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-96f4e916-5967-4217-9e01-a6382fb9c113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:49:45.817353 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c1ef6f-f9dd-4fa4-94ad-f867eb74c781 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:45.855343 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:45.865809 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 190/395] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:49:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 10:49:45.877924 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b608750-51df-49c1-ae63-a5436180b40d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:45.878615 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b608750-51df-49c1-ae63-a5436180b40d None admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:45.878947 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b608750-51df-49c1-ae63-a5436180b40d None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:45.879230 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b608750-51df-49c1-ae63-a5436180b40d None admin] PATH_INFO: `/v3/projects/db515fd18ab64bc190c7a76ae5f7e632/groups/318311d8271846a293a8abcf31026380/roles/0ecb6b324fc643f3826b2878f2f6174b` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:45.882762 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b608750-51df-49c1-ae63-a5436180b40d None admin] RBAC: Authorizing `identity:create_grant(project_id=db515fd18ab64bc190c7a76ae5f7e632, group_id=318311d8271846a293a8abcf31026380, role_id=0ecb6b324fc643f3826b2878f2f6174b)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:45.884220 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b608750-51df-49c1-ae63-a5436180b40d None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:45.901836 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 206/396] 10.222.0.15 () {58 vars in 1442 bytes} [Thu Aug 18 10:49:45 2022] PUT /identity/v3/projects/db515fd18ab64bc190c7a76ae5f7e632/groups/318311d8271846a293a8abcf31026380/roles/0ecb6b324fc643f3826b2878f2f6174b => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 10:49:46.181203 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f4e916-5967-4217-9e01-a6382fb9c113 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:46.297151 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f4e916-5967-4217-9e01-a6382fb9c113 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:46.339672 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1760a1cc-df87-49da-8f71-6e91ba6af7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:46.340377 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1760a1cc-df87-49da-8f71-6e91ba6af7df None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:46.340658 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1760a1cc-df87-49da-8f71-6e91ba6af7df None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:46.340929 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1760a1cc-df87-49da-8f71-6e91ba6af7df None admin] PATH_INFO: `/v3/roles/member` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:46.356660 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1760a1cc-df87-49da-8f71-6e91ba6af7df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:49:46.361417 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-1760a1cc-df87-49da-8f71-6e91ba6af7df None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 10:49:46.361417 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:49:46.361417 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:49:46.361417 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:49:46.361417 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:49:46.361417 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:49:46.361417 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:49:46.361417 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:49:46.361417 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:49:46.361417 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:49:46.361417 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:49:46.361417 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:49:46.361417 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:49:46.361417 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:49:46.361417 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:49:46.361417 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:49:46.362373 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:49:46.362373 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:49:46.362373 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:49:46.362373 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:49:46.362373 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:49:46.362373 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:49:46.362373 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:49:46.362373 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:49:46.362373 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:49:46.362373 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:49:46.362373 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:49:46.362373 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:49:46.362373 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:49:46.362373 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:49:46.362373 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:49:46.362373 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:49:46.363192 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:49:46.363192 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:49:46.363192 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:49:46.363192 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:49:46.363192 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:49:46.363192 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:49:46.363192 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:49:46.363192 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:49:46.363192 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:49:46.363192 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:49:46.363192 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 10:49:46.363192 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:49:46.363192 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 191/397] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 18 10:49:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:49:46.369022 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b608750-51df-49c1-ae63-a5436180b40d None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:46.401586 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b69547-bae3-4325-80f5-4c3feda8d20b None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:46.401586 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b69547-bae3-4325-80f5-4c3feda8d20b None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:46.401586 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b69547-bae3-4325-80f5-4c3feda8d20b None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:46.403243 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 192/398] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:49:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:49:46.408667 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f45a5c-8a2b-42e4-98e4-0801c31e73c2 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:46.409261 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f45a5c-8a2b-42e4-98e4-0801c31e73c2 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:46.409790 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f45a5c-8a2b-42e4-98e4-0801c31e73c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:46.429396 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-18f45a5c-8a2b-42e4-98e4-0801c31e73c2 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:49:46.431624 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-18f45a5c-8a2b-42e4-98e4-0801c31e73c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:49:46.437903 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:46.482976 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b608750-51df-49c1-ae63-a5436180b40d None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:46.496056 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:46.514329 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 193/399] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:49:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 10:49:46.521806 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9df8e5-f1a0-4596-bab1-893a0ef1c042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:46.522672 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9df8e5-f1a0-4596-bab1-893a0ef1c042 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:46.522950 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9df8e5-f1a0-4596-bab1-893a0ef1c042 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:46.523277 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9df8e5-f1a0-4596-bab1-893a0ef1c042 None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:46.524560 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9df8e5-f1a0-4596-bab1-893a0ef1c042 None admin] RBAC: Adding query filter params (name=member) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:49:46.524880 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9df8e5-f1a0-4596-bab1-893a0ef1c042 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:46.526259 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9df8e5-f1a0-4596-bab1-893a0ef1c042 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:46.535540 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 207/400] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Aug 18 10:49:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:46.541684 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f45a5c-8a2b-42e4-98e4-0801c31e73c2 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:46.653786 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f45a5c-8a2b-42e4-98e4-0801c31e73c2 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:46.694197 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0f7773-f3eb-4707-80ec-22611658e221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:46.695200 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0f7773-f3eb-4707-80ec-22611658e221 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:46.696273 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0f7773-f3eb-4707-80ec-22611658e221 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:46.696761 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0f7773-f3eb-4707-80ec-22611658e221 None admin] PATH_INFO: `/v3/groups/318311d8271846a293a8abcf31026380` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:46.698246 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0f7773-f3eb-4707-80ec-22611658e221 None admin] RBAC: Authorizing `identity:get_group(group_id=318311d8271846a293a8abcf31026380)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:46.699977 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0f7773-f3eb-4707-80ec-22611658e221 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:46.701932 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 194/401] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Aug 18 10:49:46 2022] GET /identity/v3/groups/318311d8271846a293a8abcf31026380 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:46.707695 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9df8e5-f1a0-4596-bab1-893a0ef1c042 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:46.808537 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0f7773-f3eb-4707-80ec-22611658e221 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:46.866117 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:46.870543 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9df8e5-f1a0-4596-bab1-893a0ef1c042 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:46.878647 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:46.918376 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f56fb6-bb91-4d5d-85e8-1ef20f1c128a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:46.919181 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f56fb6-bb91-4d5d-85e8-1ef20f1c128a None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:46.919829 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f56fb6-bb91-4d5d-85e8-1ef20f1c128a None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:46.920206 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f56fb6-bb91-4d5d-85e8-1ef20f1c128a None admin] PATH_INFO: `/v3/projects/40e4bf42973a49f182b6ddf70bcb3bdf` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:46.921780 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f56fb6-bb91-4d5d-85e8-1ef20f1c128a None admin] RBAC: Authorizing `identity:get_project(project_id=40e4bf42973a49f182b6ddf70bcb3bdf)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:46.924032 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f56fb6-bb91-4d5d-85e8-1ef20f1c128a None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:46.926949 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 208/402] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 18 10:49:46 2022] GET /identity/v3/projects/40e4bf42973a49f182b6ddf70bcb3bdf => generated 302 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:46.928044 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31effb80-d13a-4523-b408-a880a4e0c5d0 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:46.928668 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31effb80-d13a-4523-b408-a880a4e0c5d0 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:46.929043 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31effb80-d13a-4523-b408-a880a4e0c5d0 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:46.935270 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 209/403] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:49:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:49:46.935270 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31effb80-d13a-4523-b408-a880a4e0c5d0 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:46.937078 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0f7773-f3eb-4707-80ec-22611658e221 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:46.977892 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed024542-60e5-4eaa-a04c-31584821cc82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:46.978787 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed024542-60e5-4eaa-a04c-31584821cc82 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:46.979216 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed024542-60e5-4eaa-a04c-31584821cc82 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:46.979648 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed024542-60e5-4eaa-a04c-31584821cc82 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:46.991901 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed024542-60e5-4eaa-a04c-31584821cc82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:49:46.997742 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-ed024542-60e5-4eaa-a04c-31584821cc82 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 10:49:46.997742 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:49:46.997742 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:49:46.997742 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:49:46.997742 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:49:46.997742 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:49:46.997742 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:49:46.997742 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:49:46.997742 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:49:46.997742 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:49:46.997742 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:49:46.997742 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:49:46.997742 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:49:46.997742 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:49:46.997742 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:49:46.997742 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:49:46.998655 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:49:46.998655 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:49:46.998655 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:49:46.998655 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:49:46.998655 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:49:46.998655 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:49:46.998655 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:49:46.998655 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:49:46.998655 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:49:46.998655 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:49:46.998655 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:49:46.998655 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:49:46.998655 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:49:46.998655 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:49:46.998655 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:49:46.998655 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:49:46.999442 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:49:46.999442 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:49:46.999442 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:49:46.999442 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:49:46.999442 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:49:46.999442 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:49:46.999442 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:49:46.999442 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:49:46.999442 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:49:46.999442 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:49:46.999442 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 10:49:46.999442 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:49:47.002158 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 195/404] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Aug 18 10:49:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:49:47.003665 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb509ce1-53ff-49b7-a218-fb1b0e534363 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:47.004164 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb509ce1-53ff-49b7-a218-fb1b0e534363 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:47.004639 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb509ce1-53ff-49b7-a218-fb1b0e534363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:47.025487 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-cb509ce1-53ff-49b7-a218-fb1b0e534363 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:49:47.027033 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-cb509ce1-53ff-49b7-a218-fb1b0e534363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:49:47.072425 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31effb80-d13a-4523-b408-a880a4e0c5d0 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:47.109874 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 196/405] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:49:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 10:49:47.111384 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb509ce1-53ff-49b7-a218-fb1b0e534363 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:47.114570 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d298ed-77a2-4c15-a7e8-009209e8d556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:47.118011 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d298ed-77a2-4c15-a7e8-009209e8d556 None admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:47.118011 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d298ed-77a2-4c15-a7e8-009209e8d556 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:47.118011 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d298ed-77a2-4c15-a7e8-009209e8d556 None admin] PATH_INFO: `/v3/projects/40e4bf42973a49f182b6ddf70bcb3bdf/groups/318311d8271846a293a8abcf31026380/roles/719e5c62188d4f8a838987d6e72ca8f7` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:47.118473 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d298ed-77a2-4c15-a7e8-009209e8d556 None admin] RBAC: Authorizing `identity:create_grant(project_id=40e4bf42973a49f182b6ddf70bcb3bdf, group_id=318311d8271846a293a8abcf31026380, role_id=719e5c62188d4f8a838987d6e72ca8f7)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:47.120953 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d298ed-77a2-4c15-a7e8-009209e8d556 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:47.138528 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 210/406] 10.222.0.15 () {58 vars in 1442 bytes} [Thu Aug 18 10:49:46 2022] PUT /identity/v3/projects/40e4bf42973a49f182b6ddf70bcb3bdf/groups/318311d8271846a293a8abcf31026380/roles/719e5c62188d4f8a838987d6e72ca8f7 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 10:49:47.230657 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:47.313777 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb509ce1-53ff-49b7-a218-fb1b0e534363 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:47.355672 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8069e63a-386d-4318-ab38-0285c0025608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:47.356321 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069e63a-386d-4318-ab38-0285c0025608 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:47.356549 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069e63a-386d-4318-ab38-0285c0025608 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:47.356822 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069e63a-386d-4318-ab38-0285c0025608 None admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:47.357498 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8069e63a-386d-4318-ab38-0285c0025608 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:49:47.357825 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8069e63a-386d-4318-ab38-0285c0025608 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:47.359201 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8069e63a-386d-4318-ab38-0285c0025608 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:47.371073 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 197/407] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 18 10:49:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:47.376374 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d298ed-77a2-4c15-a7e8-009209e8d556 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:47.414932 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:47.504496 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8069e63a-386d-4318-ab38-0285c0025608 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:47.520945 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d298ed-77a2-4c15-a7e8-009209e8d556 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:47.562915 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00af8b23-f811-45ec-9550-894d3fd2dba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:47.563565 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af8b23-f811-45ec-9550-894d3fd2dba8 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:47.563846 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af8b23-f811-45ec-9550-894d3fd2dba8 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:47.564119 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af8b23-f811-45ec-9550-894d3fd2dba8 None admin] PATH_INFO: `/v3/groups/5b0c70710f494d7bb598b2711c3669cd` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:47.568475 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00af8b23-f811-45ec-9550-894d3fd2dba8 None admin] RBAC: Authorizing `identity:get_group(group_id=5b0c70710f494d7bb598b2711c3669cd)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:47.569956 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00af8b23-f811-45ec-9550-894d3fd2dba8 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:47.572078 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 211/408] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Aug 18 10:49:47 2022] GET /identity/v3/groups/5b0c70710f494d7bb598b2711c3669cd => generated 229 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:47.582785 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00af8b23-f811-45ec-9550-894d3fd2dba8 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:47.692742 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8069e63a-386d-4318-ab38-0285c0025608 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:47.704668 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:47.744592 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359f3518-f78a-489d-8366-c9fefd56b072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:47.745344 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359f3518-f78a-489d-8366-c9fefd56b072 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:47.745658 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359f3518-f78a-489d-8366-c9fefd56b072 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:47.745933 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359f3518-f78a-489d-8366-c9fefd56b072 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:47.770594 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359f3518-f78a-489d-8366-c9fefd56b072 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:49:47.782497 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-359f3518-f78a-489d-8366-c9fefd56b072 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 10:49:47.782497 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:49:47.782497 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:49:47.782497 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:49:47.782497 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:49:47.782497 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:49:47.782497 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:49:47.782497 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:49:47.782497 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:49:47.782497 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:49:47.782497 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:49:47.782497 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:49:47.782497 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:49:47.782497 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:49:47.782497 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:49:47.782497 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:49:47.783453 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:49:47.783453 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:49:47.783453 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:49:47.783453 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:49:47.783453 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:49:47.783453 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:49:47.783453 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:49:47.783453 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:49:47.783453 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:49:47.783453 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:49:47.783453 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:49:47.783453 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:49:47.783453 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:49:47.783453 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:49:47.783453 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:49:47.783453 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:49:47.784250 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:49:47.784250 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:49:47.784250 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:49:47.784250 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:49:47.784250 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:49:47.784250 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:49:47.784250 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:49:47.784250 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:49:47.784250 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:49:47.784250 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:49:47.784250 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 10:49:47.784250 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:49:47.788661 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:47.788891 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 198/409] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Aug 18 10:49:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:49:47.793874 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00af8b23-f811-45ec-9550-894d3fd2dba8 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:47.796330 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359f3518-f78a-489d-8366-c9fefd56b072 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:47.847825 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88959324-5ddc-4db4-b4a0-0075e0307dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:47.848489 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88959324-5ddc-4db4-b4a0-0075e0307dda None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:47.848768 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88959324-5ddc-4db4-b4a0-0075e0307dda None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:47.849044 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88959324-5ddc-4db4-b4a0-0075e0307dda None admin] PATH_INFO: `/v3/projects/8a5400fd95e746d7a23658c890ad84cd` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:47.851952 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88959324-5ddc-4db4-b4a0-0075e0307dda None admin] RBAC: Authorizing `identity:get_project(project_id=8a5400fd95e746d7a23658c890ad84cd)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:47.853648 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88959324-5ddc-4db4-b4a0-0075e0307dda None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:47.855675 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 212/410] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 18 10:49:47 2022] GET /identity/v3/projects/8a5400fd95e746d7a23658c890ad84cd => generated 344 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:47.875613 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88959324-5ddc-4db4-b4a0-0075e0307dda None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:47.955489 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359f3518-f78a-489d-8366-c9fefd56b072 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:47.994902 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f644303-1b77-45b4-b727-372432a99c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:47.995976 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f644303-1b77-45b4-b727-372432a99c71 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:47.996415 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f644303-1b77-45b4-b727-372432a99c71 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:47.996696 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f644303-1b77-45b4-b727-372432a99c71 None admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:47.997373 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f644303-1b77-45b4-b727-372432a99c71 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:49:47.997717 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f644303-1b77-45b4-b727-372432a99c71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:47.999108 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f644303-1b77-45b4-b727-372432a99c71 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:48.009212 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 199/411] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 18 10:49:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:48.015241 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f644303-1b77-45b4-b727-372432a99c71 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:48.051188 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:48.146768 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88959324-5ddc-4db4-b4a0-0075e0307dda None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:48.163327 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f644303-1b77-45b4-b727-372432a99c71 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:48.226885 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7db30c5-672a-446e-9451-6547bc637bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:48.227873 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db30c5-672a-446e-9451-6547bc637bef None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:48.228347 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db30c5-672a-446e-9451-6547bc637bef None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:48.228813 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db30c5-672a-446e-9451-6547bc637bef None admin] PATH_INFO: `/v3/groups/318311d8271846a293a8abcf31026380` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:48.230185 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7db30c5-672a-446e-9451-6547bc637bef None admin] RBAC: Authorizing `identity:get_group(group_id=318311d8271846a293a8abcf31026380)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:48.230290 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1da2a6c-c17d-4e47-ab6a-3aaefcccb817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:48.230910 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1da2a6c-c17d-4e47-ab6a-3aaefcccb817 None admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:48.231196 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1da2a6c-c17d-4e47-ab6a-3aaefcccb817 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:48.231472 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1da2a6c-c17d-4e47-ab6a-3aaefcccb817 None admin] PATH_INFO: `/v3/projects/8a5400fd95e746d7a23658c890ad84cd/groups/5b0c70710f494d7bb598b2711c3669cd/roles/127fdc7ef05b4e0b98a940b334e5fcab` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:48.232614 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7db30c5-672a-446e-9451-6547bc637bef None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:48.235092 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 200/412] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Aug 18 10:49:48 2022] GET /identity/v3/groups/318311d8271846a293a8abcf31026380 => generated 226 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 10:49:48.236483 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1da2a6c-c17d-4e47-ab6a-3aaefcccb817 None admin] RBAC: Authorizing `identity:create_grant(project_id=8a5400fd95e746d7a23658c890ad84cd, group_id=5b0c70710f494d7bb598b2711c3669cd, role_id=127fdc7ef05b4e0b98a940b334e5fcab)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:48.241631 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1da2a6c-c17d-4e47-ab6a-3aaefcccb817 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:48.246510 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7db30c5-672a-446e-9451-6547bc637bef None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:48.280519 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 213/413] 10.222.0.15 () {58 vars in 1442 bytes} [Thu Aug 18 10:49:47 2022] PUT /identity/v3/projects/8a5400fd95e746d7a23658c890ad84cd/groups/5b0c70710f494d7bb598b2711c3669cd/roles/127fdc7ef05b4e0b98a940b334e5fcab => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 10:49:48.326888 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0870eb9-8c4c-4865-b259-cb39f83a4d51 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:48.327121 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0870eb9-8c4c-4865-b259-cb39f83a4d51 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:48.327361 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0870eb9-8c4c-4865-b259-cb39f83a4d51 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:48.328715 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 214/414] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:49:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 10:49:48.345721 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f69cba-9203-4c7a-b17b-084923d89d83 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:48.346625 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f69cba-9203-4c7a-b17b-084923d89d83 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:48.348710 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f69cba-9203-4c7a-b17b-084923d89d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:48.390744 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-45f69cba-9203-4c7a-b17b-084923d89d83 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:49:48.392047 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-45f69cba-9203-4c7a-b17b-084923d89d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:49:48.415788 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:48.426787 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:48.431944 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7db30c5-672a-446e-9451-6547bc637bef None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:48.479893 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723c8057-2a7d-4f55-b1e2-ac6c53c4bfa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:48.480216 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c8057-2a7d-4f55-b1e2-ac6c53c4bfa9 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:48.480728 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c8057-2a7d-4f55-b1e2-ac6c53c4bfa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:48.480906 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c8057-2a7d-4f55-b1e2-ac6c53c4bfa9 None admin] PATH_INFO: `/v3/projects/40e4bf42973a49f182b6ddf70bcb3bdf` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:48.482288 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723c8057-2a7d-4f55-b1e2-ac6c53c4bfa9 None admin] RBAC: Authorizing `identity:get_project(project_id=40e4bf42973a49f182b6ddf70bcb3bdf)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:48.484486 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723c8057-2a7d-4f55-b1e2-ac6c53c4bfa9 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:48.486467 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 201/415] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 18 10:49:48 2022] GET /identity/v3/projects/40e4bf42973a49f182b6ddf70bcb3bdf => generated 302 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:48.487317 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5c628c-955a-45ba-8e58-1bbc6027d8fc None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:48.487441 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5c628c-955a-45ba-8e58-1bbc6027d8fc None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:48.487605 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5c628c-955a-45ba-8e58-1bbc6027d8fc None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:48.490987 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 202/416] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:49:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:49:48.495082 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5c628c-955a-45ba-8e58-1bbc6027d8fc None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:48.498482 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 215/417] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:49:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 10:49:48.500930 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312891d-125f-4b0a-966c-ee9c8ec83c3c None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:48.501220 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312891d-125f-4b0a-966c-ee9c8ec83c3c None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:48.501498 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312891d-125f-4b0a-966c-ee9c8ec83c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:48.526893 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-4312891d-125f-4b0a-966c-ee9c8ec83c3c None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:49:48.528368 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-4312891d-125f-4b0a-966c-ee9c8ec83c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:49:48.623688 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5c628c-955a-45ba-8e58-1bbc6027d8fc None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:48.629689 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 216/418] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:49:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 10:49:48.672137 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbded562-4895-4b72-9985-7ea0caf9c12e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:48.672801 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbded562-4895-4b72-9985-7ea0caf9c12e None admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:48.673075 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbded562-4895-4b72-9985-7ea0caf9c12e None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:48.673346 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbded562-4895-4b72-9985-7ea0caf9c12e None admin] PATH_INFO: `/v3/projects/40e4bf42973a49f182b6ddf70bcb3bdf/groups/318311d8271846a293a8abcf31026380/roles/0ecb6b324fc643f3826b2878f2f6174b` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:48.676519 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbded562-4895-4b72-9985-7ea0caf9c12e None admin] RBAC: Authorizing `identity:create_grant(project_id=40e4bf42973a49f182b6ddf70bcb3bdf, group_id=318311d8271846a293a8abcf31026380, role_id=0ecb6b324fc643f3826b2878f2f6174b)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:48.677993 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbded562-4895-4b72-9985-7ea0caf9c12e None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:48.703708 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 203/419] 10.222.0.15 () {58 vars in 1442 bytes} [Thu Aug 18 10:49:48 2022] PUT /identity/v3/projects/40e4bf42973a49f182b6ddf70bcb3bdf/groups/318311d8271846a293a8abcf31026380/roles/0ecb6b324fc643f3826b2878f2f6174b => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 10:49:48.875941 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4312891d-125f-4b0a-966c-ee9c8ec83c3c None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:48.952703 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbded562-4895-4b72-9985-7ea0caf9c12e None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:48.985892 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:48.999441 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:49.004466 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4312891d-125f-4b0a-966c-ee9c8ec83c3c None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:49.042432 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c689ce-82fb-4eff-96c4-f890b8ba67c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:49.043076 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c689ce-82fb-4eff-96c4-f890b8ba67c9 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:49.043359 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c689ce-82fb-4eff-96c4-f890b8ba67c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:49.043631 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c689ce-82fb-4eff-96c4-f890b8ba67c9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:49.054978 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c689ce-82fb-4eff-96c4-f890b8ba67c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:49:49.060307 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-b7c689ce-82fb-4eff-96c4-f890b8ba67c9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 10:49:49.060307 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:49:49.060307 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:49:49.060307 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:49:49.060307 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:49:49.060307 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:49:49.060307 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:49:49.060307 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:49:49.060307 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:49:49.060307 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:49:49.060307 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:49:49.060307 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:49:49.060307 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:49:49.060307 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:49:49.060307 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:49:49.060307 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:49:49.061316 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:49:49.061316 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:49:49.061316 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:49:49.061316 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:49:49.061316 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:49:49.061316 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:49:49.061316 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:49:49.061316 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:49:49.061316 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:49:49.061316 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:49:49.061316 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:49:49.061316 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:49:49.061316 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:49:49.061316 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:49:49.061316 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:49:49.061316 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:49:49.062190 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:49:49.062190 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:49:49.062190 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:49:49.062190 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:49:49.062190 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:49:49.062190 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:49:49.062190 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:49:49.062190 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:49:49.062190 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:49:49.062190 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:49:49.062190 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 10:49:49.062190 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:49:49.062190 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 217/420] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Aug 18 10:49:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:49:49.073156 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c689ce-82fb-4eff-96c4-f890b8ba67c9 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:49.140247 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbded562-4895-4b72-9985-7ea0caf9c12e None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:49.220892 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea713e1b-52f8-4150-a490-2ff23e1ad084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:49.225553 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea713e1b-52f8-4150-a490-2ff23e1ad084 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:49.225553 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea713e1b-52f8-4150-a490-2ff23e1ad084 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:49.225553 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea713e1b-52f8-4150-a490-2ff23e1ad084 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:49.244810 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea713e1b-52f8-4150-a490-2ff23e1ad084 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:49:49.252759 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-ea713e1b-52f8-4150-a490-2ff23e1ad084 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 10:49:49.252759 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:49:49.252759 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:49:49.252759 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:49:49.252759 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:49:49.252759 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:49:49.252759 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:49:49.252759 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:49:49.252759 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:49:49.252759 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:49:49.252759 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:49:49.252759 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:49:49.252759 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:49:49.252759 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:49:49.252759 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:49:49.252759 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:49:49.253791 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:49:49.253791 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:49:49.253791 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:49:49.253791 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:49:49.253791 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:49:49.253791 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:49:49.253791 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:49:49.253791 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:49:49.253791 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:49:49.253791 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:49:49.253791 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:49:49.253791 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:49:49.253791 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:49:49.253791 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:49:49.253791 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:49:49.253791 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:49:49.254578 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:49:49.254578 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:49:49.254578 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:49:49.254578 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:49:49.254578 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:49:49.254578 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:49:49.254578 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:49:49.254578 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:49:49.254578 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:49:49.254578 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:49:49.254578 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 10:49:49.254578 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:49:49.255729 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 204/421] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 18 10:49:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:49:49.261458 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea713e1b-52f8-4150-a490-2ff23e1ad084 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:49.278347 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c689ce-82fb-4eff-96c4-f890b8ba67c9 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:49.344786 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0535c7b-554b-4f7a-a578-2713f9ab695f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:49.345409 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0535c7b-554b-4f7a-a578-2713f9ab695f None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:49.345713 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0535c7b-554b-4f7a-a578-2713f9ab695f None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:49.345991 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0535c7b-554b-4f7a-a578-2713f9ab695f None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:49.346782 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0535c7b-554b-4f7a-a578-2713f9ab695f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:49:49.347158 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0535c7b-554b-4f7a-a578-2713f9ab695f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:49.348723 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0535c7b-554b-4f7a-a578-2713f9ab695f None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:49.365987 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:49.371005 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 218/422] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 18 10:49:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:49.377565 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0535c7b-554b-4f7a-a578-2713f9ab695f None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:49.386773 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea713e1b-52f8-4150-a490-2ff23e1ad084 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:49.392826 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:49.481882 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da74225-680e-4c89-89f5-ca39f0a45d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:49.482507 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da74225-680e-4c89-89f5-ca39f0a45d9d None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:49.484739 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da74225-680e-4c89-89f5-ca39f0a45d9d None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:49.485031 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da74225-680e-4c89-89f5-ca39f0a45d9d None admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:49.485752 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da74225-680e-4c89-89f5-ca39f0a45d9d None admin] RBAC: Adding query filter params (name=member) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:49:49.486062 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da74225-680e-4c89-89f5-ca39f0a45d9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:49.487551 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da74225-680e-4c89-89f5-ca39f0a45d9d None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:49.511408 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 205/423] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Aug 18 10:49:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 10:49:49.517697 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da74225-680e-4c89-89f5-ca39f0a45d9d None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:49.557947 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0535c7b-554b-4f7a-a578-2713f9ab695f None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:49.600606 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4767e80-fc77-41c6-ba52-1f4b6e39b9ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:49.601637 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4767e80-fc77-41c6-ba52-1f4b6e39b9ef None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:49.603473 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4767e80-fc77-41c6-ba52-1f4b6e39b9ef None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:49.603965 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4767e80-fc77-41c6-ba52-1f4b6e39b9ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:49.697097 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4767e80-fc77-41c6-ba52-1f4b6e39b9ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:49.698788 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4767e80-fc77-41c6-ba52-1f4b6e39b9ef None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:49.708996 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:49.722365 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da74225-680e-4c89-89f5-ca39f0a45d9d None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:49.762961 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77ae67d-87c4-44f3-bf0b-3284e05779bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:49.764024 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ae67d-87c4-44f3-bf0b-3284e05779bb None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:49.764508 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ae67d-87c4-44f3-bf0b-3284e05779bb None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:49.765010 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ae67d-87c4-44f3-bf0b-3284e05779bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:49.790627 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:49.821962 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 219/424] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 18 10:49:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 18 10:49:49.823057 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e791282-9806-42c1-b52a-a5445a63601a None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:49.823280 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e791282-9806-42c1-b52a-a5445a63601a None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:49.823555 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e791282-9806-42c1-b52a-a5445a63601a None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:49.824948 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 220/425] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:49:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:49:49.825786 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e791282-9806-42c1-b52a-a5445a63601a None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:49.852951 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77ae67d-87c4-44f3-bf0b-3284e05779bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:49.854901 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77ae67d-87c4-44f3-bf0b-3284e05779bb None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:49.953623 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e791282-9806-42c1-b52a-a5445a63601a None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:49.960032 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:49.974735 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 206/426] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 18 10:49:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 10:49:49.976110 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b3fe2-a7ec-46b4-8c75-23dc7177cbdb None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:49.976397 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b3fe2-a7ec-46b4-8c75-23dc7177cbdb None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:49.976672 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b3fe2-a7ec-46b4-8c75-23dc7177cbdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:49.997850 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-4a1b3fe2-a7ec-46b4-8c75-23dc7177cbdb None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:49:49.999434 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-4a1b3fe2-a7ec-46b4-8c75-23dc7177cbdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:49:50.001972 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cd4a86-e540-40f1-b6df-2b3188204e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:50.003809 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd4a86-e540-40f1-b6df-2b3188204e8d None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:50.004286 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd4a86-e540-40f1-b6df-2b3188204e8d None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:50.004767 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd4a86-e540-40f1-b6df-2b3188204e8d None admin] PATH_INFO: `/v3/projects/db515fd18ab64bc190c7a76ae5f7e632` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:50.006193 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cd4a86-e540-40f1-b6df-2b3188204e8d None admin] RBAC: Authorizing `identity:get_project(project_id=db515fd18ab64bc190c7a76ae5f7e632)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:50.009008 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cd4a86-e540-40f1-b6df-2b3188204e8d None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:50.016226 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 221/427] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 18 10:49:49 2022] GET /identity/v3/projects/db515fd18ab64bc190c7a76ae5f7e632 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:50.016226 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cd4a86-e540-40f1-b6df-2b3188204e8d None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:50.064618 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:50.095667 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 207/428] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:49:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 10:49:50.096543 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b3fe2-a7ec-46b4-8c75-23dc7177cbdb None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:50.153876 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cd4a86-e540-40f1-b6df-2b3188204e8d None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:50.193768 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e56d21-8d21-4494-b997-c52e0dd3bef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:50.194296 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e56d21-8d21-4494-b997-c52e0dd3bef5 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:50.194581 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e56d21-8d21-4494-b997-c52e0dd3bef5 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:50.194853 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e56d21-8d21-4494-b997-c52e0dd3bef5 None admin] PATH_INFO: `/v3/projects/db515fd18ab64bc190c7a76ae5f7e632` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:50.196617 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e56d21-8d21-4494-b997-c52e0dd3bef5 None admin] RBAC: Authorizing `identity:get_project(project_id=db515fd18ab64bc190c7a76ae5f7e632)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:50.198097 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e56d21-8d21-4494-b997-c52e0dd3bef5 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:50.200041 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 222/429] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 18 10:49:50 2022] GET /identity/v3/projects/db515fd18ab64bc190c7a76ae5f7e632 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:50.211682 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e56d21-8d21-4494-b997-c52e0dd3bef5 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:50.236209 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b3fe2-a7ec-46b4-8c75-23dc7177cbdb None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:50.312644 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630de70d-e25d-42d5-b148-e1ad3b4f02f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:50.314135 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630de70d-e25d-42d5-b148-e1ad3b4f02f2 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:50.316745 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630de70d-e25d-42d5-b148-e1ad3b4f02f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:50.317273 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630de70d-e25d-42d5-b148-e1ad3b4f02f2 None admin] PATH_INFO: `/v3/groups/318311d8271846a293a8abcf31026380` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:50.318591 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:50.322275 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630de70d-e25d-42d5-b148-e1ad3b4f02f2 None admin] RBAC: Authorizing `identity:get_group(group_id=318311d8271846a293a8abcf31026380)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:50.324183 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630de70d-e25d-42d5-b148-e1ad3b4f02f2 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:50.336892 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 208/430] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Aug 18 10:49:50 2022] GET /identity/v3/groups/318311d8271846a293a8abcf31026380 => generated 226 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:50.338279 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630de70d-e25d-42d5-b148-e1ad3b4f02f2 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:50.396770 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:50.449395 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e56d21-8d21-4494-b997-c52e0dd3bef5 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:50.473304 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630de70d-e25d-42d5-b148-e1ad3b4f02f2 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:50.485877 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed88b388-7e0d-4738-98a2-c234cad59494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:50.486518 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed88b388-7e0d-4738-98a2-c234cad59494 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:50.487125 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed88b388-7e0d-4738-98a2-c234cad59494 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:50.487695 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed88b388-7e0d-4738-98a2-c234cad59494 None admin] PATH_INFO: `/v3/groups/318311d8271846a293a8abcf31026380` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:50.489577 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed88b388-7e0d-4738-98a2-c234cad59494 None admin] RBAC: Authorizing `identity:get_group(group_id=318311d8271846a293a8abcf31026380)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:50.491065 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed88b388-7e0d-4738-98a2-c234cad59494 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:50.493152 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 223/431] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Aug 18 10:49:50 2022] GET /identity/v3/groups/318311d8271846a293a8abcf31026380 => generated 226 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:50.498368 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed88b388-7e0d-4738-98a2-c234cad59494 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:50.519489 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630afc9c-d13d-44ed-b504-21c1c5e44a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:50.520736 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630afc9c-d13d-44ed-b504-21c1c5e44a99 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:50.521244 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630afc9c-d13d-44ed-b504-21c1c5e44a99 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:50.521762 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630afc9c-d13d-44ed-b504-21c1c5e44a99 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:50.523377 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630afc9c-d13d-44ed-b504-21c1c5e44a99 None admin] RBAC: Adding query filter params (group.id=318311d8271846a293a8abcf31026380, role.id=0ecb6b324fc643f3826b2878f2f6174b, scope.project.id=db515fd18ab64bc190c7a76ae5f7e632) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:49:50.524565 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630afc9c-d13d-44ed-b504-21c1c5e44a99 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:50.526993 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630afc9c-d13d-44ed-b504-21c1c5e44a99 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:50.536043 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 209/432] 10.222.0.15 () {56 vars in 1376 bytes} [Thu Aug 18 10:49:50 2022] GET /identity/v3/role_assignments?group.id=318311d8271846a293a8abcf31026380&scope.project.id=db515fd18ab64bc190c7a76ae5f7e632&role.id=0ecb6b324fc643f3826b2878f2f6174b => generated 611 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:50.538405 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630afc9c-d13d-44ed-b504-21c1c5e44a99 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:50.625147 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed88b388-7e0d-4738-98a2-c234cad59494 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:50.665937 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:50.676702 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4f9cee-b743-4cd6-8c9a-ab6d98e39c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:50.677362 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f9cee-b743-4cd6-8c9a-ab6d98e39c1b None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:50.677691 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f9cee-b743-4cd6-8c9a-ab6d98e39c1b None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:50.677989 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f9cee-b743-4cd6-8c9a-ab6d98e39c1b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:50.691809 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4f9cee-b743-4cd6-8c9a-ab6d98e39c1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:49:50.695792 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630afc9c-d13d-44ed-b504-21c1c5e44a99 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:50.697502 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-7a4f9cee-b743-4cd6-8c9a-ab6d98e39c1b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 10:49:50.697502 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:49:50.697502 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:49:50.697502 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:49:50.697502 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:49:50.697502 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:49:50.697502 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:49:50.697502 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:49:50.697502 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:49:50.697502 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:49:50.697502 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:49:50.697502 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:49:50.697502 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:49:50.697502 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:49:50.697502 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:49:50.697502 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:49:50.698425 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:49:50.698425 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:49:50.698425 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:49:50.698425 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:49:50.698425 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:49:50.698425 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:49:50.698425 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:49:50.698425 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:49:50.698425 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:49:50.698425 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:49:50.698425 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:49:50.698425 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:49:50.698425 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:49:50.698425 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:49:50.698425 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:49:50.698425 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:49:50.699248 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:49:50.699248 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:49:50.699248 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:49:50.699248 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:49:50.699248 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:49:50.699248 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:49:50.699248 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:49:50.699248 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:49:50.699248 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:49:50.699248 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:49:50.699248 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 10:49:50.699248 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:49:50.699248 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 224/433] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 18 10:49:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:49:50.709426 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4f9cee-b743-4cd6-8c9a-ab6d98e39c1b None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:50.713215 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:50.744732 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdefe606-1f14-4640-91b4-1be7d28f89ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:50.745780 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdefe606-1f14-4640-91b4-1be7d28f89ac None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:50.746264 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdefe606-1f14-4640-91b4-1be7d28f89ac None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:50.746739 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdefe606-1f14-4640-91b4-1be7d28f89ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:50.747785 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdefe606-1f14-4640-91b4-1be7d28f89ac None admin] RBAC: Adding query filter params (group.id=318311d8271846a293a8abcf31026380, role.id=719e5c62188d4f8a838987d6e72ca8f7, scope.project.id=db515fd18ab64bc190c7a76ae5f7e632) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:49:50.748416 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdefe606-1f14-4640-91b4-1be7d28f89ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:50.750222 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdefe606-1f14-4640-91b4-1be7d28f89ac None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:50.757630 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 210/434] 10.222.0.15 () {56 vars in 1376 bytes} [Thu Aug 18 10:49:50 2022] GET /identity/v3/role_assignments?group.id=318311d8271846a293a8abcf31026380&scope.project.id=db515fd18ab64bc190c7a76ae5f7e632&role.id=719e5c62188d4f8a838987d6e72ca8f7 => generated 611 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:50.766585 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa332b-9e3b-483a-b0ba-d0847747481d None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:50.767222 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa332b-9e3b-483a-b0ba-d0847747481d None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:50.767808 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa332b-9e3b-483a-b0ba-d0847747481d None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:50.770025 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 211/435] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:49:50 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:49:50.776591 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ef385-940d-4bef-933b-9b894c17e8c1 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:50.777213 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ef385-940d-4bef-933b-9b894c17e8c1 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:50.777833 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ef385-940d-4bef-933b-9b894c17e8c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:50.814879 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-341ef385-940d-4bef-933b-9b894c17e8c1 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:49:50.816653 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-341ef385-940d-4bef-933b-9b894c17e8c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:49:50.860487 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4f9cee-b743-4cd6-8c9a-ab6d98e39c1b None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:50.903578 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c18930-4c04-4297-aa20-13828e54f69c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:50.904161 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c18930-4c04-4297-aa20-13828e54f69c None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:50.904445 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c18930-4c04-4297-aa20-13828e54f69c None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:50.904724 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c18930-4c04-4297-aa20-13828e54f69c None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:50.905425 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c18930-4c04-4297-aa20-13828e54f69c None admin] RBAC: Adding query filter params (name=member) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:49:50.906076 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c18930-4c04-4297-aa20-13828e54f69c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:50.907182 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c18930-4c04-4297-aa20-13828e54f69c None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:50.914890 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 212/436] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:49:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 10:49:50.918465 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 225/437] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Aug 18 10:49:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:50.924304 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341ef385-940d-4bef-933b-9b894c17e8c1 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:51.047987 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341ef385-940d-4bef-933b-9b894c17e8c1 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:51.052427 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:51.087971 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aeee4e-5b5f-42e6-86ae-aecff5d063a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:51.088951 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aeee4e-5b5f-42e6-86ae-aecff5d063a6 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:51.089422 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aeee4e-5b5f-42e6-86ae-aecff5d063a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:51.089859 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aeee4e-5b5f-42e6-86ae-aecff5d063a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:51.148870 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915a752-44fe-497d-b6f2-3ac1c1cfa2dc None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:51.150054 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915a752-44fe-497d-b6f2-3ac1c1cfa2dc None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:51.150565 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915a752-44fe-497d-b6f2-3ac1c1cfa2dc None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:51.156257 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 226/438] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:49:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:49:51.158101 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cadaf9-0e0a-42a1-b98e-e2b0a0805b19 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:51.158612 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cadaf9-0e0a-42a1-b98e-e2b0a0805b19 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:51.159092 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cadaf9-0e0a-42a1-b98e-e2b0a0805b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:51.163575 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aeee4e-5b5f-42e6-86ae-aecff5d063a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:51.165701 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aeee4e-5b5f-42e6-86ae-aecff5d063a6 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:51.185377 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-62cadaf9-0e0a-42a1-b98e-e2b0a0805b19 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:49:51.186866 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-62cadaf9-0e0a-42a1-b98e-e2b0a0805b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:49:51.231384 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:51.279830 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 227/439] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:49:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 10:49:51.280706 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cadaf9-0e0a-42a1-b98e-e2b0a0805b19 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:51.288449 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 213/440] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 18 10:49:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 10:49:51.295020 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aeee4e-5b5f-42e6-86ae-aecff5d063a6 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:51.298149 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:51.402904 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cadaf9-0e0a-42a1-b98e-e2b0a0805b19 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:51.434083 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aeee4e-5b5f-42e6-86ae-aecff5d063a6 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:51.449296 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7615458f-318f-47fa-80ad-e7ac93aab970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:51.450018 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615458f-318f-47fa-80ad-e7ac93aab970 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:51.450529 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615458f-318f-47fa-80ad-e7ac93aab970 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:51.450529 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615458f-318f-47fa-80ad-e7ac93aab970 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:51.463952 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7615458f-318f-47fa-80ad-e7ac93aab970 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:49:51.469426 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-7615458f-318f-47fa-80ad-e7ac93aab970 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 10:49:51.469426 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:49:51.469426 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:49:51.469426 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:49:51.469426 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:49:51.469426 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:49:51.469426 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:49:51.469426 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:49:51.469426 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:49:51.469426 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:49:51.469426 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:49:51.469426 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:49:51.469426 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:49:51.469426 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:49:51.469426 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:49:51.469426 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:49:51.470350 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:49:51.470350 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:49:51.470350 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:49:51.470350 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:49:51.470350 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:49:51.470350 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:49:51.470350 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:49:51.470350 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:49:51.470350 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:49:51.470350 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:49:51.470350 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:49:51.470350 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:49:51.470350 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:49:51.470350 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:49:51.470350 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:49:51.470350 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:49:51.471151 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:49:51.471151 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:49:51.471151 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:49:51.471151 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:49:51.471151 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:49:51.471151 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:49:51.471151 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:49:51.471151 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:49:51.471151 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:49:51.471151 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:49:51.471151 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 10:49:51.471151 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:49:51.471746 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 228/441] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Aug 18 10:49:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:49:51.479450 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7615458f-318f-47fa-80ad-e7ac93aab970 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:51.479992 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285142f2-a82b-471c-b010-d2e0c96caf62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:51.480644 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285142f2-a82b-471c-b010-d2e0c96caf62 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:51.480924 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285142f2-a82b-471c-b010-d2e0c96caf62 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:51.481199 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285142f2-a82b-471c-b010-d2e0c96caf62 None admin] PATH_INFO: `/v3/projects/40e4bf42973a49f182b6ddf70bcb3bdf` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:51.482418 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285142f2-a82b-471c-b010-d2e0c96caf62 None admin] RBAC: Authorizing `identity:get_project(project_id=40e4bf42973a49f182b6ddf70bcb3bdf)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:51.483867 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285142f2-a82b-471c-b010-d2e0c96caf62 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:51.485663 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 214/442] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 18 10:49:51 2022] GET /identity/v3/projects/40e4bf42973a49f182b6ddf70bcb3bdf => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:51.492073 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285142f2-a82b-471c-b010-d2e0c96caf62 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:51.507681 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:51.581122 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:51.608656 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7615458f-318f-47fa-80ad-e7ac93aab970 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:51.610743 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285142f2-a82b-471c-b010-d2e0c96caf62 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:51.645290 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9890cfe3-e4bd-4b14-8341-ef7dfd4fdc92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:51.645917 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890cfe3-e4bd-4b14-8341-ef7dfd4fdc92 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:51.646097 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f1f77d-3cbb-4cdc-918a-a2ed23062a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:51.646219 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890cfe3-e4bd-4b14-8341-ef7dfd4fdc92 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:51.646447 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890cfe3-e4bd-4b14-8341-ef7dfd4fdc92 None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:51.646722 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f1f77d-3cbb-4cdc-918a-a2ed23062a7c None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:51.646998 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f1f77d-3cbb-4cdc-918a-a2ed23062a7c None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:51.647092 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9890cfe3-e4bd-4b14-8341-ef7dfd4fdc92 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:49:51.647267 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f1f77d-3cbb-4cdc-918a-a2ed23062a7c None admin] PATH_INFO: `/v3/groups/318311d8271846a293a8abcf31026380` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:51.647383 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9890cfe3-e4bd-4b14-8341-ef7dfd4fdc92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:51.648716 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f1f77d-3cbb-4cdc-918a-a2ed23062a7c None admin] RBAC: Authorizing `identity:get_group(group_id=318311d8271846a293a8abcf31026380)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:51.649028 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9890cfe3-e4bd-4b14-8341-ef7dfd4fdc92 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:51.650221 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f1f77d-3cbb-4cdc-918a-a2ed23062a7c None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:51.651801 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 215/443] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Aug 18 10:49:51 2022] GET /identity/v3/groups/318311d8271846a293a8abcf31026380 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:51.652563 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f1f77d-3cbb-4cdc-918a-a2ed23062a7c None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:51.661828 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 229/444] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 18 10:49:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:51.661828 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9890cfe3-e4bd-4b14-8341-ef7dfd4fdc92 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:51.746405 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:51.755652 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f1f77d-3cbb-4cdc-918a-a2ed23062a7c None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:51.767545 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9890cfe3-e4bd-4b14-8341-ef7dfd4fdc92 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:51.792275 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02cef72-9960-4583-8b8d-624999ef0e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:51.792898 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02cef72-9960-4583-8b8d-624999ef0e9f None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:51.793174 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02cef72-9960-4583-8b8d-624999ef0e9f None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:51.793448 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02cef72-9960-4583-8b8d-624999ef0e9f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:51.800739 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d972b0ec-bd3f-4315-a671-ec514ddb9697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:51.800944 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:51.801343 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d972b0ec-bd3f-4315-a671-ec514ddb9697 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:51.801650 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d972b0ec-bd3f-4315-a671-ec514ddb9697 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:51.801936 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d972b0ec-bd3f-4315-a671-ec514ddb9697 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:51.802959 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d972b0ec-bd3f-4315-a671-ec514ddb9697 None admin] RBAC: Adding query filter params (group.id=318311d8271846a293a8abcf31026380, role.id=719e5c62188d4f8a838987d6e72ca8f7, scope.project.id=40e4bf42973a49f182b6ddf70bcb3bdf) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:49:51.803255 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d972b0ec-bd3f-4315-a671-ec514ddb9697 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:51.804608 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02cef72-9960-4583-8b8d-624999ef0e9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:49:51.805306 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d972b0ec-bd3f-4315-a671-ec514ddb9697 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:51.810011 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-c02cef72-9960-4583-8b8d-624999ef0e9f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 10:49:51.810011 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:49:51.810011 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:49:51.810011 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:49:51.810011 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:49:51.810011 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:49:51.810011 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:49:51.810011 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:49:51.810011 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:49:51.810011 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:49:51.810011 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:49:51.810011 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:49:51.810011 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:49:51.810011 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:49:51.810011 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:49:51.810011 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:49:51.811055 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:49:51.811055 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:49:51.811055 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:49:51.811055 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:49:51.811055 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:49:51.811055 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:49:51.811055 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:49:51.811055 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:49:51.811055 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:49:51.811055 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:49:51.811055 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:49:51.811055 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:49:51.811055 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:49:51.811055 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:49:51.811055 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:49:51.811055 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:49:51.811846 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:49:51.811846 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:49:51.811846 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:49:51.811846 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:49:51.811846 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:49:51.811846 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:49:51.811846 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:49:51.811846 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:49:51.811846 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:49:51.811846 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:49:51.811846 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 10:49:51.811846 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:49:51.811846 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 216/445] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Aug 18 10:49:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:49:51.812484 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 230/446] 10.222.0.15 () {56 vars in 1376 bytes} [Thu Aug 18 10:49:51 2022] GET /identity/v3/role_assignments?group.id=318311d8271846a293a8abcf31026380&scope.project.id=40e4bf42973a49f182b6ddf70bcb3bdf&role.id=719e5c62188d4f8a838987d6e72ca8f7 => generated 611 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:51.812552 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02cef72-9960-4583-8b8d-624999ef0e9f None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:51.816871 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d972b0ec-bd3f-4315-a671-ec514ddb9697 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:51.940450 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02cef72-9960-4583-8b8d-624999ef0e9f None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:51.945635 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d972b0ec-bd3f-4315-a671-ec514ddb9697 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:51.982241 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cff928-d234-4306-a240-0a3659f68c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:51.982857 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cff928-d234-4306-a240-0a3659f68c87 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:51.983132 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cff928-d234-4306-a240-0a3659f68c87 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:51.983410 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cff928-d234-4306-a240-0a3659f68c87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:51.986305 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee44176e-99b8-44b2-a465-72398e6d77f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:51.986914 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee44176e-99b8-44b2-a465-72398e6d77f6 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:51.989553 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee44176e-99b8-44b2-a465-72398e6d77f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:51.989553 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee44176e-99b8-44b2-a465-72398e6d77f6 None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:51.989553 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee44176e-99b8-44b2-a465-72398e6d77f6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:49:51.989553 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee44176e-99b8-44b2-a465-72398e6d77f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:51.989872 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee44176e-99b8-44b2-a465-72398e6d77f6 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:52.001405 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 231/447] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 18 10:49:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 10:49:52.007213 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee44176e-99b8-44b2-a465-72398e6d77f6 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:52.021306 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:52.062844 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:52.065921 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cff928-d234-4306-a240-0a3659f68c87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:52.067643 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cff928-d234-4306-a240-0a3659f68c87 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:52.129786 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee44176e-99b8-44b2-a465-72398e6d77f6 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:52.179569 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40079b9-eb49-4407-bc7c-86bb83759d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:52.180845 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40079b9-eb49-4407-bc7c-86bb83759d51 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:52.181182 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40079b9-eb49-4407-bc7c-86bb83759d51 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:52.181767 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40079b9-eb49-4407-bc7c-86bb83759d51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:52.193809 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 217/448] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 18 10:49:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 10:49:52.202537 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cff928-d234-4306-a240-0a3659f68c87 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:52.259676 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40079b9-eb49-4407-bc7c-86bb83759d51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:52.261150 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40079b9-eb49-4407-bc7c-86bb83759d51 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:52.275181 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:52.307273 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:52.310392 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cff928-d234-4306-a240-0a3659f68c87 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:52.346858 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c5ddb2-3955-4a0b-b804-461c92075947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:52.347487 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c5ddb2-3955-4a0b-b804-461c92075947 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:52.347769 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c5ddb2-3955-4a0b-b804-461c92075947 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:52.348042 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c5ddb2-3955-4a0b-b804-461c92075947 None admin] PATH_INFO: `/v3/projects/8a5400fd95e746d7a23658c890ad84cd` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:52.349188 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c5ddb2-3955-4a0b-b804-461c92075947 None admin] RBAC: Authorizing `identity:get_project(project_id=8a5400fd95e746d7a23658c890ad84cd)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:52.350653 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c5ddb2-3955-4a0b-b804-461c92075947 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:52.353637 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 218/449] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 18 10:49:52 2022] GET /identity/v3/projects/8a5400fd95e746d7a23658c890ad84cd => generated 344 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:52.358927 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c5ddb2-3955-4a0b-b804-461c92075947 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:52.369877 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 232/450] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 18 10:49:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 18 10:49:52.370910 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40079b9-eb49-4407-bc7c-86bb83759d51 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:52.461581 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c5ddb2-3955-4a0b-b804-461c92075947 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:52.471850 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40079b9-eb49-4407-bc7c-86bb83759d51 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:52.483768 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:52.495888 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a659871-7c9f-4a9a-b06a-b0f2cb467ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:52.496516 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a659871-7c9f-4a9a-b06a-b0f2cb467ccb None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:52.496789 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a659871-7c9f-4a9a-b06a-b0f2cb467ccb None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:52.497058 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a659871-7c9f-4a9a-b06a-b0f2cb467ccb None admin] PATH_INFO: `/v3/groups/5b0c70710f494d7bb598b2711c3669cd` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:52.498200 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a659871-7c9f-4a9a-b06a-b0f2cb467ccb None admin] RBAC: Authorizing `identity:get_group(group_id=5b0c70710f494d7bb598b2711c3669cd)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:52.499624 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a659871-7c9f-4a9a-b06a-b0f2cb467ccb None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:52.501180 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 219/451] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Aug 18 10:49:52 2022] GET /identity/v3/groups/5b0c70710f494d7bb598b2711c3669cd => generated 229 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 10:49:52.506727 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2923e0-bef5-4910-8e57-557c31df4894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:52.507030 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a659871-7c9f-4a9a-b06a-b0f2cb467ccb None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:52.507353 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2923e0-bef5-4910-8e57-557c31df4894 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:52.507635 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2923e0-bef5-4910-8e57-557c31df4894 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:52.507913 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2923e0-bef5-4910-8e57-557c31df4894 None admin] PATH_INFO: `/v3/projects/40e4bf42973a49f182b6ddf70bcb3bdf` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:52.509033 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2923e0-bef5-4910-8e57-557c31df4894 None admin] RBAC: Authorizing `identity:get_project(project_id=40e4bf42973a49f182b6ddf70bcb3bdf)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:52.510567 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2923e0-bef5-4910-8e57-557c31df4894 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:52.512102 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 233/452] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 18 10:49:52 2022] GET /identity/v3/projects/40e4bf42973a49f182b6ddf70bcb3bdf => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 10:49:52.517292 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2923e0-bef5-4910-8e57-557c31df4894 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:52.545420 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:52.621192 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2923e0-bef5-4910-8e57-557c31df4894 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:52.626303 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a659871-7c9f-4a9a-b06a-b0f2cb467ccb None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:52.656124 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9324dfc5-473b-4249-a45c-034292caed07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:52.656744 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9324dfc5-473b-4249-a45c-034292caed07 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:52.657013 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9324dfc5-473b-4249-a45c-034292caed07 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:52.657285 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9324dfc5-473b-4249-a45c-034292caed07 None admin] PATH_INFO: `/v3/groups/318311d8271846a293a8abcf31026380` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:52.658420 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9324dfc5-473b-4249-a45c-034292caed07 None admin] RBAC: Authorizing `identity:get_group(group_id=318311d8271846a293a8abcf31026380)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:52.659845 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9324dfc5-473b-4249-a45c-034292caed07 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:52.661225 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c17e82-e789-44c6-94f3-e07bcd1ef201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:52.661720 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 234/453] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Aug 18 10:49:52 2022] GET /identity/v3/groups/318311d8271846a293a8abcf31026380 => generated 226 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 10:49:52.661926 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c17e82-e789-44c6-94f3-e07bcd1ef201 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:52.662208 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c17e82-e789-44c6-94f3-e07bcd1ef201 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:52.662567 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c17e82-e789-44c6-94f3-e07bcd1ef201 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:52.663304 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c17e82-e789-44c6-94f3-e07bcd1ef201 None admin] RBAC: Adding query filter params (group.id=5b0c70710f494d7bb598b2711c3669cd, role.id=127fdc7ef05b4e0b98a940b334e5fcab, scope.project.id=8a5400fd95e746d7a23658c890ad84cd) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:49:52.663614 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c17e82-e789-44c6-94f3-e07bcd1ef201 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:52.665701 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c17e82-e789-44c6-94f3-e07bcd1ef201 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:52.668204 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9324dfc5-473b-4249-a45c-034292caed07 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:52.672406 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 220/454] 10.222.0.15 () {56 vars in 1376 bytes} [Thu Aug 18 10:49:52 2022] GET /identity/v3/role_assignments?group.id=5b0c70710f494d7bb598b2711c3669cd&scope.project.id=8a5400fd95e746d7a23658c890ad84cd&role.id=127fdc7ef05b4e0b98a940b334e5fcab => generated 611 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 10:49:52.720964 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:52.781027 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9324dfc5-473b-4249-a45c-034292caed07 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:52.818762 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69a7fa5-ce36-43c3-bd0d-9270c185812e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:52.819374 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69a7fa5-ce36-43c3-bd0d-9270c185812e None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:52.819653 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69a7fa5-ce36-43c3-bd0d-9270c185812e None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:52.819932 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69a7fa5-ce36-43c3-bd0d-9270c185812e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:52.821853 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69a7fa5-ce36-43c3-bd0d-9270c185812e None admin] RBAC: Adding query filter params (group.id=318311d8271846a293a8abcf31026380, role.id=0ecb6b324fc643f3826b2878f2f6174b, scope.project.id=40e4bf42973a49f182b6ddf70bcb3bdf) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:49:52.822179 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69a7fa5-ce36-43c3-bd0d-9270c185812e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:52.823620 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69a7fa5-ce36-43c3-bd0d-9270c185812e None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:52.829686 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 235/455] 10.222.0.15 () {56 vars in 1376 bytes} [Thu Aug 18 10:49:52 2022] GET /identity/v3/role_assignments?group.id=318311d8271846a293a8abcf31026380&scope.project.id=40e4bf42973a49f182b6ddf70bcb3bdf&role.id=0ecb6b324fc643f3826b2878f2f6174b => generated 611 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 10:49:55.301688 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8b055c-17aa-474f-9449-bad64e3fae44 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:55.302195 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8b055c-17aa-474f-9449-bad64e3fae44 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:55.302267 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8b055c-17aa-474f-9449-bad64e3fae44 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:55.303850 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 221/456] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:49:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:49:55.309738 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6068f-31db-4022-98be-c0afe95414f8 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:55.310180 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6068f-31db-4022-98be-c0afe95414f8 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:55.310361 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6068f-31db-4022-98be-c0afe95414f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:55.333588 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-b8c6068f-31db-4022-98be-c0afe95414f8 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:49:55.334801 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-b8c6068f-31db-4022-98be-c0afe95414f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:49:55.435202 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 236/457] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:49:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 10:49:55.459957 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94628c58-41bd-469c-8911-ad9f4d6cdd1c None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:55.460468 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94628c58-41bd-469c-8911-ad9f4d6cdd1c None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:55.460920 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94628c58-41bd-469c-8911-ad9f4d6cdd1c None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:55.462665 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 222/458] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:49:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:49:55.467558 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c339555-6d19-41d5-9c9a-6b371f941ab0 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:55.467845 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c339555-6d19-41d5-9c9a-6b371f941ab0 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:55.468122 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c339555-6d19-41d5-9c9a-6b371f941ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:55.494510 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-9c339555-6d19-41d5-9c9a-6b371f941ab0 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:49:55.495709 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-9c339555-6d19-41d5-9c9a-6b371f941ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:49:55.541282 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:55.584316 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 237/459] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:49:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 10:49:55.852747 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6023eae0-61a6-4b4e-8b27-3b22524e3e55 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:55.853331 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6023eae0-61a6-4b4e-8b27-3b22524e3e55 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:55.853808 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6023eae0-61a6-4b4e-8b27-3b22524e3e55 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:55.855641 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 223/460] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:49:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:49:55.861716 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30106f0f-ef87-4f7b-9715-7c62dbb6ab9a None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:55.862212 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30106f0f-ef87-4f7b-9715-7c62dbb6ab9a None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:55.862646 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30106f0f-ef87-4f7b-9715-7c62dbb6ab9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:55.888335 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6023eae0-61a6-4b4e-8b27-3b22524e3e55 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:55.890212 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-30106f0f-ef87-4f7b-9715-7c62dbb6ab9a None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:49:55.891552 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-30106f0f-ef87-4f7b-9715-7c62dbb6ab9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:49:55.993937 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:56.000536 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6023eae0-61a6-4b4e-8b27-3b22524e3e55 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:56.026002 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 238/461] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:49:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 10:49:56.047361 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30106f0f-ef87-4f7b-9715-7c62dbb6ab9a None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:56.075652 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb0af5-1ab4-4001-b7b4-74767dd1187d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:56.076303 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb0af5-1ab4-4001-b7b4-74767dd1187d None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:56.076586 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb0af5-1ab4-4001-b7b4-74767dd1187d None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:56.076858 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb0af5-1ab4-4001-b7b4-74767dd1187d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:56.099600 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb0af5-1ab4-4001-b7b4-74767dd1187d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:56.101068 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb0af5-1ab4-4001-b7b4-74767dd1187d None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:56.127681 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-8cbb0af5-1ab4-4001-b7b4-74767dd1187d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:49:56.127681 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:49:56.127681 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:49:56.127681 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:49:56.127681 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:49:56.127681 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:49:56.127681 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:49:56.127681 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:49:56.127681 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:49:56.127681 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:49:56.127681 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:49:56.127681 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:49:56.127681 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 10:49:56.127681 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 10:49:56.127681 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 10:49:56.127681 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 10:49:56.128605 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:49:56.128605 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:49:56.128605 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:49:56.128605 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:49:56.128605 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:49:56.128605 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:49:56.128605 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:49:56.128605 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:49:56.128605 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:49:56.128605 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:49:56.128605 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:49:56.128605 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:49:56.128605 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:49:56.128605 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:49:56.128605 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:49:56.128605 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:49:56.128605 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 10:49:56.129431 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 10:49:56.129431 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:49:56.129431 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:49:56.129431 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 224/462] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:49:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:49:56.136167 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb0af5-1ab4-4001-b7b4-74767dd1187d None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:56.162730 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:56.168568 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30106f0f-ef87-4f7b-9715-7c62dbb6ab9a None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:56.210631 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b3ef5f-0af3-4e47-80d9-e25472274b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:56.212103 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3ef5f-0af3-4e47-80d9-e25472274b43 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:56.212556 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3ef5f-0af3-4e47-80d9-e25472274b43 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:56.212995 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3ef5f-0af3-4e47-80d9-e25472274b43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:56.224358 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b3ef5f-0af3-4e47-80d9-e25472274b43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:56.226179 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b3ef5f-0af3-4e47-80d9-e25472274b43 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:56.241771 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-e0b3ef5f-0af3-4e47-80d9-e25472274b43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:49:56.241771 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:49:56.241771 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:49:56.241771 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:49:56.241771 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:49:56.241771 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:49:56.241771 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:49:56.241771 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:49:56.241771 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:49:56.241771 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:49:56.241771 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:49:56.241771 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:49:56.241771 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 10:49:56.241771 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 10:49:56.241771 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 10:49:56.241771 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 10:49:56.242742 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:49:56.242742 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:49:56.242742 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:49:56.242742 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:49:56.242742 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:49:56.242742 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:49:56.242742 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:49:56.242742 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:49:56.242742 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:49:56.242742 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:49:56.242742 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:49:56.242742 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:49:56.242742 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:49:56.242742 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:49:56.242742 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:49:56.242742 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:49:56.242742 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 10:49:56.243690 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 10:49:56.243690 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:49:56.243690 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:49:56.245844 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 239/463] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:49:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:49:56.247298 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc3534-8510-4212-a7f2-531fca3f1c4c None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:56.247752 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc3534-8510-4212-a7f2-531fca3f1c4c None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:56.248208 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc3534-8510-4212-a7f2-531fca3f1c4c None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:56.254020 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 240/464] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:49:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:49:56.255498 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780755f2-601f-4a21-9ccf-e95f8b607f6d None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:56.255947 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780755f2-601f-4a21-9ccf-e95f8b607f6d None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:56.256388 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780755f2-601f-4a21-9ccf-e95f8b607f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:56.276309 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-780755f2-601f-4a21-9ccf-e95f8b607f6d None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:49:56.277817 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-780755f2-601f-4a21-9ccf-e95f8b607f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:49:56.284431 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb0af5-1ab4-4001-b7b4-74767dd1187d None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:56.332133 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af53676a-0f0b-48fe-a3e4-73cc31b6ec68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:56.334064 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af53676a-0f0b-48fe-a3e4-73cc31b6ec68 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:56.334543 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af53676a-0f0b-48fe-a3e4-73cc31b6ec68 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:56.334960 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af53676a-0f0b-48fe-a3e4-73cc31b6ec68 None admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:56.336413 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af53676a-0f0b-48fe-a3e4-73cc31b6ec68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:49:56.336935 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af53676a-0f0b-48fe-a3e4-73cc31b6ec68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:56.339223 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af53676a-0f0b-48fe-a3e4-73cc31b6ec68 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:56.357332 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 225/465] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 18 10:49:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 10:49:56.358471 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af53676a-0f0b-48fe-a3e4-73cc31b6ec68 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:56.366038 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 241/466] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:49:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 10:49:56.368733 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780755f2-601f-4a21-9ccf-e95f8b607f6d None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:56.377677 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:56.458108 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:56.477549 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780755f2-601f-4a21-9ccf-e95f8b607f6d None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:56.478865 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af53676a-0f0b-48fe-a3e4-73cc31b6ec68 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:56.513618 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e942b19-8de8-48d4-adf1-6a54efea3127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:56.514507 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e942b19-8de8-48d4-adf1-6a54efea3127 None admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:56.514933 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e942b19-8de8-48d4-adf1-6a54efea3127 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:56.515348 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e942b19-8de8-48d4-adf1-6a54efea3127 None admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:56.516131 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e942b19-8de8-48d4-adf1-6a54efea3127 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:56.517736 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e942b19-8de8-48d4-adf1-6a54efea3127 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:56.517849 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978b6fb7-e45a-4426-8a7e-a83e0204a7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:56.518546 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b6fb7-e45a-4426-8a7e-a83e0204a7a9 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:56.518979 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b6fb7-e45a-4426-8a7e-a83e0204a7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:56.519356 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b6fb7-e45a-4426-8a7e-a83e0204a7a9 None admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:56.520149 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978b6fb7-e45a-4426-8a7e-a83e0204a7a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:49:56.520554 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978b6fb7-e45a-4426-8a7e-a83e0204a7a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:56.522060 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978b6fb7-e45a-4426-8a7e-a83e0204a7a9 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:56.541550 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 226/467] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 18 10:49:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:56.541550 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978b6fb7-e45a-4426-8a7e-a83e0204a7a9 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:56.549358 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 242/468] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Aug 18 10:49:56 2022] POST /identity/v3/users => generated 246 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 10:49:56.550531 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e942b19-8de8-48d4-adf1-6a54efea3127 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:56.668696 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e942b19-8de8-48d4-adf1-6a54efea3127 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:56.670645 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:56.699573 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978b6fb7-e45a-4426-8a7e-a83e0204a7a9 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:56.711793 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64ba551-4fa0-49b8-b358-2ebcd4a19e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:56.712724 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ba551-4fa0-49b8-b358-2ebcd4a19e29 None admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:56.713163 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ba551-4fa0-49b8-b358-2ebcd4a19e29 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:56.713634 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ba551-4fa0-49b8-b358-2ebcd4a19e29 None admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:56.714446 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64ba551-4fa0-49b8-b358-2ebcd4a19e29 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:56.716063 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64ba551-4fa0-49b8-b358-2ebcd4a19e29 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:56.728682 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:56.749584 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c426d553-93ef-4b82-95d7-b2386cba7d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:56.749584 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c426d553-93ef-4b82-95d7-b2386cba7d7c None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:56.749584 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c426d553-93ef-4b82-95d7-b2386cba7d7c None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:56.749584 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c426d553-93ef-4b82-95d7-b2386cba7d7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:56.750068 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 243/469] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Aug 18 10:49:56 2022] POST /identity/v3/users => generated 248 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 10:49:56.751208 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64ba551-4fa0-49b8-b358-2ebcd4a19e29 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:56.770253 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c426d553-93ef-4b82-95d7-b2386cba7d7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:56.771770 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c426d553-93ef-4b82-95d7-b2386cba7d7c None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:56.795023 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-c426d553-93ef-4b82-95d7-b2386cba7d7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:49:56.795023 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:49:56.795023 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:49:56.795023 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:49:56.795023 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:49:56.795023 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:49:56.795023 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:49:56.795023 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:49:56.795023 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:49:56.795023 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:49:56.795023 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:49:56.795023 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:49:56.795023 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 10:49:56.795023 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 10:49:56.795023 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 10:49:56.795023 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 10:49:56.796173 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:49:56.796173 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:49:56.796173 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:49:56.796173 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:49:56.796173 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:49:56.796173 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:49:56.796173 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:49:56.796173 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:49:56.796173 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:49:56.796173 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:49:56.796173 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:49:56.796173 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:49:56.796173 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:49:56.796173 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:49:56.796173 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:49:56.796173 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:49:56.796173 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 10:49:56.797125 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 10:49:56.797125 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:49:56.797125 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:49:56.797125 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 227/470] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:49:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:49:56.797664 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a242cff6-4d12-4dda-97a5-647b6c69507b None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:56.797952 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a242cff6-4d12-4dda-97a5-647b6c69507b None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:56.798229 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a242cff6-4d12-4dda-97a5-647b6c69507b None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:56.799614 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 228/471] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:49:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:49:56.806380 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a242cff6-4d12-4dda-97a5-647b6c69507b None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:56.909090 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64ba551-4fa0-49b8-b358-2ebcd4a19e29 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:56.950874 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a242cff6-4d12-4dda-97a5-647b6c69507b None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:56.953493 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51fb1f1-9851-4ad2-86da-c0312c58edcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:56.954277 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51fb1f1-9851-4ad2-86da-c0312c58edcb None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:56.954568 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51fb1f1-9851-4ad2-86da-c0312c58edcb None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:56.954845 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51fb1f1-9851-4ad2-86da-c0312c58edcb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:56.967573 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51fb1f1-9851-4ad2-86da-c0312c58edcb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:56.969683 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51fb1f1-9851-4ad2-86da-c0312c58edcb None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:56.987152 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:56.988032 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-b51fb1f1-9851-4ad2-86da-c0312c58edcb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:49:56.988032 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:49:56.988032 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:49:56.988032 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:49:56.988032 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:49:56.988032 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:49:56.988032 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:49:56.988032 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:49:56.988032 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:49:56.988032 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:49:56.988032 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:49:56.988032 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:49:56.988032 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 10:49:56.988032 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 10:49:56.988032 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 10:49:56.988032 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 10:49:56.988886 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:49:56.988886 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:49:56.988886 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:49:56.988886 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:49:56.988886 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:49:56.988886 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:49:56.988886 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:49:56.988886 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:49:56.988886 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:49:56.988886 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:49:56.988886 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:49:56.988886 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:49:56.988886 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:49:56.988886 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:49:56.988886 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:49:56.988886 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:49:56.988886 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 10:49:56.989794 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 10:49:56.989794 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:49:56.989794 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:49:56.989794 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 244/472] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:49:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:49:56.991568 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b66df-c697-457a-96a0-03a383a23c09 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:56.991786 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b66df-c697-457a-96a0-03a383a23c09 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:56.994092 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b66df-c697-457a-96a0-03a383a23c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:57.009158 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a598e9d4-7863-4765-95d4-c2f8b15aaa3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:57.012228 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a598e9d4-7863-4765-95d4-c2f8b15aaa3e None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:57.012228 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a598e9d4-7863-4765-95d4-c2f8b15aaa3e None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:57.012228 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a598e9d4-7863-4765-95d4-c2f8b15aaa3e None admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:57.012228 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a598e9d4-7863-4765-95d4-c2f8b15aaa3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:49:57.012228 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a598e9d4-7863-4765-95d4-c2f8b15aaa3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:57.017161 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a598e9d4-7863-4765-95d4-c2f8b15aaa3e None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:57.018505 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-f05b66df-c697-457a-96a0-03a383a23c09 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:49:57.019702 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-f05b66df-c697-457a-96a0-03a383a23c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:49:57.032328 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 229/473] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 18 10:49:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:57.033413 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a598e9d4-7863-4765-95d4-c2f8b15aaa3e None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:57.066762 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:57.094794 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 245/474] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:49:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 10:49:57.095780 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05b66df-c697-457a-96a0-03a383a23c09 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:57.195841 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a598e9d4-7863-4765-95d4-c2f8b15aaa3e None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:57.262792 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0995339b-5e23-4f67-9ee6-0ff576e8f4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:57.263396 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0995339b-5e23-4f67-9ee6-0ff576e8f4ce None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:57.263675 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0995339b-5e23-4f67-9ee6-0ff576e8f4ce None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:57.263944 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0995339b-5e23-4f67-9ee6-0ff576e8f4ce None admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:57.264583 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0995339b-5e23-4f67-9ee6-0ff576e8f4ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:49:57.264880 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0995339b-5e23-4f67-9ee6-0ff576e8f4ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:57.266272 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0995339b-5e23-4f67-9ee6-0ff576e8f4ce None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:57.285349 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 230/475] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 18 10:49:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:57.296726 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0995339b-5e23-4f67-9ee6-0ff576e8f4ce None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:57.299455 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05b66df-c697-457a-96a0-03a383a23c09 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:57.359072 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:57.364654 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374ad471-d9d8-43e3-baf7-98229b497f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:57.365637 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ad471-d9d8-43e3-baf7-98229b497f9e None admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:57.366136 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ad471-d9d8-43e3-baf7-98229b497f9e None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:57.367002 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ad471-d9d8-43e3-baf7-98229b497f9e None admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:57.367891 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374ad471-d9d8-43e3-baf7-98229b497f9e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:57.370518 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374ad471-d9d8-43e3-baf7-98229b497f9e None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:57.395558 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 246/476] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Aug 18 10:49:57 2022] POST /identity/v3/users => generated 248 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 10:49:57.420564 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374ad471-d9d8-43e3-baf7-98229b497f9e None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:57.455581 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:57.458352 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0995339b-5e23-4f67-9ee6-0ff576e8f4ce None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:57.531698 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374ad471-d9d8-43e3-baf7-98229b497f9e None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:57.547878 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75da0e1b-27d6-42f9-bf89-33f35b975e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:57.548265 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da0e1b-27d6-42f9-bf89-33f35b975e53 None admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:57.548538 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da0e1b-27d6-42f9-bf89-33f35b975e53 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:57.548805 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da0e1b-27d6-42f9-bf89-33f35b975e53 None admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:57.549455 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75da0e1b-27d6-42f9-bf89-33f35b975e53 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:57.550963 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75da0e1b-27d6-42f9-bf89-33f35b975e53 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:57.573069 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19452b3f-2602-4653-8ccb-27a86efb0501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:57.574832 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19452b3f-2602-4653-8ccb-27a86efb0501 None admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:57.576063 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19452b3f-2602-4653-8ccb-27a86efb0501 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:57.576552 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19452b3f-2602-4653-8ccb-27a86efb0501 None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:57.578082 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19452b3f-2602-4653-8ccb-27a86efb0501 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:57.579723 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19452b3f-2602-4653-8ccb-27a86efb0501 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:57.595127 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 231/477] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Aug 18 10:49:57 2022] POST /identity/v3/users => generated 249 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 10:49:57.596435 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.sql.core [None req-19452b3f-2602-4653-8ccb-27a86efb0501 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 18 10:49:57.596435 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 18 10:49:57.596435 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [parameters: {'id': '926f3baa30e44d1684750df0f1f89a2c', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 18 10:49:57.596435 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81433) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 18 10:49:57.614149 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-19452b3f-2602-4653-8ccb-27a86efb0501 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 18 10:49:57.614149 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:49:57.614149 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 18 10:49:57.614149 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 18 10:49:57.614149 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 18 10:49:57.614149 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 18 10:49:57.614149 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 18 10:49:57.614149 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application result = self._query(query) Aug 18 10:49:57.614149 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 18 10:49:57.614149 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application conn.query(q) Aug 18 10:49:57.614149 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 18 10:49:57.614149 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 18 10:49:57.614149 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 18 10:49:57.614149 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application result.read() Aug 18 10:49:57.614149 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 18 10:49:57.615096 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 18 10:49:57.615096 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 18 10:49:57.615096 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 18 10:49:57.615096 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 18 10:49:57.615096 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 18 10:49:57.615096 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 18 10:49:57.615096 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 18 10:49:57.615096 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 18 10:49:57.615096 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:49:57.615096 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 18 10:49:57.615096 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:49:57.615096 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:49:57.615096 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 18 10:49:57.615096 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 18 10:49:57.615096 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 18 10:49:57.615096 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return ref.to_dict() Aug 18 10:49:57.615096 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 18 10:49:57.615096 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application next(self.gen) Aug 18 10:49:57.616026 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 18 10:49:57.616026 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application yield resource Aug 18 10:49:57.616026 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 18 10:49:57.616026 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application next(self.gen) Aug 18 10:49:57.616026 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 18 10:49:57.616026 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application self.session.rollback() Aug 18 10:49:57.616026 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 18 10:49:57.616026 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application self.force_reraise() Aug 18 10:49:57.616026 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 18 10:49:57.616026 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise self.value Aug 18 10:49:57.616026 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 18 10:49:57.616026 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 18 10:49:57.616026 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 18 10:49:57.616026 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application session.commit() Aug 18 10:49:57.616026 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 18 10:49:57.616026 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 18 10:49:57.616026 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 18 10:49:57.616865 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application self._prepare_impl() Aug 18 10:49:57.616865 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 18 10:49:57.616865 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application self.session.flush() Aug 18 10:49:57.616865 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 18 10:49:57.616865 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application self._flush(objects) Aug 18 10:49:57.616865 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 18 10:49:57.616865 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 18 10:49:57.616865 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 18 10:49:57.616865 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application compat.raise_( Aug 18 10:49:57.616865 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 18 10:49:57.616865 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception Aug 18 10:49:57.616865 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 18 10:49:57.616865 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application flush_context.execute() Aug 18 10:49:57.616865 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 18 10:49:57.616865 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rec.execute(self) Aug 18 10:49:57.616865 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 18 10:49:57.616865 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 18 10:49:57.618437 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 18 10:49:57.618437 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 18 10:49:57.618437 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 18 10:49:57.618437 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 18 10:49:57.618437 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 18 10:49:57.618437 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 18 10:49:57.618437 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 18 10:49:57.618437 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 18 10:49:57.618437 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 18 10:49:57.618437 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 18 10:49:57.618437 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 18 10:49:57.618437 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 18 10:49:57.618437 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 18 10:49:57.618437 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 18 10:49:57.618437 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 18 10:49:57.618437 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception Aug 18 10:49:57.619339 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 18 10:49:57.619339 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 18 10:49:57.619339 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 18 10:49:57.619339 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 18 10:49:57.619339 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 18 10:49:57.619339 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application result = self._query(query) Aug 18 10:49:57.619339 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 18 10:49:57.619339 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application conn.query(q) Aug 18 10:49:57.619339 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 18 10:49:57.619339 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 18 10:49:57.619339 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 18 10:49:57.619339 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application result.read() Aug 18 10:49:57.619339 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 18 10:49:57.619339 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 18 10:49:57.619339 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 18 10:49:57.619339 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 18 10:49:57.620106 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 18 10:49:57.620106 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 18 10:49:57.620106 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 18 10:49:57.620106 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 18 10:49:57.620106 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 18 10:49:57.620106 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 18 10:49:57.620106 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [parameters: {'id': '926f3baa30e44d1684750df0f1f89a2c', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 18 10:49:57.620106 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 18 10:49:57.620106 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:49:57.620106 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 10:49:57.620106 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:49:57.620106 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:49:57.620106 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:49:57.620106 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:49:57.620106 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:49:57.620106 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:49:57.620903 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:49:57.620903 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:49:57.620903 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:49:57.620903 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:49:57.620903 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:49:57.620903 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:49:57.620903 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 18 10:49:57.620903 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 18 10:49:57.620903 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:49:57.620903 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:49:57.620903 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 18 10:49:57.620903 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 18 10:49:57.620903 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 18 10:49:57.620903 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 18 10:49:57.620903 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 18 10:49:57.620903 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:49:57.623691 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 247/478] 10.222.0.15 () {60 vars in 1131 bytes} [Thu Aug 18 10:49:57 2022] POST /identity/v3/roles => generated 144 bytes in 203 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 18 10:49:57.629678 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75da0e1b-27d6-42f9-bf89-33f35b975e53 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:57.747100 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:57.749992 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75da0e1b-27d6-42f9-bf89-33f35b975e53 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:57.795877 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2154751d-2f12-4133-8b0a-7b6e481f67f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:57.796510 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2154751d-2f12-4133-8b0a-7b6e481f67f3 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:57.796795 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2154751d-2f12-4133-8b0a-7b6e481f67f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:57.797065 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2154751d-2f12-4133-8b0a-7b6e481f67f3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:57.809886 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2154751d-2f12-4133-8b0a-7b6e481f67f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:49:57.815289 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-2154751d-2f12-4133-8b0a-7b6e481f67f3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 10:49:57.815289 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:49:57.815289 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:49:57.815289 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:49:57.815289 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:49:57.815289 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:49:57.815289 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:49:57.815289 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:49:57.815289 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:49:57.815289 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:49:57.815289 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:49:57.815289 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:49:57.815289 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:49:57.815289 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:49:57.815289 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:49:57.815289 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:49:57.816648 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:49:57.816648 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:49:57.816648 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:49:57.816648 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:49:57.816648 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:49:57.816648 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:49:57.816648 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:49:57.816648 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:49:57.816648 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:49:57.816648 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:49:57.816648 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:49:57.816648 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:49:57.816648 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:49:57.816648 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:49:57.816648 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:49:57.816648 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:49:57.817847 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:49:57.817847 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:49:57.817847 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:49:57.817847 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:49:57.817847 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:49:57.817847 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:49:57.817847 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:49:57.817847 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:49:57.817847 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:49:57.817847 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:49:57.817847 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 10:49:57.817847 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:49:57.817847 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 232/479] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Aug 18 10:49:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:49:57.823840 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19452b3f-2602-4653-8ccb-27a86efb0501 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:57.939058 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:57.947134 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19452b3f-2602-4653-8ccb-27a86efb0501 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:57.988897 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ca1ea-4e90-4265-8dbb-686b47a89390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:57.989533 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ca1ea-4e90-4265-8dbb-686b47a89390 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:57.989829 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ca1ea-4e90-4265-8dbb-686b47a89390 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:57.990098 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ca1ea-4e90-4265-8dbb-686b47a89390 None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:57.990760 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1ca1ea-4e90-4265-8dbb-686b47a89390 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:49:57.991059 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1ca1ea-4e90-4265-8dbb-686b47a89390 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:57.993092 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1ca1ea-4e90-4265-8dbb-686b47a89390 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:58.003761 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 248/480] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 18 10:49:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:58.897140 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812f22d-463e-4bd9-bb39-93a847eb19f8 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:58.897958 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812f22d-463e-4bd9-bb39-93a847eb19f8 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:58.897958 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812f22d-463e-4bd9-bb39-93a847eb19f8 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:58.899793 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 233/481] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:49:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:49:58.905461 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da37b0-3e53-4614-b97d-0b13a8e4ecef None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:58.905995 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da37b0-3e53-4614-b97d-0b13a8e4ecef None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:58.906071 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da37b0-3e53-4614-b97d-0b13a8e4ecef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:58.934968 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-03da37b0-3e53-4614-b97d-0b13a8e4ecef None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:49:58.936172 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-03da37b0-3e53-4614-b97d-0b13a8e4ecef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:49:59.011906 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 249/482] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:49:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 10:49:59.328148 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2812f22d-463e-4bd9-bb39-93a847eb19f8 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:59.372294 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d74295-b894-4d58-b8b9-b5fa7141f3fa None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:59.372605 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d74295-b894-4d58-b8b9-b5fa7141f3fa None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:59.372852 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d74295-b894-4d58-b8b9-b5fa7141f3fa None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:59.374464 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 250/483] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:49:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:49:59.379334 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69749045-1730-4f4c-807b-bcc078bb0f20 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:59.379859 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69749045-1730-4f4c-807b-bcc078bb0f20 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:59.380325 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69749045-1730-4f4c-807b-bcc078bb0f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:59.409539 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-69749045-1730-4f4c-807b-bcc078bb0f20 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:49:59.411053 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-69749045-1730-4f4c-807b-bcc078bb0f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:49:59.444475 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2812f22d-463e-4bd9-bb39-93a847eb19f8 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:59.482462 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9fd310-7312-4220-b7d8-c559b17a2a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:59.483024 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9fd310-7312-4220-b7d8-c559b17a2a9e None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:59.483371 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9fd310-7312-4220-b7d8-c559b17a2a9e None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:59.483651 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9fd310-7312-4220-b7d8-c559b17a2a9e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:59.495463 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9fd310-7312-4220-b7d8-c559b17a2a9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:49:59.500720 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-2d9fd310-7312-4220-b7d8-c559b17a2a9e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 10:49:59.500720 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:49:59.500720 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:49:59.500720 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:49:59.500720 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:49:59.500720 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:49:59.500720 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:49:59.500720 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:49:59.500720 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:49:59.500720 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:49:59.500720 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:49:59.500720 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:49:59.500720 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:49:59.500720 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:49:59.500720 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:49:59.500720 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:49:59.501608 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:49:59.501608 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:49:59.501608 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:49:59.501608 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:49:59.501608 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:49:59.501608 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:49:59.501608 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:49:59.501608 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:49:59.501608 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:49:59.501608 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:49:59.501608 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:49:59.501608 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:49:59.501608 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:49:59.501608 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:49:59.501608 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:49:59.501608 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:49:59.502375 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:49:59.502375 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:49:59.502375 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:49:59.502375 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:49:59.502375 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:49:59.502375 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:49:59.502375 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:49:59.502375 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:49:59.502375 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:49:59.502375 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:49:59.502375 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 10:49:59.502375 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:49:59.502375 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 234/484] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Aug 18 10:49:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:49:59.508478 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9fd310-7312-4220-b7d8-c559b17a2a9e None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:59.534123 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:59.571255 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 251/485] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:49:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 10:49:59.619679 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9fd310-7312-4220-b7d8-c559b17a2a9e None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:59.655425 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f44191-c0e8-47a9-9c59-b2a4693ff9d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:59.656449 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f44191-c0e8-47a9-9c59-b2a4693ff9d4 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:59.656903 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f44191-c0e8-47a9-9c59-b2a4693ff9d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:59.657323 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f44191-c0e8-47a9-9c59-b2a4693ff9d4 None admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:59.658232 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f44191-c0e8-47a9-9c59-b2a4693ff9d4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:49:59.658680 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f44191-c0e8-47a9-9c59-b2a4693ff9d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:59.660244 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f44191-c0e8-47a9-9c59-b2a4693ff9d4 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:59.670153 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 235/486] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Aug 18 10:49:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:49:59.675984 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69749045-1730-4f4c-807b-bcc078bb0f20 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:59.696648 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:49:59.802308 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69749045-1730-4f4c-807b-bcc078bb0f20 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:49:59.849760 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07664c5b-56bb-4cae-aa20-9665c4645b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:49:59.850552 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07664c5b-56bb-4cae-aa20-9665c4645b88 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:59.850836 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07664c5b-56bb-4cae-aa20-9665c4645b88 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:59.851166 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07664c5b-56bb-4cae-aa20-9665c4645b88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:59.866565 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07664c5b-56bb-4cae-aa20-9665c4645b88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:49:59.868246 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07664c5b-56bb-4cae-aa20-9665c4645b88 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:49:59.888638 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-07664c5b-56bb-4cae-aa20-9665c4645b88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:49:59.888638 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:49:59.888638 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:49:59.888638 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:49:59.888638 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:49:59.888638 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:49:59.888638 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:49:59.888638 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:49:59.888638 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:49:59.888638 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:49:59.888638 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:49:59.888638 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:49:59.888638 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 10:49:59.888638 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 10:49:59.888638 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 10:49:59.888638 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 10:49:59.889611 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:49:59.889611 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:49:59.889611 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:49:59.889611 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:49:59.889611 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:49:59.889611 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:49:59.889611 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:49:59.889611 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:49:59.889611 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:49:59.889611 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:49:59.889611 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:49:59.889611 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:49:59.889611 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:49:59.889611 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:49:59.889611 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:49:59.889611 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:49:59.889611 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 10:49:59.890478 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 10:49:59.890478 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:49:59.890478 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:49:59.890478 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 252/487] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:49:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:49:59.896672 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f44191-c0e8-47a9-9c59-b2a4693ff9d4 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:49:59.935894 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb147fc-0c57-482f-af86-efd65971cfbb None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:59.936390 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb147fc-0c57-482f-af86-efd65971cfbb None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:59.936494 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb147fc-0c57-482f-af86-efd65971cfbb None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:59.938005 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 253/488] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:49:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:49:59.953560 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39f5f29-b83f-4b76-9fbe-a26f362a58b8 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:49:59.953560 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39f5f29-b83f-4b76-9fbe-a26f362a58b8 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:49:59.953560 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39f5f29-b83f-4b76-9fbe-a26f362a58b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:49:59.978171 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-b39f5f29-b83f-4b76-9fbe-a26f362a58b8 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:49:59.979708 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-b39f5f29-b83f-4b76-9fbe-a26f362a58b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:50:00.014141 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f44191-c0e8-47a9-9c59-b2a4693ff9d4 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:00.016280 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:00.051426 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:00.057282 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 254/489] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:49:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 10:50:00.058128 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3c553b-e6fe-4861-8151-5b3599bfcf0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:00.058706 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39f5f29-b83f-4b76-9fbe-a26f362a58b8 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:00.058828 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c553b-e6fe-4861-8151-5b3599bfcf0d None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:00.059010 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c553b-e6fe-4861-8151-5b3599bfcf0d None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:00.059448 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c553b-e6fe-4861-8151-5b3599bfcf0d None admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:00.060325 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3c553b-e6fe-4861-8151-5b3599bfcf0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:00.060806 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3c553b-e6fe-4861-8151-5b3599bfcf0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:00.062590 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3c553b-e6fe-4861-8151-5b3599bfcf0d None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:00.076381 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 236/490] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 18 10:49:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:00.082063 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3c553b-e6fe-4861-8151-5b3599bfcf0d None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:00.170258 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39f5f29-b83f-4b76-9fbe-a26f362a58b8 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:00.208720 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3c553b-e6fe-4861-8151-5b3599bfcf0d None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:00.222171 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307f1fab-f18a-4f1e-9509-b809aa9c1131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:00.222171 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f1fab-f18a-4f1e-9509-b809aa9c1131 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:00.222171 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f1fab-f18a-4f1e-9509-b809aa9c1131 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:00.222171 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f1fab-f18a-4f1e-9509-b809aa9c1131 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:00.255439 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36e99b9-530b-466d-83e1-8d0d939b4f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:00.256469 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e99b9-530b-466d-83e1-8d0d939b4f63 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:00.256970 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e99b9-530b-466d-83e1-8d0d939b4f63 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:00.257445 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e99b9-530b-466d-83e1-8d0d939b4f63 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:00.259134 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307f1fab-f18a-4f1e-9509-b809aa9c1131 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:50:00.264283 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-307f1fab-f18a-4f1e-9509-b809aa9c1131 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 10:50:00.264283 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:00.264283 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:00.264283 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:00.264283 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:00.264283 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:00.264283 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:00.264283 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:00.264283 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:00.264283 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:00.264283 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:00.264283 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:00.264283 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:50:00.264283 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:50:00.264283 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:50:00.264283 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:50:00.265198 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:50:00.265198 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:50:00.265198 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:50:00.265198 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:50:00.265198 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:00.265198 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:00.265198 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:00.265198 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:00.265198 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:00.265198 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:00.265198 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:00.265198 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:00.265198 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:00.265198 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:00.265198 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:00.265198 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:00.266427 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:00.266427 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:00.266427 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:00.266427 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:00.266427 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:50:00.266427 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:50:00.266427 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:50:00.266427 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:50:00.266427 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:50:00.266427 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:50:00.266427 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 10:50:00.266427 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:00.266427 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 255/491] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Aug 18 10:50:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:00.271316 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36e99b9-530b-466d-83e1-8d0d939b4f63 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:00.274112 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36e99b9-530b-466d-83e1-8d0d939b4f63 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:00.279548 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307f1fab-f18a-4f1e-9509-b809aa9c1131 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:00.289085 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-a36e99b9-530b-466d-83e1-8d0d939b4f63 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 10:50:00.289085 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:00.289085 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:00.289085 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:00.289085 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:00.289085 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:00.289085 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:00.289085 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:00.289085 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:00.289085 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:00.289085 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:00.289085 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:00.289085 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 10:50:00.289085 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 10:50:00.289085 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 10:50:00.289085 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 10:50:00.290335 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:00.290335 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:00.290335 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 10:50:00.290335 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 10:50:00.290335 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 10:50:00.290335 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 10:50:00.290335 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:00.290335 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:00.290335 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:00.290335 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:00.290335 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:00.290335 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:00.290335 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:00.290335 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:00.290335 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:00.290335 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:00.290335 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:00.290335 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:00.291412 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:00.291412 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:00.291412 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 10:50:00.291412 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 10:50:00.291412 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 10:50:00.291412 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 10:50:00.291412 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 10:50:00.291412 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 10:50:00.291412 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 10:50:00.291412 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:00.293980 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 237/492] 10.222.0.15 () {56 vars in 1093 bytes} [Thu Aug 18 10:50:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 10:50:00.299127 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36e99b9-530b-466d-83e1-8d0d939b4f63 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:00.306390 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:00.394895 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:00.420468 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36e99b9-530b-466d-83e1-8d0d939b4f63 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:00.443560 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307f1fab-f18a-4f1e-9509-b809aa9c1131 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:00.459815 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b80ed1-0f02-4f04-b8ab-9572e7d1be5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:00.460430 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b80ed1-0f02-4f04-b8ab-9572e7d1be5c None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:00.460712 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b80ed1-0f02-4f04-b8ab-9572e7d1be5c None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:00.461594 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b80ed1-0f02-4f04-b8ab-9572e7d1be5c None admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:00.462337 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b80ed1-0f02-4f04-b8ab-9572e7d1be5c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:00.462641 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b80ed1-0f02-4f04-b8ab-9572e7d1be5c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:00.464134 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b80ed1-0f02-4f04-b8ab-9572e7d1be5c None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:00.484680 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8decbc8-69b8-4b5e-ac6a-0ae415db2e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:00.485291 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8decbc8-69b8-4b5e-ac6a-0ae415db2e5d None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:00.485597 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8decbc8-69b8-4b5e-ac6a-0ae415db2e5d None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:00.485874 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8decbc8-69b8-4b5e-ac6a-0ae415db2e5d None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:00.486889 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8decbc8-69b8-4b5e-ac6a-0ae415db2e5d None admin] RBAC: Adding query filter params (name=service) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:00.487434 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8decbc8-69b8-4b5e-ac6a-0ae415db2e5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:00.489533 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8decbc8-69b8-4b5e-ac6a-0ae415db2e5d None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:00.503922 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 256/493] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Aug 18 10:50:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:00.503922 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d82faa-4569-4242-a9a8-8f572d5aea7f None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:00.503922 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d82faa-4569-4242-a9a8-8f572d5aea7f None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:00.503922 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d82faa-4569-4242-a9a8-8f572d5aea7f None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:00.503922 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 257/494] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:50:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:50:00.503922 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d82faa-4569-4242-a9a8-8f572d5aea7f None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:00.511664 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 238/495] 10.222.0.15 () {56 vars in 1133 bytes} [Thu Aug 18 10:50:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:00.516385 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b80ed1-0f02-4f04-b8ab-9572e7d1be5c None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:00.582861 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:00.638740 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d82faa-4569-4242-a9a8-8f572d5aea7f None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:00.650767 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b80ed1-0f02-4f04-b8ab-9572e7d1be5c None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:00.672806 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:00.690230 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb11b7b-f566-4635-96c6-0e516d9be1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:00.690864 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb11b7b-f566-4635-96c6-0e516d9be1ed None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:00.691143 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb11b7b-f566-4635-96c6-0e516d9be1ed None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:00.691416 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb11b7b-f566-4635-96c6-0e516d9be1ed None admin] PATH_INFO: `/v3/roles/service` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:00.702620 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f390359f-b47c-4d73-8a41-98951ece7f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:00.703257 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f390359f-b47c-4d73-8a41-98951ece7f47 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:00.703536 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f390359f-b47c-4d73-8a41-98951ece7f47 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:00.703815 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f390359f-b47c-4d73-8a41-98951ece7f47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:00.704632 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb11b7b-f566-4635-96c6-0e516d9be1ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:50:00.709314 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-9eb11b7b-f566-4635-96c6-0e516d9be1ed None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 10:50:00.709314 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:00.709314 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:00.709314 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:00.709314 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:00.709314 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:00.709314 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:00.709314 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:00.709314 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:00.709314 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:00.709314 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:00.709314 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:00.709314 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:50:00.709314 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:50:00.709314 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:50:00.709314 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:50:00.710431 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:50:00.710431 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:50:00.710431 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:50:00.710431 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:50:00.710431 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:00.710431 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:00.710431 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:00.710431 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:00.710431 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:00.710431 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:00.710431 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:00.710431 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:00.710431 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:00.710431 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:00.710431 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:00.710431 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:00.711484 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:00.711484 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:00.711484 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:00.711484 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:00.711484 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:50:00.711484 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:50:00.711484 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:50:00.711484 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:50:00.711484 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:50:00.711484 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:50:00.711484 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 10:50:00.711484 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:00.711484 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 258/496] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Aug 18 10:50:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:00.712673 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f504e-e7de-443e-8772-9d11ce71092e None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:00.712673 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f504e-e7de-443e-8772-9d11ce71092e None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:00.712673 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f504e-e7de-443e-8772-9d11ce71092e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:00.715855 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f390359f-b47c-4d73-8a41-98951ece7f47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:00.717291 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f390359f-b47c-4d73-8a41-98951ece7f47 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:00.730187 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-7b3f504e-e7de-443e-8772-9d11ce71092e None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:50:00.731386 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-7b3f504e-e7de-443e-8772-9d11ce71092e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:50:00.733099 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-f390359f-b47c-4d73-8a41-98951ece7f47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:00.733099 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:00.733099 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:00.733099 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:00.733099 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:00.733099 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:00.733099 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:00.733099 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:00.733099 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:00.733099 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:00.733099 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:00.733099 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:00.733099 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 10:50:00.733099 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 10:50:00.733099 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 10:50:00.733099 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 10:50:00.733979 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:00.733979 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:00.733979 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:00.733979 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:00.733979 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:00.733979 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:00.733979 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:00.733979 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:00.733979 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:00.733979 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:00.733979 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:00.733979 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:00.733979 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:00.733979 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:00.733979 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:00.733979 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:00.733979 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 10:50:00.736425 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 10:50:00.736425 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:00.736425 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:00.736425 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 239/497] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:50:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:00.736425 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f390359f-b47c-4d73-8a41-98951ece7f47 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:00.802485 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 259/498] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:50:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 10:50:00.804108 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8bfcc6-6aa1-4b22-9019-3b0364d129c4 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:00.804394 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8bfcc6-6aa1-4b22-9019-3b0364d129c4 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:00.805344 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8bfcc6-6aa1-4b22-9019-3b0364d129c4 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:00.806602 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 260/499] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:50:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:50:00.807305 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8bfcc6-6aa1-4b22-9019-3b0364d129c4 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:00.856948 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f390359f-b47c-4d73-8a41-98951ece7f47 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:00.870632 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:00.895535 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef94dc50-b6bb-407a-8296-9c13b1b03703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:00.896141 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef94dc50-b6bb-407a-8296-9c13b1b03703 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:00.896412 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef94dc50-b6bb-407a-8296-9c13b1b03703 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:00.896679 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef94dc50-b6bb-407a-8296-9c13b1b03703 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:00.925016 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8bfcc6-6aa1-4b22-9019-3b0364d129c4 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:00.940473 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:00.969555 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93432e9a-c3ed-4ace-88dd-b57d23d75c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:00.970176 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93432e9a-c3ed-4ace-88dd-b57d23d75c2a None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:00.970460 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93432e9a-c3ed-4ace-88dd-b57d23d75c2a None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:00.970738 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93432e9a-c3ed-4ace-88dd-b57d23d75c2a None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:00.971405 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93432e9a-c3ed-4ace-88dd-b57d23d75c2a None admin] RBAC: Adding query filter params (name=service) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:00.971711 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93432e9a-c3ed-4ace-88dd-b57d23d75c2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:00.973113 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93432e9a-c3ed-4ace-88dd-b57d23d75c2a None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:00.979472 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef94dc50-b6bb-407a-8296-9c13b1b03703 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:00.981427 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef94dc50-b6bb-407a-8296-9c13b1b03703 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:00.981726 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 261/500] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Aug 18 10:50:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:00.982538 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93432e9a-c3ed-4ace-88dd-b57d23d75c2a None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:01.096255 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 240/501] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 18 10:50:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 10:50:01.096781 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93432e9a-c3ed-4ace-88dd-b57d23d75c2a None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:01.097494 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff673be-a2d0-4495-9180-09fcc147ba63 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:01.097807 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff673be-a2d0-4495-9180-09fcc147ba63 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:01.098087 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff673be-a2d0-4495-9180-09fcc147ba63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:01.115309 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-cff673be-a2d0-4495-9180-09fcc147ba63 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:50:01.116514 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-cff673be-a2d0-4495-9180-09fcc147ba63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:50:01.124163 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:01.131724 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d3235-0764-4017-a1ec-1863d9f23c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:01.132353 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d3235-0764-4017-a1ec-1863d9f23c89 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:01.133178 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d3235-0764-4017-a1ec-1863d9f23c89 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:01.133680 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d3235-0764-4017-a1ec-1863d9f23c89 None admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:01.134354 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8d3235-0764-4017-a1ec-1863d9f23c89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:01.134657 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8d3235-0764-4017-a1ec-1863d9f23c89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:01.136004 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8d3235-0764-4017-a1ec-1863d9f23c89 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:01.148033 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 262/502] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 18 10:50:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:01.149433 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d3235-0764-4017-a1ec-1863d9f23c89 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:01.183376 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:01.186840 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 241/503] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:50:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 10:50:01.187696 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff673be-a2d0-4495-9180-09fcc147ba63 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:01.257421 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d3235-0764-4017-a1ec-1863d9f23c89 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:01.293767 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d85c29c-11cf-44ea-9bcb-95c021e4bfe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:01.294405 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d85c29c-11cf-44ea-9bcb-95c021e4bfe4 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:01.294718 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d85c29c-11cf-44ea-9bcb-95c021e4bfe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:01.294955 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d85c29c-11cf-44ea-9bcb-95c021e4bfe4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:01.301049 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff673be-a2d0-4495-9180-09fcc147ba63 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:01.306855 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d85c29c-11cf-44ea-9bcb-95c021e4bfe4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:01.309558 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d85c29c-11cf-44ea-9bcb-95c021e4bfe4 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:01.326492 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-4d85c29c-11cf-44ea-9bcb-95c021e4bfe4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:01.326492 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:01.326492 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:01.326492 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:01.326492 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:01.326492 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:01.326492 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:01.326492 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:01.326492 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:01.326492 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:01.326492 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:01.326492 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:01.326492 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 10:50:01.326492 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 10:50:01.326492 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 10:50:01.326492 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 10:50:01.332524 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:01.332524 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:01.332524 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:01.332524 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:01.332524 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:01.332524 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:01.332524 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:01.332524 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:01.332524 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:01.332524 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:01.332524 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:01.332524 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:01.332524 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:01.332524 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:01.332524 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:01.332524 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:01.332524 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 10:50:01.333669 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 10:50:01.333669 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:01.333669 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:01.333669 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 263/504] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:50:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:01.333669 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d85c29c-11cf-44ea-9bcb-95c021e4bfe4 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:01.347358 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e578e6c-a9e2-4bf0-a98e-3c258c0ab2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:01.347991 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e578e6c-a9e2-4bf0-a98e-3c258c0ab2d7 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:01.348272 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e578e6c-a9e2-4bf0-a98e-3c258c0ab2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:01.348530 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e578e6c-a9e2-4bf0-a98e-3c258c0ab2d7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:01.359927 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e578e6c-a9e2-4bf0-a98e-3c258c0ab2d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:50:01.364504 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-4e578e6c-a9e2-4bf0-a98e-3c258c0ab2d7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 10:50:01.364504 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:01.364504 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:01.364504 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:01.364504 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:01.364504 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:01.364504 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:01.364504 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:01.364504 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:01.364504 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:01.364504 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:01.364504 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:01.364504 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:50:01.364504 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:50:01.364504 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:50:01.364504 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:50:01.365463 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:50:01.365463 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:50:01.365463 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:50:01.365463 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:50:01.365463 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:01.365463 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:01.365463 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:01.365463 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:01.365463 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:01.365463 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:01.365463 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:01.365463 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:01.365463 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:01.365463 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:01.365463 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:01.365463 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:01.366301 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:01.366301 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:01.366301 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:01.366301 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:01.366301 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:50:01.366301 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:50:01.366301 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:50:01.366301 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:50:01.366301 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:50:01.366301 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:50:01.366301 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 10:50:01.366301 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:01.370986 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 242/505] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Aug 18 10:50:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:01.371836 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e578e6c-a9e2-4bf0-a98e-3c258c0ab2d7 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:01.375975 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:01.427571 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:01.444753 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d85c29c-11cf-44ea-9bcb-95c021e4bfe4 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:01.480987 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a013d1-e740-4eca-87d7-ea00f9e9acdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:01.481740 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a013d1-e740-4eca-87d7-ea00f9e9acdc None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:01.482020 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a013d1-e740-4eca-87d7-ea00f9e9acdc None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:01.482293 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a013d1-e740-4eca-87d7-ea00f9e9acdc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:01.482462 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e578e6c-a9e2-4bf0-a98e-3c258c0ab2d7 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:01.493061 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a013d1-e740-4eca-87d7-ea00f9e9acdc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:01.494585 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a013d1-e740-4eca-87d7-ea00f9e9acdc None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:01.508862 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-36a013d1-e740-4eca-87d7-ea00f9e9acdc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:01.508862 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:01.508862 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:01.508862 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:01.508862 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:01.508862 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:01.508862 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:01.508862 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:01.508862 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:01.508862 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:01.508862 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:01.508862 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:01.508862 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 10:50:01.508862 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 10:50:01.508862 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 10:50:01.508862 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 10:50:01.509992 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:01.509992 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:01.509992 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:01.509992 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:01.509992 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:01.509992 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:01.509992 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:01.509992 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:01.509992 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:01.509992 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:01.509992 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:01.509992 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:01.509992 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:01.509992 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:01.509992 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:01.509992 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:01.509992 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 10:50:01.510846 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 10:50:01.510846 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:01.510846 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:01.510846 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 264/506] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:50:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:01.510846 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a013d1-e740-4eca-87d7-ea00f9e9acdc None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:01.519731 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5908f06-dfd9-43c7-bbb0-b6531edcf430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:01.520353 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5908f06-dfd9-43c7-bbb0-b6531edcf430 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:01.520630 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5908f06-dfd9-43c7-bbb0-b6531edcf430 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:01.520896 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5908f06-dfd9-43c7-bbb0-b6531edcf430 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:01.529333 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5908f06-dfd9-43c7-bbb0-b6531edcf430 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:01.530838 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5908f06-dfd9-43c7-bbb0-b6531edcf430 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:01.542243 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-a5908f06-dfd9-43c7-bbb0-b6531edcf430 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 18 10:50:01.542243 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:01.542243 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:01.542243 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:01.542243 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:01.542243 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:01.542243 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:01.542243 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:01.542243 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:01.542243 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:01.542243 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:01.542243 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:01.542243 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 10:50:01.542243 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 10:50:01.542243 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 10:50:01.542243 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 10:50:01.543283 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:01.543283 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:01.543283 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 10:50:01.543283 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 10:50:01.543283 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 10:50:01.543283 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 10:50:01.543283 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:01.543283 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:01.543283 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:01.543283 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:01.543283 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:01.543283 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:01.543283 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:01.543283 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:01.543283 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:01.543283 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:01.543283 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:01.543283 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:01.544443 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:01.544443 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:01.544443 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 10:50:01.544443 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 10:50:01.544443 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 10:50:01.544443 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 10:50:01.544443 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 10:50:01.544443 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 10:50:01.544443 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 18 10:50:01.544443 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:01.544443 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 243/507] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 18 10:50:01 2022] GET /identity/v3/users/glance => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:01.548664 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5908f06-dfd9-43c7-bbb0-b6531edcf430 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:01.610329 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:01.612257 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a013d1-e740-4eca-87d7-ea00f9e9acdc None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:01.645179 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33da5af-635e-4714-9bb6-8527175ad81e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:01.645814 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33da5af-635e-4714-9bb6-8527175ad81e None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:01.646086 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33da5af-635e-4714-9bb6-8527175ad81e None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:01.646360 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33da5af-635e-4714-9bb6-8527175ad81e None admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:01.646995 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33da5af-635e-4714-9bb6-8527175ad81e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:01.647297 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33da5af-635e-4714-9bb6-8527175ad81e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:01.649551 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33da5af-635e-4714-9bb6-8527175ad81e None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:01.651269 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5908f06-dfd9-43c7-bbb0-b6531edcf430 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:01.656436 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:01.662179 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 265/508] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 18 10:50:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:01.662987 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33da5af-635e-4714-9bb6-8527175ad81e None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:01.689876 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5531e7-a557-43e6-b13c-88e9e37e44aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:01.690481 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5531e7-a557-43e6-b13c-88e9e37e44aa None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:01.690760 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5531e7-a557-43e6-b13c-88e9e37e44aa None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:01.691035 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5531e7-a557-43e6-b13c-88e9e37e44aa None admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:01.691693 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5531e7-a557-43e6-b13c-88e9e37e44aa None admin] RBAC: Adding query filter params (name=service) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:01.691994 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5531e7-a557-43e6-b13c-88e9e37e44aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:01.693353 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5531e7-a557-43e6-b13c-88e9e37e44aa None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:01.702693 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 244/509] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Aug 18 10:50:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:01.703452 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5531e7-a557-43e6-b13c-88e9e37e44aa None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:01.764247 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33da5af-635e-4714-9bb6-8527175ad81e None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:01.798383 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4ce83c-2273-4968-8077-ec68d75be482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:01.799088 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ce83c-2273-4968-8077-ec68d75be482 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:01.799370 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ce83c-2273-4968-8077-ec68d75be482 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:01.799741 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ce83c-2273-4968-8077-ec68d75be482 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:01.806116 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5531e7-a557-43e6-b13c-88e9e37e44aa None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:01.810470 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4ce83c-2273-4968-8077-ec68d75be482 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:01.811969 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4ce83c-2273-4968-8077-ec68d75be482 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:01.826482 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-7f4ce83c-2273-4968-8077-ec68d75be482 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:01.826482 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:01.826482 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:01.826482 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:01.826482 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:01.826482 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:01.826482 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:01.826482 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:01.826482 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:01.826482 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:01.826482 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:01.826482 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:01.826482 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 10:50:01.826482 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 10:50:01.826482 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 10:50:01.826482 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 10:50:01.827530 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:01.827530 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:01.827530 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:01.827530 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:01.827530 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:01.827530 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:01.827530 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:01.827530 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:01.827530 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:01.827530 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:01.827530 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:01.827530 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:01.827530 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:01.827530 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:01.827530 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:01.827530 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:01.827530 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 10:50:01.828360 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 10:50:01.828360 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:01.828360 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:01.828360 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 266/510] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:50:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:01.828576 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4ce83c-2273-4968-8077-ec68d75be482 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:01.832107 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:01.844644 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c389f275-2675-46de-8d16-79398dd5db77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:01.845251 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c389f275-2675-46de-8d16-79398dd5db77 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:01.845552 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c389f275-2675-46de-8d16-79398dd5db77 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:01.845827 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c389f275-2675-46de-8d16-79398dd5db77 None admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:01.846477 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c389f275-2675-46de-8d16-79398dd5db77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:01.846784 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c389f275-2675-46de-8d16-79398dd5db77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:01.848176 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c389f275-2675-46de-8d16-79398dd5db77 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:01.860894 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 245/511] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 18 10:50:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:01.861935 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c389f275-2675-46de-8d16-79398dd5db77 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:01.881552 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:01.938350 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4ce83c-2273-4968-8077-ec68d75be482 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:01.968472 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c389f275-2675-46de-8d16-79398dd5db77 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:01.972299 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34e1aa5-d5f9-4164-becc-e02e6c15863c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:01.972896 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34e1aa5-d5f9-4164-becc-e02e6c15863c None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:01.973174 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34e1aa5-d5f9-4164-becc-e02e6c15863c None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:01.973447 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34e1aa5-d5f9-4164-becc-e02e6c15863c None admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:01.974200 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34e1aa5-d5f9-4164-becc-e02e6c15863c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:01.974508 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34e1aa5-d5f9-4164-becc-e02e6c15863c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:01.975928 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34e1aa5-d5f9-4164-becc-e02e6c15863c None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:02.004128 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ab2c19-237d-4d82-b48e-abf8aeb25f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:02.004760 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ab2c19-237d-4d82-b48e-abf8aeb25f5a None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:02.005041 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ab2c19-237d-4d82-b48e-abf8aeb25f5a None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:02.005314 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ab2c19-237d-4d82-b48e-abf8aeb25f5a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:02.012657 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ab2c19-237d-4d82-b48e-abf8aeb25f5a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:02.012970 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 267/512] 10.222.0.15 () {56 vars in 1137 bytes} [Thu Aug 18 10:50:01 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:02.013829 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34e1aa5-d5f9-4164-becc-e02e6c15863c None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:02.014224 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ab2c19-237d-4d82-b48e-abf8aeb25f5a None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:02.027252 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-e4ab2c19-237d-4d82-b48e-abf8aeb25f5a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 10:50:02.027252 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:02.027252 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:02.027252 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:02.027252 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:02.027252 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:02.027252 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:02.027252 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:02.027252 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:02.027252 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:02.027252 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:02.027252 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:02.027252 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 10:50:02.027252 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 10:50:02.027252 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 10:50:02.027252 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 10:50:02.028236 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:02.028236 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:02.028236 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 10:50:02.028236 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 10:50:02.028236 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 10:50:02.028236 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 10:50:02.028236 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:02.028236 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:02.028236 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:02.028236 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:02.028236 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:02.028236 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:02.028236 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:02.028236 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:02.028236 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:02.028236 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:02.028236 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:02.028236 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:02.029153 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:02.029153 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:02.029153 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 10:50:02.029153 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 10:50:02.029153 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 10:50:02.029153 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 10:50:02.029153 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 10:50:02.029153 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 10:50:02.029153 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 10:50:02.029153 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:02.029153 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 246/513] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 18 10:50:01 2022] GET /identity/v3/users/cinder => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:02.029153 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ab2c19-237d-4d82-b48e-abf8aeb25f5a None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:02.075289 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:02.121588 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34e1aa5-d5f9-4164-becc-e02e6c15863c None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:02.130917 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:02.132433 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ab2c19-237d-4d82-b48e-abf8aeb25f5a None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:02.157535 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd00b20-a440-4203-9998-5ecd8cad3a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:02.158183 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd00b20-a440-4203-9998-5ecd8cad3a30 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:02.158460 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd00b20-a440-4203-9998-5ecd8cad3a30 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:02.158725 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd00b20-a440-4203-9998-5ecd8cad3a30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:02.167493 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acef7ffd-dddd-4833-baa4-b1b4104ab4ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:02.168152 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef7ffd-dddd-4833-baa4-b1b4104ab4ab None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:02.168375 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef7ffd-dddd-4833-baa4-b1b4104ab4ab None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:02.168567 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd00b20-a440-4203-9998-5ecd8cad3a30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:02.168659 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef7ffd-dddd-4833-baa4-b1b4104ab4ab None admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:02.169277 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acef7ffd-dddd-4833-baa4-b1b4104ab4ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:02.169612 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acef7ffd-dddd-4833-baa4-b1b4104ab4ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:02.170056 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd00b20-a440-4203-9998-5ecd8cad3a30 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:02.170963 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acef7ffd-dddd-4833-baa4-b1b4104ab4ab None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:02.184023 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 247/514] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 18 10:50:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:02.184862 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acef7ffd-dddd-4833-baa4-b1b4104ab4ab None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:02.186168 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-3bd00b20-a440-4203-9998-5ecd8cad3a30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:02.186168 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:02.186168 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:02.186168 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:02.186168 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:02.186168 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:02.186168 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:02.186168 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:02.186168 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:02.186168 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:02.186168 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:02.186168 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:02.186168 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 10:50:02.186168 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 10:50:02.186168 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 10:50:02.186168 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 10:50:02.187044 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:02.187044 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:02.187044 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:02.187044 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:02.187044 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:02.187044 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:02.187044 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:02.187044 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:02.187044 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:02.187044 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:02.187044 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:02.187044 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:02.187044 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:02.187044 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:02.187044 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:02.187044 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:02.187044 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 10:50:02.192490 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 10:50:02.192490 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:02.192490 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:02.192490 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 268/515] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:50:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:02.192490 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd00b20-a440-4203-9998-5ecd8cad3a30 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:02.292539 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd00b20-a440-4203-9998-5ecd8cad3a30 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:02.302663 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acef7ffd-dddd-4833-baa4-b1b4104ab4ab None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:02.305871 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:02.326882 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3837ac2-002c-4a4f-83b5-8015f639fd8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:02.327489 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3837ac2-002c-4a4f-83b5-8015f639fd8e None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:02.327765 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3837ac2-002c-4a4f-83b5-8015f639fd8e None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:02.328036 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3837ac2-002c-4a4f-83b5-8015f639fd8e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:02.341606 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5873fc-a40b-4a6a-997e-b8d24b3b78ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:02.342256 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5873fc-a40b-4a6a-997e-b8d24b3b78ee None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:02.342537 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5873fc-a40b-4a6a-997e-b8d24b3b78ee None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:02.342811 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5873fc-a40b-4a6a-997e-b8d24b3b78ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:02.350075 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5873fc-a40b-4a6a-997e-b8d24b3b78ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:02.352192 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5873fc-a40b-4a6a-997e-b8d24b3b78ee None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:02.362065 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:02.364170 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-0c5873fc-a40b-4a6a-997e-b8d24b3b78ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 10:50:02.364170 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:02.364170 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:02.364170 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:02.364170 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:02.364170 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:02.364170 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:02.364170 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:02.364170 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:02.364170 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:02.364170 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:02.364170 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:02.364170 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 10:50:02.364170 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 10:50:02.364170 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 10:50:02.365045 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 10:50:02.365045 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:02.365045 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:02.365045 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:02.365045 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:02.365045 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:02.365045 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:02.365045 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:02.365045 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:02.365045 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:02.365045 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:02.365045 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:02.365045 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:02.365045 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:02.365045 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:02.365045 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:02.365045 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:02.365928 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 10:50:02.365928 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 10:50:02.365928 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 10:50:02.365928 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 10:50:02.365928 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 10:50:02.365928 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 10:50:02.365928 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 10:50:02.365928 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:02.365928 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 248/516] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 18 10:50:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:02.366447 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5873fc-a40b-4a6a-997e-b8d24b3b78ee None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:02.407668 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3837ac2-002c-4a4f-83b5-8015f639fd8e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:02.409127 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3837ac2-002c-4a4f-83b5-8015f639fd8e None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:02.471113 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5873fc-a40b-4a6a-997e-b8d24b3b78ee None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:02.505347 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993b7212-2338-4400-bc5c-efac554e24c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:02.505976 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b7212-2338-4400-bc5c-efac554e24c0 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:02.506255 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b7212-2338-4400-bc5c-efac554e24c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:02.506531 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b7212-2338-4400-bc5c-efac554e24c0 None admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:02.507257 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993b7212-2338-4400-bc5c-efac554e24c0 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:02.508079 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993b7212-2338-4400-bc5c-efac554e24c0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:02.509668 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993b7212-2338-4400-bc5c-efac554e24c0 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:02.509855 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 269/517] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 18 10:50:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 10:50:02.510632 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3837ac2-002c-4a4f-83b5-8015f639fd8e None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:02.531612 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 249/518] 10.222.0.15 () {56 vars in 1137 bytes} [Thu Aug 18 10:50:02 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:02.532439 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993b7212-2338-4400-bc5c-efac554e24c0 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:02.556986 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:02.572442 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:02.613437 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3837ac2-002c-4a4f-83b5-8015f639fd8e None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:02.632821 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993b7212-2338-4400-bc5c-efac554e24c0 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:02.647953 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2239d74e-b025-4209-8c49-00607f6adb18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:02.649021 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2239d74e-b025-4209-8c49-00607f6adb18 None admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:02.649302 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2239d74e-b025-4209-8c49-00607f6adb18 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:02.649603 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2239d74e-b025-4209-8c49-00607f6adb18 None admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:02.650252 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2239d74e-b025-4209-8c49-00607f6adb18 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:02.651692 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2239d74e-b025-4209-8c49-00607f6adb18 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:02.668488 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3be4b49-3425-4e50-865d-0c6e68ab0613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:02.669356 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3be4b49-3425-4e50-865d-0c6e68ab0613 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:02.669814 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3be4b49-3425-4e50-865d-0c6e68ab0613 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:02.670093 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3be4b49-3425-4e50-865d-0c6e68ab0613 None admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:02.670762 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3be4b49-3425-4e50-865d-0c6e68ab0613 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:02.671069 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3be4b49-3425-4e50-865d-0c6e68ab0613 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:02.672442 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3be4b49-3425-4e50-865d-0c6e68ab0613 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:02.672676 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 270/519] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Aug 18 10:50:02 2022] POST /identity/v3/users => generated 247 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 10:50:02.673490 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2239d74e-b025-4209-8c49-00607f6adb18 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:02.687803 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 250/520] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 18 10:50:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:02.689051 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3be4b49-3425-4e50-865d-0c6e68ab0613 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:02.794941 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:02.806117 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2239d74e-b025-4209-8c49-00607f6adb18 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:02.819168 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3be4b49-3425-4e50-865d-0c6e68ab0613 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:02.828309 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:02.856666 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b68ad-e738-4cac-8810-13cea9f4b7a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:02.857318 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b68ad-e738-4cac-8810-13cea9f4b7a3 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:02.857626 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b68ad-e738-4cac-8810-13cea9f4b7a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:02.857901 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b68ad-e738-4cac-8810-13cea9f4b7a3 None admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:02.858602 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91b68ad-e738-4cac-8810-13cea9f4b7a3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:02.858904 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91b68ad-e738-4cac-8810-13cea9f4b7a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:02.860357 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91b68ad-e738-4cac-8810-13cea9f4b7a3 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:02.863372 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f85572-b246-44c3-8391-981828a436c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:02.864013 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f85572-b246-44c3-8391-981828a436c2 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:02.864294 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f85572-b246-44c3-8391-981828a436c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:02.864570 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f85572-b246-44c3-8391-981828a436c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:02.877887 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f85572-b246-44c3-8391-981828a436c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:02.879350 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f85572-b246-44c3-8391-981828a436c2 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:02.881396 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 271/521] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Aug 18 10:50:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:02.887113 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b68ad-e738-4cac-8810-13cea9f4b7a3 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:02.895782 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-b6f85572-b246-44c3-8391-981828a436c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:02.895782 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:02.895782 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:02.895782 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:02.895782 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:02.895782 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:02.895782 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:02.895782 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:02.895782 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:02.895782 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:02.895782 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:02.895782 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:02.895782 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 10:50:02.895782 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 10:50:02.895782 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 10:50:02.895782 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 10:50:02.896733 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:02.896733 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:02.896733 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:02.896733 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:02.896733 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:02.896733 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:02.896733 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:02.896733 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:02.896733 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:02.896733 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:02.896733 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:02.896733 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:02.896733 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:02.896733 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:02.896733 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:02.896733 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:02.896733 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 10:50:02.897877 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 10:50:02.897877 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:02.897877 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:02.897877 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 251/522] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:50:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:02.898562 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f85572-b246-44c3-8391-981828a436c2 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:03.001627 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b68ad-e738-4cac-8810-13cea9f4b7a3 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:03.014891 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f85572-b246-44c3-8391-981828a436c2 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:03.039558 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f91d33-43e2-4c38-9495-d495eb1a2f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:03.040363 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f91d33-43e2-4c38-9495-d495eb1a2f30 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:03.040642 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f91d33-43e2-4c38-9495-d495eb1a2f30 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:03.040916 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f91d33-43e2-4c38-9495-d495eb1a2f30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:03.050500 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6265ea-3aeb-48d0-bd03-9c6ae3b09866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:03.051129 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6265ea-3aeb-48d0-bd03-9c6ae3b09866 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:03.051405 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6265ea-3aeb-48d0-bd03-9c6ae3b09866 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:03.051681 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6265ea-3aeb-48d0-bd03-9c6ae3b09866 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:03.053645 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:03.061622 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6265ea-3aeb-48d0-bd03-9c6ae3b09866 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:03.063554 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6265ea-3aeb-48d0-bd03-9c6ae3b09866 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:03.076757 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-9b6265ea-3aeb-48d0-bd03-9c6ae3b09866 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 18 10:50:03.076757 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:03.076757 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:03.076757 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:03.076757 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:03.076757 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:03.076757 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:03.076757 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:03.076757 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:03.076757 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:03.076757 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:03.076757 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:03.076757 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 10:50:03.076757 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 10:50:03.076757 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 10:50:03.076757 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 10:50:03.077853 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:03.077853 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:03.077853 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 10:50:03.077853 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 10:50:03.077853 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 10:50:03.077853 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 10:50:03.077853 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:03.077853 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:03.077853 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:03.077853 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:03.077853 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:03.077853 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:03.077853 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:03.077853 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:03.077853 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:03.077853 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:03.077853 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:03.077853 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:03.078947 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:03.078947 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:03.078947 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 10:50:03.078947 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 10:50:03.078947 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 10:50:03.078947 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 10:50:03.078947 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 10:50:03.078947 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 10:50:03.078947 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 18 10:50:03.078947 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:03.078947 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 252/523] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Aug 18 10:50:02 2022] GET /identity/v3/users/neutron => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:03.078947 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6265ea-3aeb-48d0-bd03-9c6ae3b09866 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:03.098008 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:03.127430 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f91d33-43e2-4c38-9495-d495eb1a2f30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:03.128924 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f91d33-43e2-4c38-9495-d495eb1a2f30 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:03.199408 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6265ea-3aeb-48d0-bd03-9c6ae3b09866 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:03.243709 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 272/524] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 18 10:50:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 10:50:03.244577 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f91d33-43e2-4c38-9495-d495eb1a2f30 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:03.248961 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58873923-5b22-4ffa-b7c8-ac2b21929ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:03.249613 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58873923-5b22-4ffa-b7c8-ac2b21929ed1 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:03.249896 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58873923-5b22-4ffa-b7c8-ac2b21929ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:03.250164 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58873923-5b22-4ffa-b7c8-ac2b21929ed1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:03.250902 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58873923-5b22-4ffa-b7c8-ac2b21929ed1 None admin] RBAC: Adding query filter params (role.id=13bffd536e214d0893b3007e267f3301, scope.project.id=1575e8ebaaab4650995841659b6e631b, user.id=a005d8f0c46d44c7b6f2201a54717b12) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:03.251210 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58873923-5b22-4ffa-b7c8-ac2b21929ed1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:03.252645 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58873923-5b22-4ffa-b7c8-ac2b21929ed1 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:03.259002 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 253/525] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Aug 18 10:50:03 2022] GET /identity/v3/role_assignments?user.id=a005d8f0c46d44c7b6f2201a54717b12&scope.project.id=1575e8ebaaab4650995841659b6e631b&role.id=13bffd536e214d0893b3007e267f3301 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:03.259734 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58873923-5b22-4ffa-b7c8-ac2b21929ed1 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:03.332318 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:03.360763 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:03.386238 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58873923-5b22-4ffa-b7c8-ac2b21929ed1 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:03.398235 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f91d33-43e2-4c38-9495-d495eb1a2f30 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:03.430512 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811c353e-8328-4fda-9c48-4da6986683a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:03.431139 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c353e-8328-4fda-9c48-4da6986683a2 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:03.431792 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c353e-8328-4fda-9c48-4da6986683a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:03.432271 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c353e-8328-4fda-9c48-4da6986683a2 None admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:03.432782 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811c353e-8328-4fda-9c48-4da6986683a2 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:03.433092 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811c353e-8328-4fda-9c48-4da6986683a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:03.434599 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811c353e-8328-4fda-9c48-4da6986683a2 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:03.456161 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929dfae9-8598-4849-b1c8-0fd0cfe68d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:03.457194 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929dfae9-8598-4849-b1c8-0fd0cfe68d74 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:03.457715 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929dfae9-8598-4849-b1c8-0fd0cfe68d74 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:03.458076 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929dfae9-8598-4849-b1c8-0fd0cfe68d74 None admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:03.459117 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929dfae9-8598-4849-b1c8-0fd0cfe68d74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:03.459578 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929dfae9-8598-4849-b1c8-0fd0cfe68d74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:03.460525 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 254/526] 10.222.0.15 () {56 vars in 1139 bytes} [Thu Aug 18 10:50:03 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:03.462288 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811c353e-8328-4fda-9c48-4da6986683a2 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:03.462860 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929dfae9-8598-4849-b1c8-0fd0cfe68d74 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:03.487824 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 273/527] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 18 10:50:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:03.488778 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929dfae9-8598-4849-b1c8-0fd0cfe68d74 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:03.576031 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811c353e-8328-4fda-9c48-4da6986683a2 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:03.595892 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:03.617732 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4420c19c-f8c0-4c06-a748-256332dda4fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:03.618738 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4420c19c-f8c0-4c06-a748-256332dda4fb None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:03.618928 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4420c19c-f8c0-4c06-a748-256332dda4fb None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:03.619302 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4420c19c-f8c0-4c06-a748-256332dda4fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:03.629617 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929dfae9-8598-4849-b1c8-0fd0cfe68d74 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:03.630925 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4420c19c-f8c0-4c06-a748-256332dda4fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:03.633241 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4420c19c-f8c0-4c06-a748-256332dda4fb None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:03.649239 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-4420c19c-f8c0-4c06-a748-256332dda4fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:03.649239 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:03.649239 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:03.649239 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:03.649239 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:03.649239 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:03.649239 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:03.649239 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:03.649239 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:03.649239 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:03.649239 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:03.649239 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:03.649239 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 10:50:03.649239 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 10:50:03.649239 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 10:50:03.649239 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 10:50:03.650400 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:03.650400 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:03.650400 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:03.650400 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:03.650400 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:03.650400 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:03.650400 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:03.650400 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:03.650400 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:03.650400 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:03.650400 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:03.650400 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:03.650400 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:03.650400 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:03.650400 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:03.650400 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:03.650400 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 10:50:03.651471 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 10:50:03.651471 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:03.651471 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:03.657401 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 255/528] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:50:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:03.658435 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4420c19c-f8c0-4c06-a748-256332dda4fb None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:03.675046 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de845f8b-a994-4db3-bb34-27ff64c5f2a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:03.675891 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de845f8b-a994-4db3-bb34-27ff64c5f2a0 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:03.676315 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de845f8b-a994-4db3-bb34-27ff64c5f2a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:03.676936 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de845f8b-a994-4db3-bb34-27ff64c5f2a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:03.701944 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:03.760622 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de845f8b-a994-4db3-bb34-27ff64c5f2a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:03.762432 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de845f8b-a994-4db3-bb34-27ff64c5f2a0 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:03.780710 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4420c19c-f8c0-4c06-a748-256332dda4fb None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:03.819347 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0e8fe9-2813-4292-ba96-30034bb22265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:03.820997 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e8fe9-2813-4292-ba96-30034bb22265 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:03.821507 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e8fe9-2813-4292-ba96-30034bb22265 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:03.822015 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e8fe9-2813-4292-ba96-30034bb22265 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:03.833180 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0e8fe9-2813-4292-ba96-30034bb22265 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:03.834939 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0e8fe9-2813-4292-ba96-30034bb22265 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:03.853750 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-7f0e8fe9-2813-4292-ba96-30034bb22265 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 10:50:03.853750 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:03.853750 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:03.853750 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:03.853750 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:03.853750 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:03.853750 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:03.853750 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:03.853750 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:03.853750 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:03.853750 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:03.853750 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:03.853750 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 10:50:03.853750 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 10:50:03.853750 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 10:50:03.854618 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 10:50:03.854618 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:03.854618 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:03.854618 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:03.854618 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:03.854618 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:03.854618 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:03.854618 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:03.854618 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:03.854618 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:03.854618 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:03.854618 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:03.854618 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:03.854618 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:03.854618 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:03.854618 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:03.854618 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:03.856097 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 10:50:03.856097 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 10:50:03.856097 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 10:50:03.856097 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 10:50:03.856097 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 10:50:03.856097 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 10:50:03.856097 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 10:50:03.856097 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:03.856097 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 256/529] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 18 10:50:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:03.856097 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0e8fe9-2813-4292-ba96-30034bb22265 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:03.890661 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 274/530] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 18 10:50:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 10:50:03.892081 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de845f8b-a994-4db3-bb34-27ff64c5f2a0 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:03.893735 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:03.944915 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:03.977550 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0e8fe9-2813-4292-ba96-30034bb22265 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:04.019558 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa3829-27b7-48be-97fb-31bb7e6abead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:04.020163 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa3829-27b7-48be-97fb-31bb7e6abead None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:04.020441 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa3829-27b7-48be-97fb-31bb7e6abead None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:04.020735 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa3829-27b7-48be-97fb-31bb7e6abead None admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:04.021789 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fa3829-27b7-48be-97fb-31bb7e6abead None admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:04.022093 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fa3829-27b7-48be-97fb-31bb7e6abead None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:04.024279 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fa3829-27b7-48be-97fb-31bb7e6abead None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:04.028000 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de845f8b-a994-4db3-bb34-27ff64c5f2a0 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:04.040053 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 257/531] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 18 10:50:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:04.040895 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa3829-27b7-48be-97fb-31bb7e6abead None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:04.067873 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afe6917-6b41-4f77-95f4-542be4015322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:04.068846 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe6917-6b41-4f77-95f4-542be4015322 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:04.069874 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe6917-6b41-4f77-95f4-542be4015322 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:04.070551 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe6917-6b41-4f77-95f4-542be4015322 None admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:04.071804 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afe6917-6b41-4f77-95f4-542be4015322 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:04.072550 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afe6917-6b41-4f77-95f4-542be4015322 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:04.074885 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afe6917-6b41-4f77-95f4-542be4015322 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:04.090844 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 275/532] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Aug 18 10:50:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:04.092495 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afe6917-6b41-4f77-95f4-542be4015322 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:04.148369 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:04.163304 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa3829-27b7-48be-97fb-31bb7e6abead None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:04.193224 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:04.199697 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afe6917-6b41-4f77-95f4-542be4015322 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:04.210827 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe1de7e-9afe-44fb-9e92-e876bdbb3d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:04.211968 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe1de7e-9afe-44fb-9e92-e876bdbb3d51 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:04.212433 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe1de7e-9afe-44fb-9e92-e876bdbb3d51 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:04.212943 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe1de7e-9afe-44fb-9e92-e876bdbb3d51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:04.225245 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe1de7e-9afe-44fb-9e92-e876bdbb3d51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:04.227709 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe1de7e-9afe-44fb-9e92-e876bdbb3d51 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:04.235861 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f4fcaf-3ed2-4d1c-8e3e-a2c3b06dc39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:04.236432 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f4fcaf-3ed2-4d1c-8e3e-a2c3b06dc39d None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:04.236714 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f4fcaf-3ed2-4d1c-8e3e-a2c3b06dc39d None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:04.236985 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f4fcaf-3ed2-4d1c-8e3e-a2c3b06dc39d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:04.244704 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f4fcaf-3ed2-4d1c-8e3e-a2c3b06dc39d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:04.245893 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-3fe1de7e-9afe-44fb-9e92-e876bdbb3d51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:04.245893 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:04.245893 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:04.245893 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:04.245893 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:04.245893 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:04.245893 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:04.245893 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:04.245893 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:04.245893 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:04.245893 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:04.245893 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:04.245893 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 10:50:04.245893 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 10:50:04.245893 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 10:50:04.245893 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 10:50:04.246740 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:04.246740 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:04.246740 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:04.246740 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:04.246740 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:04.246740 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:04.246740 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:04.246740 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:04.246740 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:04.246740 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:04.246740 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:04.246740 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:04.246740 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:04.246740 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:04.246740 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:04.246740 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:04.246740 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 10:50:04.247580 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 10:50:04.247580 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:04.247580 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:04.247738 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f4fcaf-3ed2-4d1c-8e3e-a2c3b06dc39d None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:04.250069 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 258/533] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:50:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:04.251169 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe1de7e-9afe-44fb-9e92-e876bdbb3d51 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:04.258855 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-65f4fcaf-3ed2-4d1c-8e3e-a2c3b06dc39d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 10:50:04.258855 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:04.258855 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:04.258855 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:04.258855 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:04.258855 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:04.258855 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:04.258855 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:04.258855 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:04.258855 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:04.258855 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:04.258855 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:04.258855 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 10:50:04.258855 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 10:50:04.258855 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 10:50:04.259714 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 10:50:04.259714 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:04.259714 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:04.259714 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:04.259714 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:04.259714 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:04.259714 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:04.259714 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:04.259714 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:04.259714 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:04.259714 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:04.259714 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:04.259714 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:04.259714 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:04.259714 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:04.259714 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:04.259714 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:04.261149 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 10:50:04.261149 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 10:50:04.261149 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 10:50:04.261149 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 10:50:04.261149 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 10:50:04.261149 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 10:50:04.261149 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 10:50:04.261149 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:04.261149 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 276/534] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 18 10:50:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:04.261149 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f4fcaf-3ed2-4d1c-8e3e-a2c3b06dc39d None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:04.365849 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f4fcaf-3ed2-4d1c-8e3e-a2c3b06dc39d None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:04.381646 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe1de7e-9afe-44fb-9e92-e876bdbb3d51 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:04.410812 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205ff3fa-87ff-4ecc-a87c-9a359a116db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:04.411911 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205ff3fa-87ff-4ecc-a87c-9a359a116db2 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:04.412354 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205ff3fa-87ff-4ecc-a87c-9a359a116db2 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:04.412929 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205ff3fa-87ff-4ecc-a87c-9a359a116db2 None admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:04.414593 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205ff3fa-87ff-4ecc-a87c-9a359a116db2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:04.415067 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205ff3fa-87ff-4ecc-a87c-9a359a116db2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:04.416979 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205ff3fa-87ff-4ecc-a87c-9a359a116db2 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:04.424891 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9995ae6-17c1-4c36-9711-98b19b70a1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:04.426273 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9995ae6-17c1-4c36-9711-98b19b70a1e2 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:04.426729 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9995ae6-17c1-4c36-9711-98b19b70a1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:04.427147 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9995ae6-17c1-4c36-9711-98b19b70a1e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:04.428575 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9995ae6-17c1-4c36-9711-98b19b70a1e2 None admin] RBAC: Adding query filter params (role.id=13bffd536e214d0893b3007e267f3301, scope.project.id=1575e8ebaaab4650995841659b6e631b, user.id=77211d2dcef242c4a7fe2198556d5efc) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:04.429319 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9995ae6-17c1-4c36-9711-98b19b70a1e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:04.430988 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9995ae6-17c1-4c36-9711-98b19b70a1e2 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:04.431491 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 277/535] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 18 10:50:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:04.432408 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205ff3fa-87ff-4ecc-a87c-9a359a116db2 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:04.439460 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 259/536] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Aug 18 10:50:04 2022] GET /identity/v3/role_assignments?user.id=77211d2dcef242c4a7fe2198556d5efc&scope.project.id=1575e8ebaaab4650995841659b6e631b&role.id=13bffd536e214d0893b3007e267f3301 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:04.440665 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9995ae6-17c1-4c36-9711-98b19b70a1e2 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:04.446533 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:04.471312 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:04.650015 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9995ae6-17c1-4c36-9711-98b19b70a1e2 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:04.662616 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205ff3fa-87ff-4ecc-a87c-9a359a116db2 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:04.728850 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9875252-ff55-4ab2-b36b-72440fb24511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:04.729866 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9875252-ff55-4ab2-b36b-72440fb24511 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:04.730431 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9875252-ff55-4ab2-b36b-72440fb24511 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:04.730930 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9875252-ff55-4ab2-b36b-72440fb24511 None admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:04.731840 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9875252-ff55-4ab2-b36b-72440fb24511 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:04.732351 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9875252-ff55-4ab2-b36b-72440fb24511 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:04.734020 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9875252-ff55-4ab2-b36b-72440fb24511 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:04.745246 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afcf41c-269e-4492-a994-4ab84e214a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:04.746093 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afcf41c-269e-4492-a994-4ab84e214a3b None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:04.746473 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afcf41c-269e-4492-a994-4ab84e214a3b None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:04.746833 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afcf41c-269e-4492-a994-4ab84e214a3b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:04.748302 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 278/537] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Aug 18 10:50:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:04.749837 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d470a-194e-46c7-91c5-503bc91ca270 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:04.750483 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d470a-194e-46c7-91c5-503bc91ca270 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:04.751030 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d470a-194e-46c7-91c5-503bc91ca270 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:04.752853 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 279/538] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:50:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:50:04.755562 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340d470a-194e-46c7-91c5-503bc91ca270 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:04.765363 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afcf41c-269e-4492-a994-4ab84e214a3b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:04.767236 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afcf41c-269e-4492-a994-4ab84e214a3b None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:04.783358 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-9afcf41c-269e-4492-a994-4ab84e214a3b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 10:50:04.783358 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:04.783358 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:04.783358 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:04.783358 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:04.783358 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:04.783358 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:04.783358 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:04.783358 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:04.783358 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:04.783358 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:04.783358 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:04.783358 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 10:50:04.783358 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 10:50:04.783358 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 10:50:04.784352 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 10:50:04.784352 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:04.784352 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:04.784352 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:04.784352 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:04.784352 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:04.784352 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:04.784352 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:04.784352 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:04.784352 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:04.784352 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:04.784352 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:04.784352 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:04.784352 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:04.784352 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:04.784352 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:04.784352 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:04.785179 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 10:50:04.785179 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 10:50:04.785179 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 10:50:04.785179 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 10:50:04.785179 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 10:50:04.785179 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 10:50:04.785179 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 10:50:04.785179 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:04.788209 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 260/539] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 18 10:50:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:04.790524 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60c2df-2e1c-443c-9b8b-1e1d29a0f2f8 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:04.791027 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60c2df-2e1c-443c-9b8b-1e1d29a0f2f8 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:04.791584 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60c2df-2e1c-443c-9b8b-1e1d29a0f2f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:04.820826 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-8a60c2df-2e1c-443c-9b8b-1e1d29a0f2f8 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:50:04.822528 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-8a60c2df-2e1c-443c-9b8b-1e1d29a0f2f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:50:04.879770 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:04.904343 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:04.911030 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340d470a-194e-46c7-91c5-503bc91ca270 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:04.925644 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 261/540] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:50:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 10:50:04.925644 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a60c2df-2e1c-443c-9b8b-1e1d29a0f2f8 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:04.998668 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f654ca1e-fed1-4913-99ff-edd895a065ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:05.000048 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f654ca1e-fed1-4913-99ff-edd895a065ad None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:05.000048 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f654ca1e-fed1-4913-99ff-edd895a065ad None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:05.000048 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f654ca1e-fed1-4913-99ff-edd895a065ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:05.001442 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f654ca1e-fed1-4913-99ff-edd895a065ad None admin] RBAC: Adding query filter params (role.id=13bffd536e214d0893b3007e267f3301, scope.project.id=1575e8ebaaab4650995841659b6e631b, user.id=5b8a09704b9b4ab2bffb813796ec6e77) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:05.001788 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f654ca1e-fed1-4913-99ff-edd895a065ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:05.003249 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f654ca1e-fed1-4913-99ff-edd895a065ad None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:05.024556 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 280/541] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Aug 18 10:50:04 2022] GET /identity/v3/role_assignments?user.id=5b8a09704b9b4ab2bffb813796ec6e77&scope.project.id=1575e8ebaaab4650995841659b6e631b&role.id=13bffd536e214d0893b3007e267f3301 => generated 259 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:05.092785 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a60c2df-2e1c-443c-9b8b-1e1d29a0f2f8 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:05.149896 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78803270-dec0-46b1-827e-9d6a4282e2fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:05.150610 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78803270-dec0-46b1-827e-9d6a4282e2fb None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:05.150902 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78803270-dec0-46b1-827e-9d6a4282e2fb None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:05.151178 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78803270-dec0-46b1-827e-9d6a4282e2fb None admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:05.152020 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78803270-dec0-46b1-827e-9d6a4282e2fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:05.152337 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78803270-dec0-46b1-827e-9d6a4282e2fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:05.153920 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78803270-dec0-46b1-827e-9d6a4282e2fb None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:05.184929 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 262/542] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Aug 18 10:50:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:05.186112 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f654ca1e-fed1-4913-99ff-edd895a065ad None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:05.292429 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78803270-dec0-46b1-827e-9d6a4282e2fb None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:05.348314 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f654ca1e-fed1-4913-99ff-edd895a065ad None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:05.396754 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422e3018-4085-4792-b624-6b61aa1c05ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:05.397377 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422e3018-4085-4792-b624-6b61aa1c05ec None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:05.397942 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422e3018-4085-4792-b624-6b61aa1c05ec None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:05.398891 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422e3018-4085-4792-b624-6b61aa1c05ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:05.399672 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422e3018-4085-4792-b624-6b61aa1c05ec None admin] RBAC: Adding query filter params (role.id=13bffd536e214d0893b3007e267f3301, scope.project.id=1575e8ebaaab4650995841659b6e631b, user.id=86c2cd74178f443d9c2398ff8e00cccc) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:05.405566 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422e3018-4085-4792-b624-6b61aa1c05ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:05.405566 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422e3018-4085-4792-b624-6b61aa1c05ec None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:05.415561 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 281/543] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Aug 18 10:50:05 2022] GET /identity/v3/role_assignments?user.id=86c2cd74178f443d9c2398ff8e00cccc&scope.project.id=1575e8ebaaab4650995841659b6e631b&role.id=13bffd536e214d0893b3007e267f3301 => generated 259 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:05.437990 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:05.492951 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dbe663-e30f-47ca-80b2-e6ece6879478 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:05.493554 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dbe663-e30f-47ca-80b2-e6ece6879478 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:05.493850 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dbe663-e30f-47ca-80b2-e6ece6879478 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:05.495393 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78803270-dec0-46b1-827e-9d6a4282e2fb None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:05.495797 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 282/544] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:50:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 10:50:05.503586 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3c377-679e-49e8-9096-24667c6d16b0 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:05.503894 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3c377-679e-49e8-9096-24667c6d16b0 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:05.504145 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3c377-679e-49e8-9096-24667c6d16b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:05.517123 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:05.543809 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-bba3c377-679e-49e8-9096-24667c6d16b0 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:50:05.546317 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-bba3c377-679e-49e8-9096-24667c6d16b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:50:05.575947 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaee5de-6524-4ab9-8963-a2853bc1857d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:05.576809 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaee5de-6524-4ab9-8963-a2853bc1857d None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:05.577086 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaee5de-6524-4ab9-8963-a2853bc1857d None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:05.577505 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaee5de-6524-4ab9-8963-a2853bc1857d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:05.603092 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaee5de-6524-4ab9-8963-a2853bc1857d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:50:05.608218 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-ecaee5de-6524-4ab9-8963-a2853bc1857d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 10:50:05.608218 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:05.608218 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:05.608218 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:05.608218 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:05.608218 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:05.608218 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:05.608218 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:05.608218 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:05.608218 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:05.608218 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:05.608218 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:05.608218 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:50:05.608218 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:50:05.608218 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:50:05.608218 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:50:05.609341 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:50:05.609341 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:50:05.609341 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:50:05.609341 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:50:05.609341 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:05.609341 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:05.609341 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:05.609341 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:05.609341 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:05.609341 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:05.609341 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:05.609341 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:05.609341 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:05.609341 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:05.609341 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:05.609341 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:05.610182 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:05.610182 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:05.610182 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:05.610182 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:05.610182 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:50:05.610182 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:50:05.610182 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:50:05.610182 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:50:05.610182 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:50:05.610182 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:50:05.610182 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 10:50:05.610182 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:05.610182 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 263/545] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Aug 18 10:50:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:05.622070 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaee5de-6524-4ab9-8963-a2853bc1857d None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:05.656005 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 283/546] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:50:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 10:50:05.779779 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaee5de-6524-4ab9-8963-a2853bc1857d None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:05.805700 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:05.830426 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0d8faa-ffa7-42c4-86c5-d6ccdca424ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:05.831091 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d8faa-ffa7-42c4-86c5-d6ccdca424ea None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:05.831369 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d8faa-ffa7-42c4-86c5-d6ccdca424ea None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:05.831693 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d8faa-ffa7-42c4-86c5-d6ccdca424ea None admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:05.832367 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0d8faa-ffa7-42c4-86c5-d6ccdca424ea None admin] RBAC: Adding query filter params (name=service) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:05.832673 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0d8faa-ffa7-42c4-86c5-d6ccdca424ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:05.834091 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0d8faa-ffa7-42c4-86c5-d6ccdca424ea None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:05.847442 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 264/547] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Aug 18 10:50:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:05.853260 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba3c377-679e-49e8-9096-24667c6d16b0 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:05.973995 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba3c377-679e-49e8-9096-24667c6d16b0 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:05.979456 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0d8faa-ffa7-42c4-86c5-d6ccdca424ea None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:06.013972 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617a5ec1-3621-49ad-a550-1b22dfd06095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:06.014617 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617a5ec1-3621-49ad-a550-1b22dfd06095 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:06.014894 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617a5ec1-3621-49ad-a550-1b22dfd06095 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:06.015173 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617a5ec1-3621-49ad-a550-1b22dfd06095 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:06.024771 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:06.034038 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617a5ec1-3621-49ad-a550-1b22dfd06095 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:06.035248 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617a5ec1-3621-49ad-a550-1b22dfd06095 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:06.065827 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-617a5ec1-3621-49ad-a550-1b22dfd06095 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:06.065827 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:06.065827 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:06.065827 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:06.065827 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:06.065827 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:06.065827 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:06.065827 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:06.065827 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:06.065827 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:06.065827 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:06.065827 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:06.065827 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 10:50:06.065827 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 10:50:06.065827 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 10:50:06.065827 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 10:50:06.066770 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:06.066770 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:06.066770 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:06.066770 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:06.066770 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:06.066770 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:06.066770 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:06.066770 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:06.066770 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:06.066770 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:06.066770 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:06.066770 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:06.066770 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:06.066770 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:06.066770 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:06.066770 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:06.066770 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 10:50:06.067590 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 10:50:06.067590 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:06.067590 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:06.067590 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 284/548] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:50:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:06.083828 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617a5ec1-3621-49ad-a550-1b22dfd06095 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:06.153831 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0d8faa-ffa7-42c4-86c5-d6ccdca424ea None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:06.192685 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b569f5f-ece8-42fd-aef4-778cfd3e5796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:06.193320 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b569f5f-ece8-42fd-aef4-778cfd3e5796 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:06.193627 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b569f5f-ece8-42fd-aef4-778cfd3e5796 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:06.194060 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b569f5f-ece8-42fd-aef4-778cfd3e5796 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:06.211590 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b569f5f-ece8-42fd-aef4-778cfd3e5796 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:50:06.215681 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617a5ec1-3621-49ad-a550-1b22dfd06095 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:06.217469 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-0b569f5f-ece8-42fd-aef4-778cfd3e5796 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 10:50:06.217469 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:06.217469 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:06.217469 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:06.217469 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:06.217469 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:06.217469 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:06.217469 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:06.217469 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:06.217469 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:06.217469 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:06.217469 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:06.217469 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:50:06.217469 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:50:06.217469 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:50:06.217469 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:50:06.218427 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:50:06.218427 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:50:06.218427 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:50:06.218427 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:50:06.218427 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:06.218427 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:06.218427 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:06.218427 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:06.218427 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:06.218427 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:06.218427 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:06.218427 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:06.218427 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:06.218427 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:06.218427 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:06.218427 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:06.219685 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:06.219685 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:06.219685 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:06.219685 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:06.219685 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:50:06.219685 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:50:06.219685 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:50:06.219685 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:50:06.219685 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:50:06.219685 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:50:06.219685 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 10:50:06.219685 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:06.219685 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 265/549] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Aug 18 10:50:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 10:50:06.226688 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b569f5f-ece8-42fd-aef4-778cfd3e5796 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:06.302211 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e114e56-5c33-4d5d-a913-4ddb0c684e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:06.302816 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e114e56-5c33-4d5d-a913-4ddb0c684e80 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:06.303096 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e114e56-5c33-4d5d-a913-4ddb0c684e80 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:06.303372 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e114e56-5c33-4d5d-a913-4ddb0c684e80 None admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:06.304030 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e114e56-5c33-4d5d-a913-4ddb0c684e80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:06.304333 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e114e56-5c33-4d5d-a913-4ddb0c684e80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:06.308215 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e114e56-5c33-4d5d-a913-4ddb0c684e80 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:06.308596 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:06.331649 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 285/550] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 18 10:50:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 10:50:06.337997 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e114e56-5c33-4d5d-a913-4ddb0c684e80 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:06.381940 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b569f5f-ece8-42fd-aef4-778cfd3e5796 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:06.428054 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f943e26-22c8-4a60-88ae-eb0fc409c857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:06.430663 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f943e26-22c8-4a60-88ae-eb0fc409c857 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:06.430948 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f943e26-22c8-4a60-88ae-eb0fc409c857 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:06.434091 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f943e26-22c8-4a60-88ae-eb0fc409c857 None admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:06.434808 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f943e26-22c8-4a60-88ae-eb0fc409c857 None admin] RBAC: Adding query filter params (name=service) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:06.435121 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f943e26-22c8-4a60-88ae-eb0fc409c857 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:06.436536 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f943e26-22c8-4a60-88ae-eb0fc409c857 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:06.437663 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:06.456149 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 266/551] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Aug 18 10:50:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 10:50:06.462227 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f943e26-22c8-4a60-88ae-eb0fc409c857 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:06.545124 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e114e56-5c33-4d5d-a913-4ddb0c684e80 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:06.590305 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de262f7b-6482-4153-a728-b48780d7d416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:06.590866 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de262f7b-6482-4153-a728-b48780d7d416 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:06.591207 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de262f7b-6482-4153-a728-b48780d7d416 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:06.591484 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de262f7b-6482-4153-a728-b48780d7d416 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:06.604595 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de262f7b-6482-4153-a728-b48780d7d416 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:06.606288 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de262f7b-6482-4153-a728-b48780d7d416 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:06.626547 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-de262f7b-6482-4153-a728-b48780d7d416 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 18 10:50:06.626547 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:06.626547 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:06.626547 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:06.626547 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:06.626547 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:06.626547 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:06.626547 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:06.626547 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:06.626547 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:06.626547 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:06.626547 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:06.626547 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 10:50:06.626547 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 10:50:06.626547 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 10:50:06.626547 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 10:50:06.627588 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:06.627588 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:06.627588 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 10:50:06.627588 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 10:50:06.627588 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 10:50:06.627588 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 10:50:06.627588 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:06.627588 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:06.627588 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:06.627588 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:06.627588 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:06.627588 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:06.627588 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:06.627588 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:06.627588 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:06.627588 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:06.627588 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:06.627588 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:06.628790 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:06.628790 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:06.628790 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 10:50:06.628790 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 10:50:06.628790 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 10:50:06.628790 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 10:50:06.628790 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 10:50:06.628790 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 10:50:06.628790 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 18 10:50:06.628790 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:06.628790 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 286/552] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Aug 18 10:50:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 10:50:06.629353 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be7e40-2082-4cd5-a30e-d25ebdd000b2 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:06.630018 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be7e40-2082-4cd5-a30e-d25ebdd000b2 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:06.630018 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be7e40-2082-4cd5-a30e-d25ebdd000b2 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:06.636094 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 287/553] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:50:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:50:06.637711 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca086aa-406f-4b22-b3f1-f1025f674a39 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:06.638250 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca086aa-406f-4b22-b3f1-f1025f674a39 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:06.638707 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca086aa-406f-4b22-b3f1-f1025f674a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:06.642875 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:06.647327 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f943e26-22c8-4a60-88ae-eb0fc409c857 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:06.660240 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-fca086aa-406f-4b22-b3f1-f1025f674a39 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:50:06.661820 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-fca086aa-406f-4b22-b3f1-f1025f674a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:50:06.692402 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beae6bd-8b0c-4ba2-abb1-3e04c3a31f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:06.693047 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beae6bd-8b0c-4ba2-abb1-3e04c3a31f3d None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:06.693330 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beae6bd-8b0c-4ba2-abb1-3e04c3a31f3d None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:06.693649 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beae6bd-8b0c-4ba2-abb1-3e04c3a31f3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:06.708728 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beae6bd-8b0c-4ba2-abb1-3e04c3a31f3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:06.710887 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beae6bd-8b0c-4ba2-abb1-3e04c3a31f3d None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:06.730509 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-5beae6bd-8b0c-4ba2-abb1-3e04c3a31f3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:06.730509 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:06.730509 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:06.730509 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:06.730509 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:06.730509 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:06.730509 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:06.730509 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:06.730509 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:06.730509 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:06.730509 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:06.730509 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:06.730509 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 10:50:06.730509 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 10:50:06.730509 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 10:50:06.730509 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 10:50:06.731573 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:06.731573 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:06.731573 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:06.731573 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:06.731573 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:06.731573 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:06.731573 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:06.731573 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:06.731573 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:06.731573 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:06.731573 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:06.731573 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:06.731573 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:06.731573 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:06.731573 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:06.731573 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:06.731573 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 10:50:06.732441 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 10:50:06.732441 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:06.732441 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:06.732441 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 267/554] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:50:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:06.733114 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beae6bd-8b0c-4ba2-abb1-3e04c3a31f3d None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:06.753273 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 288/555] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:50:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 10:50:06.754699 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca086aa-406f-4b22-b3f1-f1025f674a39 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:06.814731 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:06.881042 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beae6bd-8b0c-4ba2-abb1-3e04c3a31f3d None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:06.925377 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9928859-8982-4de5-b4af-163156288049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:06.926013 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9928859-8982-4de5-b4af-163156288049 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:06.926287 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9928859-8982-4de5-b4af-163156288049 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:06.926563 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9928859-8982-4de5-b4af-163156288049 None admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:06.927290 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9928859-8982-4de5-b4af-163156288049 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:06.927591 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9928859-8982-4de5-b4af-163156288049 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:06.929032 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9928859-8982-4de5-b4af-163156288049 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:06.969116 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 268/556] 10.222.0.15 () {56 vars in 1135 bytes} [Thu Aug 18 10:50:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:06.975332 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9928859-8982-4de5-b4af-163156288049 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:06.991784 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca086aa-406f-4b22-b3f1-f1025f674a39 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:06.995549 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:07.039974 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70434cbe-a966-40e2-b646-823ef415a78f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:07.040592 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70434cbe-a966-40e2-b646-823ef415a78f None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:07.040874 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70434cbe-a966-40e2-b646-823ef415a78f None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:07.041147 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70434cbe-a966-40e2-b646-823ef415a78f None admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:07.041826 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70434cbe-a966-40e2-b646-823ef415a78f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:07.042130 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70434cbe-a966-40e2-b646-823ef415a78f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:07.044243 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70434cbe-a966-40e2-b646-823ef415a78f None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:07.068171 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 289/557] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 18 10:50:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:07.072905 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70434cbe-a966-40e2-b646-823ef415a78f None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:07.155633 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9928859-8982-4de5-b4af-163156288049 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:07.199288 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:07.204361 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa49ef8-a958-4006-8cd3-a8ff8f202ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:07.206370 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa49ef8-a958-4006-8cd3-a8ff8f202ffb None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:07.206644 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa49ef8-a958-4006-8cd3-a8ff8f202ffb None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:07.206902 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa49ef8-a958-4006-8cd3-a8ff8f202ffb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:07.213670 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70434cbe-a966-40e2-b646-823ef415a78f None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:07.258353 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b427da6-3ec7-4922-a2ce-d8f696b5c114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:07.258984 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b427da6-3ec7-4922-a2ce-d8f696b5c114 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:07.259283 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b427da6-3ec7-4922-a2ce-d8f696b5c114 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:07.259560 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b427da6-3ec7-4922-a2ce-d8f696b5c114 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:07.269826 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b427da6-3ec7-4922-a2ce-d8f696b5c114 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:07.272114 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b427da6-3ec7-4922-a2ce-d8f696b5c114 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:07.289833 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-3b427da6-3ec7-4922-a2ce-d8f696b5c114 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 10:50:07.289833 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:07.289833 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:07.289833 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:07.289833 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:07.289833 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:07.289833 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:07.289833 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:07.289833 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:07.289833 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:07.289833 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:07.289833 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:07.289833 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 10:50:07.289833 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 10:50:07.289833 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 10:50:07.289833 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 10:50:07.291298 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:07.291298 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:07.291298 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 10:50:07.291298 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 10:50:07.291298 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 10:50:07.291298 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 10:50:07.291298 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:07.291298 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:07.291298 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:07.291298 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:07.291298 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:07.291298 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:07.291298 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:07.291298 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:07.291298 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:07.291298 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:07.291298 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:07.291298 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:07.292232 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:07.292232 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:07.292232 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 10:50:07.292232 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 10:50:07.292232 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 10:50:07.292232 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 10:50:07.292232 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 10:50:07.292232 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 10:50:07.292232 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 10:50:07.292232 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:07.296409 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 290/558] 10.222.0.15 () {56 vars in 1093 bytes} [Thu Aug 18 10:50:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:07.297720 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b427da6-3ec7-4922-a2ce-d8f696b5c114 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:07.308194 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa49ef8-a958-4006-8cd3-a8ff8f202ffb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:07.310509 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa49ef8-a958-4006-8cd3-a8ff8f202ffb None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:07.324921 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:07.423602 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b427da6-3ec7-4922-a2ce-d8f696b5c114 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:07.434268 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 269/559] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 18 10:50:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 10:50:07.435324 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa49ef8-a958-4006-8cd3-a8ff8f202ffb None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:07.460486 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84cc4aa-f887-4349-ab1f-04ccfd495964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:07.462224 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84cc4aa-f887-4349-ab1f-04ccfd495964 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:07.462712 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84cc4aa-f887-4349-ab1f-04ccfd495964 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:07.463214 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84cc4aa-f887-4349-ab1f-04ccfd495964 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:07.474245 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84cc4aa-f887-4349-ab1f-04ccfd495964 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:50:07.481459 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-d84cc4aa-f887-4349-ab1f-04ccfd495964 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 10:50:07.481459 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:07.481459 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:07.481459 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:07.481459 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:07.481459 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:07.481459 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:07.481459 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:07.481459 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:07.481459 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:07.481459 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:07.481459 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:07.481459 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:50:07.481459 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:50:07.481459 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:50:07.481459 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:50:07.482505 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:50:07.482505 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:50:07.482505 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:50:07.482505 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:50:07.482505 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:07.482505 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:07.482505 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:07.482505 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:07.482505 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:07.482505 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:07.482505 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:07.482505 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:07.482505 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:07.482505 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:07.482505 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:07.482505 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:07.483364 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:07.483364 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:07.483364 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:07.483364 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:07.483364 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:50:07.483364 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:50:07.483364 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:50:07.483364 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:50:07.483364 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:50:07.483364 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:50:07.483364 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 10:50:07.483364 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:07.483364 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 291/560] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Aug 18 10:50:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:07.484115 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84cc4aa-f887-4349-ab1f-04ccfd495964 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:07.503351 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:07.554916 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa49ef8-a958-4006-8cd3-a8ff8f202ffb None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:07.565946 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:07.594615 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80159e9-c656-4002-a1d7-ac4602483b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:07.595330 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80159e9-c656-4002-a1d7-ac4602483b89 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:07.595615 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80159e9-c656-4002-a1d7-ac4602483b89 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:07.595887 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80159e9-c656-4002-a1d7-ac4602483b89 None admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:07.596360 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84cc4aa-f887-4349-ab1f-04ccfd495964 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:07.596614 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80159e9-c656-4002-a1d7-ac4602483b89 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:07.596917 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80159e9-c656-4002-a1d7-ac4602483b89 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:07.598429 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80159e9-c656-4002-a1d7-ac4602483b89 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:07.621688 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 270/561] 10.222.0.15 () {56 vars in 1133 bytes} [Thu Aug 18 10:50:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:07.623405 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b9449-8475-4caf-86cb-3b998ff39fc1 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:07.623692 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b9449-8475-4caf-86cb-3b998ff39fc1 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:07.624049 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b9449-8475-4caf-86cb-3b998ff39fc1 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:07.625370 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 271/562] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:50:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:50:07.625984 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b9449-8475-4caf-86cb-3b998ff39fc1 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:07.641418 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df52cb55-59ff-4282-8ecb-0e30d77bd835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:07.642074 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52cb55-59ff-4282-8ecb-0e30d77bd835 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:07.642356 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52cb55-59ff-4282-8ecb-0e30d77bd835 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:07.642625 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52cb55-59ff-4282-8ecb-0e30d77bd835 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:07.656588 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df52cb55-59ff-4282-8ecb-0e30d77bd835 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:07.658061 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df52cb55-59ff-4282-8ecb-0e30d77bd835 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:07.674348 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-df52cb55-59ff-4282-8ecb-0e30d77bd835 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:07.674348 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:07.674348 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:07.674348 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:07.674348 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:07.674348 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:07.674348 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:07.674348 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:07.674348 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:07.674348 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:07.674348 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:07.674348 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:07.674348 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 10:50:07.674348 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 10:50:07.674348 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 10:50:07.674348 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 10:50:07.675296 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:07.675296 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:07.675296 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:07.675296 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:07.675296 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:07.675296 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:07.675296 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:07.675296 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:07.675296 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:07.675296 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:07.675296 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:07.675296 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:07.675296 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:07.675296 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:07.675296 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:07.675296 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:07.675296 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 10:50:07.676184 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 10:50:07.676184 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:07.676184 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:07.676184 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 292/563] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:50:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:07.677238 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df52cb55-59ff-4282-8ecb-0e30d77bd835 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:07.744278 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b9449-8475-4caf-86cb-3b998ff39fc1 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:07.748608 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:07.783412 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498684dd-7ee2-483c-93d7-86ca7cd3f29f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:07.783621 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df52cb55-59ff-4282-8ecb-0e30d77bd835 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:07.784013 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498684dd-7ee2-483c-93d7-86ca7cd3f29f None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:07.784294 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498684dd-7ee2-483c-93d7-86ca7cd3f29f None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:07.784562 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498684dd-7ee2-483c-93d7-86ca7cd3f29f None admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:07.785353 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498684dd-7ee2-483c-93d7-86ca7cd3f29f None admin] RBAC: Adding query filter params (name=service) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:07.785634 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498684dd-7ee2-483c-93d7-86ca7cd3f29f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:07.787007 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498684dd-7ee2-483c-93d7-86ca7cd3f29f None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:07.795233 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 272/564] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Aug 18 10:50:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:07.796466 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18122a8-b256-4221-83ff-e1614e43dcb3 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:07.796734 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18122a8-b256-4221-83ff-e1614e43dcb3 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:07.797009 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18122a8-b256-4221-83ff-e1614e43dcb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:07.815214 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-f18122a8-b256-4221-83ff-e1614e43dcb3 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:50:07.816465 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-f18122a8-b256-4221-83ff-e1614e43dcb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:50:07.821923 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b226a6-6f79-426c-9671-79a50181a411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:07.822552 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b226a6-6f79-426c-9671-79a50181a411 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:07.822829 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b226a6-6f79-426c-9671-79a50181a411 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:07.823098 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b226a6-6f79-426c-9671-79a50181a411 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:07.833602 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b226a6-6f79-426c-9671-79a50181a411 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:07.835033 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b226a6-6f79-426c-9671-79a50181a411 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:07.840934 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:07.849393 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-b3b226a6-6f79-426c-9671-79a50181a411 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:07.849393 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:07.849393 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:07.849393 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:07.849393 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:07.849393 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:07.849393 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:07.849393 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:07.849393 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:07.849393 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:07.849393 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:07.849393 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:07.849393 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 10:50:07.849393 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 10:50:07.849393 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 10:50:07.849393 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 10:50:07.850363 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:07.850363 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:07.850363 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:07.850363 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:07.850363 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:07.850363 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:07.850363 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:07.850363 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:07.850363 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:07.850363 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:07.850363 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:07.850363 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:07.850363 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:07.850363 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:07.850363 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:07.850363 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:07.850363 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 10:50:07.851226 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 10:50:07.851226 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:07.851226 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:07.851226 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 293/565] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:50:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:07.851456 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b226a6-6f79-426c-9671-79a50181a411 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:07.891176 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 273/566] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:50:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 10:50:07.892534 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d401163-6862-498e-8d4c-ffb0cec7de16 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:07.892824 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d401163-6862-498e-8d4c-ffb0cec7de16 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:07.893208 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d401163-6862-498e-8d4c-ffb0cec7de16 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:07.894433 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 274/567] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:50:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:50:07.895144 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d401163-6862-498e-8d4c-ffb0cec7de16 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:07.971827 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b226a6-6f79-426c-9671-79a50181a411 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:07.992452 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:08.009223 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d401163-6862-498e-8d4c-ffb0cec7de16 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:08.013561 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd674f6-a1c4-4c83-9e68-c91ab6cd23ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:08.014537 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd674f6-a1c4-4c83-9e68-c91ab6cd23ba None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:08.015008 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd674f6-a1c4-4c83-9e68-c91ab6cd23ba None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:08.015454 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd674f6-a1c4-4c83-9e68-c91ab6cd23ba None admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:08.016349 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd674f6-a1c4-4c83-9e68-c91ab6cd23ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:08.016549 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd674f6-a1c4-4c83-9e68-c91ab6cd23ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:08.017962 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd674f6-a1c4-4c83-9e68-c91ab6cd23ba None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:08.032677 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 294/568] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 18 10:50:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:08.033511 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd674f6-a1c4-4c83-9e68-c91ab6cd23ba None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:08.058869 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36cab42-83a7-45f0-b2de-aa547e2ea1fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:08.059509 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36cab42-83a7-45f0-b2de-aa547e2ea1fb None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:08.059784 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36cab42-83a7-45f0-b2de-aa547e2ea1fb None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:08.060052 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36cab42-83a7-45f0-b2de-aa547e2ea1fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:08.074470 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36cab42-83a7-45f0-b2de-aa547e2ea1fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:08.075944 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36cab42-83a7-45f0-b2de-aa547e2ea1fb None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:08.091961 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-d36cab42-83a7-45f0-b2de-aa547e2ea1fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:08.091961 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:08.091961 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:08.091961 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:08.091961 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:08.091961 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:08.091961 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:08.091961 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:08.091961 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:08.091961 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:08.091961 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:08.091961 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:08.091961 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 10:50:08.091961 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 10:50:08.091961 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 10:50:08.091961 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 10:50:08.092912 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:08.092912 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:08.092912 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:08.092912 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:08.092912 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:08.092912 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:08.092912 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:08.092912 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:08.092912 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:08.092912 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:08.092912 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:08.092912 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:08.092912 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:08.092912 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:08.092912 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:08.092912 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:08.092912 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 10:50:08.093850 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 10:50:08.093850 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:08.093850 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:08.093850 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 275/569] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:50:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:08.094355 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f64631-4acc-4ad7-9184-54598bb4e766 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:08.094480 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f64631-4acc-4ad7-9184-54598bb4e766 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:08.094750 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f64631-4acc-4ad7-9184-54598bb4e766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:08.112836 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-58f64631-4acc-4ad7-9184-54598bb4e766 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:50:08.114054 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-58f64631-4acc-4ad7-9184-54598bb4e766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:50:08.117555 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:08.155160 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd674f6-a1c4-4c83-9e68-c91ab6cd23ba None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:08.184805 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 276/570] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:50:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 10:50:08.185688 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f64631-4acc-4ad7-9184-54598bb4e766 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:08.192445 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c634c368-4e1e-4aec-979d-7271b2025aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:08.193059 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c634c368-4e1e-4aec-979d-7271b2025aa6 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:08.193337 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c634c368-4e1e-4aec-979d-7271b2025aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:08.193681 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c634c368-4e1e-4aec-979d-7271b2025aa6 None admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:08.194332 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c634c368-4e1e-4aec-979d-7271b2025aa6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:08.194640 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c634c368-4e1e-4aec-979d-7271b2025aa6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:08.196711 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c634c368-4e1e-4aec-979d-7271b2025aa6 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:08.210742 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 295/571] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 18 10:50:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:08.211753 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c634c368-4e1e-4aec-979d-7271b2025aa6 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:08.259552 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:08.311904 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f64631-4acc-4ad7-9184-54598bb4e766 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:08.329166 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c634c368-4e1e-4aec-979d-7271b2025aa6 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:08.359235 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29ef48e-8a69-4dd3-a8c8-0b01cab50738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:08.360337 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29ef48e-8a69-4dd3-a8c8-0b01cab50738 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:08.360623 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29ef48e-8a69-4dd3-a8c8-0b01cab50738 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:08.360895 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29ef48e-8a69-4dd3-a8c8-0b01cab50738 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:08.373277 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29ef48e-8a69-4dd3-a8c8-0b01cab50738 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:08.374764 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29ef48e-8a69-4dd3-a8c8-0b01cab50738 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:08.379422 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:08.380357 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e384ff25-3ddf-4f8e-aac5-03a263b1494f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:08.381065 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e384ff25-3ddf-4f8e-aac5-03a263b1494f None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:08.381339 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e384ff25-3ddf-4f8e-aac5-03a263b1494f None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:08.381663 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e384ff25-3ddf-4f8e-aac5-03a263b1494f None admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:08.383157 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e384ff25-3ddf-4f8e-aac5-03a263b1494f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:08.384128 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e384ff25-3ddf-4f8e-aac5-03a263b1494f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:08.385585 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e384ff25-3ddf-4f8e-aac5-03a263b1494f None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:08.396105 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-c29ef48e-8a69-4dd3-a8c8-0b01cab50738 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 10:50:08.396105 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:08.396105 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:08.396105 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:08.396105 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:08.396105 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:08.396105 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:08.396105 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:08.396105 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:08.396105 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:08.396105 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:08.396105 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:08.396105 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 10:50:08.396105 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 10:50:08.396105 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 10:50:08.397098 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 10:50:08.397098 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:08.397098 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:08.397098 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:08.397098 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:08.397098 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:08.397098 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:08.397098 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:08.397098 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:08.397098 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:08.397098 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:08.397098 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:08.397098 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:08.397098 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:08.397098 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:08.397098 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:08.397098 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:08.399373 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 10:50:08.399373 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 10:50:08.399373 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 10:50:08.399373 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 10:50:08.399373 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 10:50:08.399373 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 10:50:08.399373 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 10:50:08.399373 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:08.405456 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 296/572] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 18 10:50:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:08.405456 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e384ff25-3ddf-4f8e-aac5-03a263b1494f None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:08.405948 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 277/573] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 18 10:50:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:08.405948 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29ef48e-8a69-4dd3-a8c8-0b01cab50738 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:08.511748 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:08.514592 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e384ff25-3ddf-4f8e-aac5-03a263b1494f None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:08.520070 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29ef48e-8a69-4dd3-a8c8-0b01cab50738 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:08.550365 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8323ed22-44d9-4fa3-871f-81d5d6a7d272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:08.550994 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8323ed22-44d9-4fa3-871f-81d5d6a7d272 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:08.551273 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8323ed22-44d9-4fa3-871f-81d5d6a7d272 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:08.551545 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8323ed22-44d9-4fa3-871f-81d5d6a7d272 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:08.554333 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca5cc2-6eed-4dbc-906e-561f827277c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:08.555767 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca5cc2-6eed-4dbc-906e-561f827277c2 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:08.556052 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca5cc2-6eed-4dbc-906e-561f827277c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:08.556330 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca5cc2-6eed-4dbc-906e-561f827277c2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:08.562325 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8323ed22-44d9-4fa3-871f-81d5d6a7d272 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:50:08.563198 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ca5cc2-6eed-4dbc-906e-561f827277c2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:08.564635 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ca5cc2-6eed-4dbc-906e-561f827277c2 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:08.567010 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-8323ed22-44d9-4fa3-871f-81d5d6a7d272 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 10:50:08.567010 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:08.567010 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:08.567010 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:08.567010 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:08.567010 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:08.567010 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:08.567010 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:08.567010 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:08.567010 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:08.567010 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:08.567010 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:08.567010 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:50:08.567010 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:50:08.567010 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:50:08.567010 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:50:08.567982 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:50:08.567982 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:50:08.567982 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:50:08.567982 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:50:08.567982 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:08.567982 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:08.567982 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:08.567982 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:08.567982 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:08.567982 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:08.567982 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:08.567982 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:08.567982 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:08.567982 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:08.567982 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:08.567982 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:08.568811 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:08.568811 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:08.568811 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:08.568811 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:08.568811 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:50:08.568811 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:50:08.568811 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:50:08.568811 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:50:08.568811 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:50:08.568811 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:50:08.568811 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 10:50:08.568811 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:08.568811 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 297/574] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Aug 18 10:50:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:08.569550 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8323ed22-44d9-4fa3-871f-81d5d6a7d272 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:08.578063 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-d5ca5cc2-6eed-4dbc-906e-561f827277c2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 10:50:08.578063 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:08.578063 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:08.578063 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:08.578063 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:08.578063 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:08.578063 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:08.578063 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:08.578063 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:08.578063 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:08.578063 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:08.578063 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:08.578063 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 10:50:08.578063 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 10:50:08.578063 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 10:50:08.579241 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 10:50:08.579241 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:08.579241 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:08.579241 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:08.579241 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:08.579241 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:08.579241 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:08.579241 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:08.579241 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:08.579241 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:08.579241 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:08.579241 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:08.579241 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:08.579241 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:08.579241 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:08.579241 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:08.579241 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:08.580124 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 10:50:08.580124 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 10:50:08.580124 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 10:50:08.580124 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 10:50:08.580124 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 10:50:08.580124 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 10:50:08.580124 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 10:50:08.580124 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:08.580124 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 278/575] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 18 10:50:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:08.580124 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca5cc2-6eed-4dbc-906e-561f827277c2 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:08.641646 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:08.674457 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8323ed22-44d9-4fa3-871f-81d5d6a7d272 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:08.683028 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca5cc2-6eed-4dbc-906e-561f827277c2 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:08.710168 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760a49d-81a3-44b7-bd60-632690db9c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:08.711116 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760a49d-81a3-44b7-bd60-632690db9c4e None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:08.711686 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760a49d-81a3-44b7-bd60-632690db9c4e None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:08.717894 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b4c58c-b545-483c-bc13-a0cad24317dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:08.718498 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b4c58c-b545-483c-bc13-a0cad24317dd None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:08.718780 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b4c58c-b545-483c-bc13-a0cad24317dd None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:08.719050 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b4c58c-b545-483c-bc13-a0cad24317dd None admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:08.719736 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b4c58c-b545-483c-bc13-a0cad24317dd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:08.720039 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b4c58c-b545-483c-bc13-a0cad24317dd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:08.721473 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b4c58c-b545-483c-bc13-a0cad24317dd None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:08.727006 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760a49d-81a3-44b7-bd60-632690db9c4e None admin] PATH_INFO: `/v3/users/glance` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:08.737144 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5760a49d-81a3-44b7-bd60-632690db9c4e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:08.743424 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 279/576] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Aug 18 10:50:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:08.743424 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b4c58c-b545-483c-bc13-a0cad24317dd None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:08.743704 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5760a49d-81a3-44b7-bd60-632690db9c4e None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:08.755121 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-5760a49d-81a3-44b7-bd60-632690db9c4e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 18 10:50:08.755121 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:08.755121 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:08.755121 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:08.755121 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:08.755121 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:08.755121 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:08.755121 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:08.755121 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:08.755121 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:08.755121 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:08.755121 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:08.755121 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 10:50:08.755121 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 10:50:08.755121 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 10:50:08.755121 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 10:50:08.756082 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:08.756082 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:08.756082 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 10:50:08.756082 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 10:50:08.756082 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 10:50:08.756082 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 10:50:08.756082 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:08.756082 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:08.756082 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:08.756082 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:08.756082 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:08.756082 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:08.756082 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:08.756082 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:08.756082 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:08.756082 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:08.756082 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:08.756082 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:08.757225 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:08.757225 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:08.757225 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 10:50:08.757225 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 10:50:08.757225 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 10:50:08.757225 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 10:50:08.757225 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 10:50:08.757225 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 10:50:08.757225 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 18 10:50:08.757225 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:08.757225 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 298/577] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 18 10:50:08 2022] GET /identity/v3/users/glance => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:08.757225 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760a49d-81a3-44b7-bd60-632690db9c4e None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:08.781402 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:08.847292 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b4c58c-b545-483c-bc13-a0cad24317dd None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:08.859523 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760a49d-81a3-44b7-bd60-632690db9c4e None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:08.868547 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:08.884780 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cd8474-aac6-4c2b-b3f0-08caf2be1a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:08.885409 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd8474-aac6-4c2b-b3f0-08caf2be1a0c None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:08.885716 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd8474-aac6-4c2b-b3f0-08caf2be1a0c None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:08.885988 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd8474-aac6-4c2b-b3f0-08caf2be1a0c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:08.894451 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3366c8b-d27c-4e48-a8bc-522468048df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:08.895056 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3366c8b-d27c-4e48-a8bc-522468048df5 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:08.895330 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3366c8b-d27c-4e48-a8bc-522468048df5 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:08.895598 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3366c8b-d27c-4e48-a8bc-522468048df5 None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:08.896259 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3366c8b-d27c-4e48-a8bc-522468048df5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:08.896556 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3366c8b-d27c-4e48-a8bc-522468048df5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:08.898298 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3366c8b-d27c-4e48-a8bc-522468048df5 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:08.899079 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cd8474-aac6-4c2b-b3f0-08caf2be1a0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:50:08.904366 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-f4cd8474-aac6-4c2b-b3f0-08caf2be1a0c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 10:50:08.904366 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:08.904366 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:08.904366 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:08.904366 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:08.904366 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:08.904366 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:08.904366 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:08.904366 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:08.904366 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:08.904366 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:08.904366 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:08.904366 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:50:08.904366 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:50:08.904366 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:50:08.904366 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:50:08.905271 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:50:08.905271 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:50:08.905271 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:50:08.905271 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:50:08.905271 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:08.905271 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:08.905271 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:08.905271 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:08.905271 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:08.905271 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:08.905271 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:08.905271 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:08.905271 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:08.905271 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:08.905271 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:08.905271 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:08.906136 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:08.906136 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:08.906136 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:08.906136 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:08.906136 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:50:08.906136 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:50:08.906136 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:50:08.906136 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:50:08.906136 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:50:08.906136 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:50:08.906136 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 10:50:08.906136 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:08.906136 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 280/578] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Aug 18 10:50:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:08.906816 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cd8474-aac6-4c2b-b3f0-08caf2be1a0c None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:08.907497 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 299/579] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Aug 18 10:50:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:08.908314 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3366c8b-d27c-4e48-a8bc-522468048df5 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:08.989283 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:09.008884 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3366c8b-d27c-4e48-a8bc-522468048df5 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:09.014516 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cd8474-aac6-4c2b-b3f0-08caf2be1a0c None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:09.043391 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b382fdd1-9cf8-4286-97b2-a023113cd08f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:09.044202 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382fdd1-9cf8-4286-97b2-a023113cd08f None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:09.044685 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382fdd1-9cf8-4286-97b2-a023113cd08f None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:09.045113 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382fdd1-9cf8-4286-97b2-a023113cd08f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:09.046259 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b382fdd1-9cf8-4286-97b2-a023113cd08f None admin] RBAC: Adding query filter params (role.id=13bffd536e214d0893b3007e267f3301, scope.project.id=1575e8ebaaab4650995841659b6e631b, user.id=f97e906b1922419d8511ab1c8b9c86e4) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:09.046672 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b382fdd1-9cf8-4286-97b2-a023113cd08f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:09.048593 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b382fdd1-9cf8-4286-97b2-a023113cd08f None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:09.051007 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55098e79-5c03-4f0c-9f99-b1ff2711e240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:09.051600 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55098e79-5c03-4f0c-9f99-b1ff2711e240 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:09.051874 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55098e79-5c03-4f0c-9f99-b1ff2711e240 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:09.052140 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55098e79-5c03-4f0c-9f99-b1ff2711e240 None admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:09.052823 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55098e79-5c03-4f0c-9f99-b1ff2711e240 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:09.053122 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55098e79-5c03-4f0c-9f99-b1ff2711e240 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:09.055117 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55098e79-5c03-4f0c-9f99-b1ff2711e240 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:09.058363 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 300/580] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Aug 18 10:50:08 2022] GET /identity/v3/role_assignments?user.id=f97e906b1922419d8511ab1c8b9c86e4&scope.project.id=1575e8ebaaab4650995841659b6e631b&role.id=13bffd536e214d0893b3007e267f3301 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:09.059280 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b382fdd1-9cf8-4286-97b2-a023113cd08f None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:09.072842 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 281/581] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Aug 18 10:50:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:09.073776 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55098e79-5c03-4f0c-9f99-b1ff2711e240 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:09.126456 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:09.183964 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b382fdd1-9cf8-4286-97b2-a023113cd08f None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:09.198601 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55098e79-5c03-4f0c-9f99-b1ff2711e240 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:09.224579 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fba1dc8-c785-4c3c-9a69-786d61221581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:09.225187 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba1dc8-c785-4c3c-9a69-786d61221581 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:09.225462 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba1dc8-c785-4c3c-9a69-786d61221581 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:09.225762 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba1dc8-c785-4c3c-9a69-786d61221581 None admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:09.227255 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fba1dc8-c785-4c3c-9a69-786d61221581 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:09.227622 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fba1dc8-c785-4c3c-9a69-786d61221581 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:09.229102 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fba1dc8-c785-4c3c-9a69-786d61221581 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:09.246774 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efab5fec-6f3b-4d51-8e6e-d1343184a500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:09.247390 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab5fec-6f3b-4d51-8e6e-d1343184a500 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:09.247667 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab5fec-6f3b-4d51-8e6e-d1343184a500 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:09.247937 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab5fec-6f3b-4d51-8e6e-d1343184a500 None admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:09.248612 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efab5fec-6f3b-4d51-8e6e-d1343184a500 None admin] RBAC: Adding query filter params (name=service) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:09.248916 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efab5fec-6f3b-4d51-8e6e-d1343184a500 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:09.250426 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efab5fec-6f3b-4d51-8e6e-d1343184a500 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:09.252572 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 301/582] 10.222.0.15 () {56 vars in 1137 bytes} [Thu Aug 18 10:50:09 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:09.253470 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fba1dc8-c785-4c3c-9a69-786d61221581 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:09.257269 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:09.264983 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 282/583] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Aug 18 10:50:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:09.264983 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efab5fec-6f3b-4d51-8e6e-d1343184a500 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:09.370781 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efab5fec-6f3b-4d51-8e6e-d1343184a500 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:09.372411 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:09.373578 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fba1dc8-c785-4c3c-9a69-786d61221581 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:09.410030 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6aff70-b884-460b-ada1-f0c3c7b756f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:09.410658 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6aff70-b884-460b-ada1-f0c3c7b756f3 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:09.410935 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6aff70-b884-460b-ada1-f0c3c7b756f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:09.411203 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6aff70-b884-460b-ada1-f0c3c7b756f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:09.411562 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe4960b-78b0-4dcc-9ef5-ff3c1ad82906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:09.412230 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe4960b-78b0-4dcc-9ef5-ff3c1ad82906 None admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:09.412511 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe4960b-78b0-4dcc-9ef5-ff3c1ad82906 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:09.412784 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe4960b-78b0-4dcc-9ef5-ff3c1ad82906 None admin] PATH_INFO: `/v3/projects/1575e8ebaaab4650995841659b6e631b/users/a005d8f0c46d44c7b6f2201a54717b12/roles/13bffd536e214d0893b3007e267f3301` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:09.422493 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6aff70-b884-460b-ada1-f0c3c7b756f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:09.423943 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6aff70-b884-460b-ada1-f0c3c7b756f3 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:09.428675 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe4960b-78b0-4dcc-9ef5-ff3c1ad82906 None admin] RBAC: Authorizing `identity:create_grant(project_id=1575e8ebaaab4650995841659b6e631b, user_id=a005d8f0c46d44c7b6f2201a54717b12, role_id=13bffd536e214d0893b3007e267f3301)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:09.430734 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe4960b-78b0-4dcc-9ef5-ff3c1ad82906 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:09.439475 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-7e6aff70-b884-460b-ada1-f0c3c7b756f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:09.439475 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:09.439475 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:09.439475 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:09.439475 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:09.439475 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:09.439475 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:09.439475 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:09.439475 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:09.439475 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:09.439475 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:09.439475 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:09.439475 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 10:50:09.439475 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 10:50:09.439475 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 10:50:09.439475 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 10:50:09.440481 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:09.440481 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:09.440481 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:09.440481 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:09.440481 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:09.440481 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:09.440481 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:09.440481 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:09.440481 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:09.440481 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:09.440481 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:09.440481 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:09.440481 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:09.440481 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:09.440481 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:09.440481 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:09.440481 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 10:50:09.441383 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 10:50:09.441383 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:09.441383 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:09.441383 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 302/584] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:50:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:09.441383 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6aff70-b884-460b-ada1-f0c3c7b756f3 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:09.451709 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 283/585] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Aug 18 10:50:09 2022] PUT /identity/v3/projects/1575e8ebaaab4650995841659b6e631b/users/a005d8f0c46d44c7b6f2201a54717b12/roles/13bffd536e214d0893b3007e267f3301 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 10:50:09.452609 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe4960b-78b0-4dcc-9ef5-ff3c1ad82906 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:09.533476 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:09.582665 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6aff70-b884-460b-ada1-f0c3c7b756f3 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:09.605881 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe4960b-78b0-4dcc-9ef5-ff3c1ad82906 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:09.629199 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c93b6b-3b44-4c0e-8423-444b7b0e4930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:09.630268 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c93b6b-3b44-4c0e-8423-444b7b0e4930 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:09.630761 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c93b6b-3b44-4c0e-8423-444b7b0e4930 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:09.631039 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c93b6b-3b44-4c0e-8423-444b7b0e4930 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:09.645197 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c93b6b-3b44-4c0e-8423-444b7b0e4930 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:09.647139 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c93b6b-3b44-4c0e-8423-444b7b0e4930 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:09.663126 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3a187a-2b5a-49af-988b-1c9dd398ad58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:09.664400 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-64c93b6b-3b44-4c0e-8423-444b7b0e4930 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:09.664400 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:09.664400 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:09.664400 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:09.664400 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:09.664400 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:09.664400 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:09.664400 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:09.664400 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:09.664400 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:09.664400 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:09.664400 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:09.664400 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 10:50:09.664400 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 10:50:09.664400 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 10:50:09.664400 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 10:50:09.665381 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:09.665381 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:09.665381 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:09.665381 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:09.665381 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:09.665381 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:09.665381 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:09.665381 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:09.665381 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:09.665381 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:09.665381 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:09.665381 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:09.665381 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:09.665381 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:09.665381 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:09.665381 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:09.665381 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 10:50:09.666289 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 10:50:09.666289 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:09.666289 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:09.666289 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 303/586] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:50:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:09.666934 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c93b6b-3b44-4c0e-8423-444b7b0e4930 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:09.667406 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a187a-2b5a-49af-988b-1c9dd398ad58 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:09.667874 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a187a-2b5a-49af-988b-1c9dd398ad58 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:09.668388 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a187a-2b5a-49af-988b-1c9dd398ad58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:09.683884 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3a187a-2b5a-49af-988b-1c9dd398ad58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:09.686486 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3a187a-2b5a-49af-988b-1c9dd398ad58 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:09.707884 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-bb3a187a-2b5a-49af-988b-1c9dd398ad58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:09.707884 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:09.707884 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:09.707884 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:09.707884 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:09.707884 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:09.707884 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:09.707884 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:09.707884 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:09.707884 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:09.707884 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:09.707884 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:09.707884 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 10:50:09.707884 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 10:50:09.707884 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 10:50:09.707884 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 10:50:09.708883 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:09.708883 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:09.708883 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:09.708883 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:09.708883 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:09.708883 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:09.708883 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:09.708883 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:09.708883 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:09.708883 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:09.708883 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:09.708883 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:09.708883 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:09.708883 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:09.708883 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:09.708883 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:09.708883 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 10:50:09.709778 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 10:50:09.709778 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:09.709778 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:09.709778 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 284/587] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:50:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:09.711360 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3a187a-2b5a-49af-988b-1c9dd398ad58 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:09.716137 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:09.802615 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c93b6b-3b44-4c0e-8423-444b7b0e4930 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:09.817017 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:09.847155 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0a14d6-22d4-401c-89fd-cbf974b2f5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:09.847869 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a14d6-22d4-401c-89fd-cbf974b2f5ae None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:09.848226 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a14d6-22d4-401c-89fd-cbf974b2f5ae None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:09.848574 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a14d6-22d4-401c-89fd-cbf974b2f5ae None admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:09.848851 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3a187a-2b5a-49af-988b-1c9dd398ad58 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:09.849409 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0a14d6-22d4-401c-89fd-cbf974b2f5ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:09.849811 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0a14d6-22d4-401c-89fd-cbf974b2f5ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:09.851345 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0a14d6-22d4-401c-89fd-cbf974b2f5ae None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:09.864991 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 304/588] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 18 10:50:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:09.866062 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0a14d6-22d4-401c-89fd-cbf974b2f5ae None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:09.897301 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76196dc0-cc1e-4c5e-93b0-08dfd0299007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:09.898701 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76196dc0-cc1e-4c5e-93b0-08dfd0299007 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:09.898989 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76196dc0-cc1e-4c5e-93b0-08dfd0299007 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:09.899403 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76196dc0-cc1e-4c5e-93b0-08dfd0299007 None admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:09.900065 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76196dc0-cc1e-4c5e-93b0-08dfd0299007 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:09.900400 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76196dc0-cc1e-4c5e-93b0-08dfd0299007 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:09.901834 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76196dc0-cc1e-4c5e-93b0-08dfd0299007 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:09.918058 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 285/589] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 18 10:50:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:09.919739 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76196dc0-cc1e-4c5e-93b0-08dfd0299007 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:09.998419 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0a14d6-22d4-401c-89fd-cbf974b2f5ae None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:10.006285 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:10.047292 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aecfc9-e325-48ba-a594-2e5f9bbb9dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:10.048866 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aecfc9-e325-48ba-a594-2e5f9bbb9dda None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:10.049337 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aecfc9-e325-48ba-a594-2e5f9bbb9dda None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:10.049846 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aecfc9-e325-48ba-a594-2e5f9bbb9dda None admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:10.050908 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aecfc9-e325-48ba-a594-2e5f9bbb9dda None admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:10.051738 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aecfc9-e325-48ba-a594-2e5f9bbb9dda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:10.053576 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aecfc9-e325-48ba-a594-2e5f9bbb9dda None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:10.054153 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76196dc0-cc1e-4c5e-93b0-08dfd0299007 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:10.067334 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 305/590] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 18 10:50:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:10.068425 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aecfc9-e325-48ba-a594-2e5f9bbb9dda None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:10.099680 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8185ad-ff74-4ae7-94bc-03ac547a76c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:10.100417 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8185ad-ff74-4ae7-94bc-03ac547a76c2 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:10.100772 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8185ad-ff74-4ae7-94bc-03ac547a76c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:10.101144 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8185ad-ff74-4ae7-94bc-03ac547a76c2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:10.112254 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8185ad-ff74-4ae7-94bc-03ac547a76c2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:10.114960 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8185ad-ff74-4ae7-94bc-03ac547a76c2 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:10.121084 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:10.134850 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-1a8185ad-ff74-4ae7-94bc-03ac547a76c2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 10:50:10.134850 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:10.134850 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:10.134850 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:10.134850 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:10.134850 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:10.134850 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:10.134850 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:10.134850 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:10.134850 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:10.134850 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:10.134850 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:10.134850 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 10:50:10.134850 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 10:50:10.134850 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 10:50:10.134850 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 10:50:10.135850 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:10.135850 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:10.135850 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 10:50:10.135850 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 10:50:10.135850 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 10:50:10.135850 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 10:50:10.135850 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:10.135850 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:10.135850 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:10.135850 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:10.135850 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:10.135850 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:10.135850 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:10.135850 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:10.135850 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:10.135850 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:10.135850 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:10.135850 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:10.136761 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:10.136761 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:10.136761 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 10:50:10.136761 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 10:50:10.136761 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 10:50:10.136761 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 10:50:10.136761 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 10:50:10.136761 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 10:50:10.136761 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 10:50:10.136761 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:10.136761 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 286/591] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 18 10:50:09 2022] GET /identity/v3/users/cinder => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:10.137323 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8185ad-ff74-4ae7-94bc-03ac547a76c2 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:10.191996 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aecfc9-e325-48ba-a594-2e5f9bbb9dda None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:10.239294 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d9160-21ce-41e5-919f-b8cd817560b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:10.241169 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d9160-21ce-41e5-919f-b8cd817560b6 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:10.241609 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d9160-21ce-41e5-919f-b8cd817560b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:10.242095 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d9160-21ce-41e5-919f-b8cd817560b6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:10.252136 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912d9160-21ce-41e5-919f-b8cd817560b6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:10.254216 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912d9160-21ce-41e5-919f-b8cd817560b6 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:10.270477 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-912d9160-21ce-41e5-919f-b8cd817560b6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 10:50:10.270477 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:10.270477 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:10.270477 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:10.270477 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:10.270477 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:10.270477 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:10.270477 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:10.270477 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:10.270477 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:10.270477 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:10.270477 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:10.270477 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 10:50:10.270477 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 10:50:10.270477 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 10:50:10.271410 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 10:50:10.271410 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:10.271410 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:10.271410 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:10.271410 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:10.271410 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:10.271410 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:10.271410 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:10.271410 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:10.271410 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:10.271410 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:10.271410 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:10.271410 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:10.271410 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:10.271410 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:10.271410 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:10.271410 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:10.272273 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 10:50:10.272273 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 10:50:10.272273 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 10:50:10.272273 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 10:50:10.272273 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 10:50:10.272273 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 10:50:10.272273 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 10:50:10.272273 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:10.272273 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 306/592] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 18 10:50:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:10.273143 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d9160-21ce-41e5-919f-b8cd817560b6 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:10.279010 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8185ad-ff74-4ae7-94bc-03ac547a76c2 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:10.306404 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:10.322777 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be65a7-93d8-4895-ab4b-19638521a333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:10.323405 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be65a7-93d8-4895-ab4b-19638521a333 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:10.323682 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be65a7-93d8-4895-ab4b-19638521a333 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:10.324007 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be65a7-93d8-4895-ab4b-19638521a333 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:10.334674 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be65a7-93d8-4895-ab4b-19638521a333 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:10.336978 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be65a7-93d8-4895-ab4b-19638521a333 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:10.353631 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-04be65a7-93d8-4895-ab4b-19638521a333 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 18 10:50:10.353631 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:10.353631 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:10.353631 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:10.353631 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:10.353631 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:10.353631 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:10.353631 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:10.353631 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:10.353631 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:10.353631 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:10.353631 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:10.353631 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 10:50:10.353631 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 10:50:10.353631 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 10:50:10.353631 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 10:50:10.354668 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:10.354668 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:10.354668 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 10:50:10.354668 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 10:50:10.354668 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 10:50:10.354668 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 10:50:10.354668 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:10.354668 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:10.354668 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:10.354668 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:10.354668 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:10.354668 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:10.354668 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:10.354668 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:10.354668 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:10.354668 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:10.354668 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:10.354668 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:10.355606 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:10.355606 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:10.355606 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 10:50:10.355606 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 10:50:10.355606 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 10:50:10.355606 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 10:50:10.355606 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 10:50:10.355606 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 10:50:10.355606 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 18 10:50:10.355606 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:10.358335 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 287/593] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Aug 18 10:50:10 2022] GET /identity/v3/users/neutron => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:10.359421 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be65a7-93d8-4895-ab4b-19638521a333 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:10.389652 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:10.407367 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d9160-21ce-41e5-919f-b8cd817560b6 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:10.455681 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976b79dd-5a93-4d66-a7bd-cd9e13499a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:10.456222 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b79dd-5a93-4d66-a7bd-cd9e13499a6a None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:10.456506 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b79dd-5a93-4d66-a7bd-cd9e13499a6a None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:10.456786 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b79dd-5a93-4d66-a7bd-cd9e13499a6a None admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:10.457532 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976b79dd-5a93-4d66-a7bd-cd9e13499a6a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:10.457867 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976b79dd-5a93-4d66-a7bd-cd9e13499a6a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:10.460018 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976b79dd-5a93-4d66-a7bd-cd9e13499a6a None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:10.480615 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be65a7-93d8-4895-ab4b-19638521a333 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:10.484774 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 307/594] 10.222.0.15 () {56 vars in 1137 bytes} [Thu Aug 18 10:50:10 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:10.485678 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976b79dd-5a93-4d66-a7bd-cd9e13499a6a None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:10.526509 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8e3c25-ee59-4096-8fa0-3134ed22468c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:10.527123 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e3c25-ee59-4096-8fa0-3134ed22468c None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:10.527413 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e3c25-ee59-4096-8fa0-3134ed22468c None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:10.527703 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e3c25-ee59-4096-8fa0-3134ed22468c None admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:10.528446 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8e3c25-ee59-4096-8fa0-3134ed22468c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:10.528760 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8e3c25-ee59-4096-8fa0-3134ed22468c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:10.530250 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8e3c25-ee59-4096-8fa0-3134ed22468c None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:10.544441 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 288/595] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Aug 18 10:50:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:10.545314 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8e3c25-ee59-4096-8fa0-3134ed22468c None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:10.594861 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:10.627242 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976b79dd-5a93-4d66-a7bd-cd9e13499a6a None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:10.659171 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8e3c25-ee59-4096-8fa0-3134ed22468c None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:10.676931 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4483d65-81ff-4269-ba41-c7cb37c4449a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:10.678999 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4483d65-81ff-4269-ba41-c7cb37c4449a None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:10.679288 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4483d65-81ff-4269-ba41-c7cb37c4449a None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:10.679600 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4483d65-81ff-4269-ba41-c7cb37c4449a None admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:10.680542 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4483d65-81ff-4269-ba41-c7cb37c4449a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:10.680842 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4483d65-81ff-4269-ba41-c7cb37c4449a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:10.682297 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4483d65-81ff-4269-ba41-c7cb37c4449a None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:10.704077 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 308/596] 10.222.0.15 () {56 vars in 1139 bytes} [Thu Aug 18 10:50:10 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:10.704909 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4483d65-81ff-4269-ba41-c7cb37c4449a None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:10.708081 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c150cd71-ee4e-4c49-92c5-9b89d849a352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:10.709554 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:10.712428 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150cd71-ee4e-4c49-92c5-9b89d849a352 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:10.713081 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150cd71-ee4e-4c49-92c5-9b89d849a352 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:10.713578 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150cd71-ee4e-4c49-92c5-9b89d849a352 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:10.729398 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c150cd71-ee4e-4c49-92c5-9b89d849a352 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:10.732045 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c150cd71-ee4e-4c49-92c5-9b89d849a352 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:10.753051 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-c150cd71-ee4e-4c49-92c5-9b89d849a352 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:10.753051 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:10.753051 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:10.753051 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:10.753051 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:10.753051 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:10.753051 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:10.753051 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:10.753051 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:10.753051 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:10.753051 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:10.753051 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:10.753051 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 10:50:10.753051 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 10:50:10.753051 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 10:50:10.753051 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 10:50:10.754046 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:10.754046 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:10.754046 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:10.754046 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:10.754046 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:10.754046 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:10.754046 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:10.754046 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:10.754046 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:10.754046 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:10.754046 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:10.754046 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:10.754046 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:10.754046 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:10.754046 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:10.754046 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:10.754046 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 10:50:10.754923 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 10:50:10.754923 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:10.754923 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:10.756943 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 289/597] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:50:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:10.759172 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c150cd71-ee4e-4c49-92c5-9b89d849a352 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:10.818900 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4483d65-81ff-4269-ba41-c7cb37c4449a None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:10.856710 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a47334-c664-4739-bb9a-94d7bc39d4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:10.857574 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a47334-c664-4739-bb9a-94d7bc39d4b6 None admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:10.857922 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a47334-c664-4739-bb9a-94d7bc39d4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:10.858292 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a47334-c664-4739-bb9a-94d7bc39d4b6 None admin] PATH_INFO: `/v3/projects/1575e8ebaaab4650995841659b6e631b/users/77211d2dcef242c4a7fe2198556d5efc/roles/13bffd536e214d0893b3007e267f3301` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:10.875934 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a47334-c664-4739-bb9a-94d7bc39d4b6 None admin] RBAC: Authorizing `identity:create_grant(project_id=1575e8ebaaab4650995841659b6e631b, user_id=77211d2dcef242c4a7fe2198556d5efc, role_id=13bffd536e214d0893b3007e267f3301)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:10.877612 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a47334-c664-4739-bb9a-94d7bc39d4b6 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:10.892067 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 309/598] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Aug 18 10:50:10 2022] PUT /identity/v3/projects/1575e8ebaaab4650995841659b6e631b/users/77211d2dcef242c4a7fe2198556d5efc/roles/13bffd536e214d0893b3007e267f3301 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 10:50:10.892778 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:10.893536 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a47334-c664-4739-bb9a-94d7bc39d4b6 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:10.902191 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c150cd71-ee4e-4c49-92c5-9b89d849a352 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:10.944041 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5530f696-f24f-4e06-ad5f-ac8e3301cc95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:10.944986 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5530f696-f24f-4e06-ad5f-ac8e3301cc95 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:10.945414 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5530f696-f24f-4e06-ad5f-ac8e3301cc95 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:10.946072 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5530f696-f24f-4e06-ad5f-ac8e3301cc95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:10.958468 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5530f696-f24f-4e06-ad5f-ac8e3301cc95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:10.959128 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:10.961918 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5530f696-f24f-4e06-ad5f-ac8e3301cc95 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:10.980847 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-5530f696-f24f-4e06-ad5f-ac8e3301cc95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:10.980847 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:10.980847 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:10.980847 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:10.980847 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:10.980847 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:10.980847 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:10.980847 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:10.980847 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:10.980847 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:10.980847 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:10.980847 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:10.980847 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 10:50:10.980847 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 10:50:10.980847 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 10:50:10.980847 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 10:50:10.981937 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:10.981937 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:10.981937 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:10.981937 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:10.981937 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:10.981937 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:10.981937 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:10.981937 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:10.981937 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:10.981937 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:10.981937 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:10.981937 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:10.981937 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:10.981937 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:10.981937 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:10.981937 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:10.981937 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 10:50:10.983020 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 10:50:10.983020 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:10.983020 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:10.984909 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 290/599] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:50:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:10.990556 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5530f696-f24f-4e06-ad5f-ac8e3301cc95 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:11.019641 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a47334-c664-4739-bb9a-94d7bc39d4b6 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:11.072363 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9332dc56-1ae2-4103-8a4f-23897d7397fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:11.073205 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9332dc56-1ae2-4103-8a4f-23897d7397fb None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:11.073655 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9332dc56-1ae2-4103-8a4f-23897d7397fb None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:11.074026 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9332dc56-1ae2-4103-8a4f-23897d7397fb None admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:11.074793 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9332dc56-1ae2-4103-8a4f-23897d7397fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:11.076641 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9332dc56-1ae2-4103-8a4f-23897d7397fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:11.078211 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9332dc56-1ae2-4103-8a4f-23897d7397fb None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:11.105056 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 310/600] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 18 10:50:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:11.111650 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9332dc56-1ae2-4103-8a4f-23897d7397fb None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:11.202162 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5530f696-f24f-4e06-ad5f-ac8e3301cc95 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:11.245265 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9332dc56-1ae2-4103-8a4f-23897d7397fb None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:11.248612 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb05d27-a035-4133-a30d-562280940499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:11.249354 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb05d27-a035-4133-a30d-562280940499 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:11.249564 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb05d27-a035-4133-a30d-562280940499 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:11.249845 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb05d27-a035-4133-a30d-562280940499 None admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:11.250492 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb05d27-a035-4133-a30d-562280940499 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:11.250791 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb05d27-a035-4133-a30d-562280940499 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:11.252155 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb05d27-a035-4133-a30d-562280940499 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:11.261819 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:11.268065 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 291/601] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 18 10:50:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:11.269350 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59176689-5f97-4bd5-bba4-f4d8e734b2a3 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:11.273743 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59176689-5f97-4bd5-bba4-f4d8e734b2a3 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:11.274365 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59176689-5f97-4bd5-bba4-f4d8e734b2a3 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:11.275909 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 292/602] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:50:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:50:11.278072 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59176689-5f97-4bd5-bba4-f4d8e734b2a3 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:11.294575 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:11.304890 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9c5b89-bf0c-40f5-996f-d874013df668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:11.305941 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c5b89-bf0c-40f5-996f-d874013df668 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:11.306364 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c5b89-bf0c-40f5-996f-d874013df668 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:11.306778 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c5b89-bf0c-40f5-996f-d874013df668 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:11.317009 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9c5b89-bf0c-40f5-996f-d874013df668 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:11.319582 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9c5b89-bf0c-40f5-996f-d874013df668 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:11.334489 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-8f9c5b89-bf0c-40f5-996f-d874013df668 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 10:50:11.334489 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:11.334489 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:11.334489 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:11.334489 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:11.334489 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:11.334489 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:11.334489 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:11.334489 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:11.334489 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:11.334489 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:11.334489 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:11.334489 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 10:50:11.334489 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 10:50:11.334489 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 10:50:11.336107 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 10:50:11.336107 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:11.336107 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:11.336107 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:11.336107 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:11.336107 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:11.336107 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:11.336107 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:11.336107 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:11.336107 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:11.336107 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:11.336107 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:11.336107 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:11.336107 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:11.336107 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:11.336107 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:11.336107 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:11.337202 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 10:50:11.337202 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 10:50:11.337202 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 10:50:11.337202 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 10:50:11.337202 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 10:50:11.337202 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 10:50:11.337202 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 10:50:11.337202 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:11.344466 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 311/603] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 18 10:50:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 10:50:11.346280 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9bc473-26fd-43b3-9613-05166c7d8f13 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:11.346710 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9bc473-26fd-43b3-9613-05166c7d8f13 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:11.347148 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9bc473-26fd-43b3-9613-05166c7d8f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:11.372261 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-5c9bc473-26fd-43b3-9613-05166c7d8f13 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:50:11.373727 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-5c9bc473-26fd-43b3-9613-05166c7d8f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:50:11.405790 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59176689-5f97-4bd5-bba4-f4d8e734b2a3 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:11.447440 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88316bd-f7eb-4a0a-b5de-0237c1eec727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:11.448301 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88316bd-f7eb-4a0a-b5de-0237c1eec727 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:11.448567 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88316bd-f7eb-4a0a-b5de-0237c1eec727 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:11.448915 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88316bd-f7eb-4a0a-b5de-0237c1eec727 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:11.456480 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88316bd-f7eb-4a0a-b5de-0237c1eec727 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:11.458296 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88316bd-f7eb-4a0a-b5de-0237c1eec727 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:11.470193 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 312/604] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:50:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 10:50:11.471381 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9bc473-26fd-43b3-9613-05166c7d8f13 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:11.480595 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-b88316bd-f7eb-4a0a-b5de-0237c1eec727 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 10:50:11.480595 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:11.480595 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:11.480595 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:11.480595 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:11.480595 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:11.480595 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:11.480595 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:11.480595 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:11.480595 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:11.480595 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:11.480595 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:11.480595 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 10:50:11.480595 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 10:50:11.480595 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 10:50:11.481938 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 10:50:11.481938 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:11.481938 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:11.481938 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:11.481938 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:11.481938 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:11.481938 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:11.481938 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:11.481938 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:11.481938 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:11.481938 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:11.481938 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:11.481938 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:11.481938 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:11.481938 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:11.481938 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:11.481938 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:11.482810 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 10:50:11.482810 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 10:50:11.482810 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 10:50:11.482810 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 10:50:11.482810 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 10:50:11.482810 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 10:50:11.482810 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 10:50:11.482810 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:11.482810 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 293/605] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 18 10:50:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:11.490521 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88316bd-f7eb-4a0a-b5de-0237c1eec727 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:11.604469 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:11.657992 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88316bd-f7eb-4a0a-b5de-0237c1eec727 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:11.658436 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9bc473-26fd-43b3-9613-05166c7d8f13 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:11.661628 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:11.698753 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d44c6-0fd8-4eee-9052-619f425f0712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:11.699865 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d44c6-0fd8-4eee-9052-619f425f0712 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:11.700250 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d44c6-0fd8-4eee-9052-619f425f0712 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:11.700560 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d44c6-0fd8-4eee-9052-619f425f0712 None admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:11.701700 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644d44c6-0fd8-4eee-9052-619f425f0712 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:11.702013 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644d44c6-0fd8-4eee-9052-619f425f0712 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:11.703654 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644d44c6-0fd8-4eee-9052-619f425f0712 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:11.709635 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b54df4-63a0-4170-9433-f94aaead419b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:11.710559 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b54df4-63a0-4170-9433-f94aaead419b None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:11.711634 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b54df4-63a0-4170-9433-f94aaead419b None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:11.712116 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b54df4-63a0-4170-9433-f94aaead419b None admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:11.713567 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b54df4-63a0-4170-9433-f94aaead419b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:11.714099 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b54df4-63a0-4170-9433-f94aaead419b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:11.716022 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b54df4-63a0-4170-9433-f94aaead419b None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:11.716888 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 313/606] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Aug 18 10:50:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:11.718359 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd35fc-a6df-410c-aed8-ed7abfe3c71e None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:11.718650 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd35fc-a6df-410c-aed8-ed7abfe3c71e None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:11.718928 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd35fc-a6df-410c-aed8-ed7abfe3c71e None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:11.724112 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 314/607] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:50:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:50:11.724112 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebd35fc-a6df-410c-aed8-ed7abfe3c71e None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:11.741011 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 294/608] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Aug 18 10:50:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 10:50:11.743173 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d44bb-b095-4366-a8f1-b130ee67c4ff None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:11.743670 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d44bb-b095-4366-a8f1-b130ee67c4ff None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:11.744169 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d44bb-b095-4366-a8f1-b130ee67c4ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:11.768333 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-4b4d44bb-b095-4366-a8f1-b130ee67c4ff None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:50:11.770199 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-4b4d44bb-b095-4366-a8f1-b130ee67c4ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:50:11.847097 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebd35fc-a6df-410c-aed8-ed7abfe3c71e None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:11.850671 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 295/609] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:50:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 10:50:11.851166 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4d44bb-b095-4366-a8f1-b130ee67c4ff None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:11.888843 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c55c63-7587-4c01-b05c-03ed3b47f28b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:11.889427 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c55c63-7587-4c01-b05c-03ed3b47f28b None admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:11.889842 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c55c63-7587-4c01-b05c-03ed3b47f28b None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:11.890128 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c55c63-7587-4c01-b05c-03ed3b47f28b None admin] PATH_INFO: `/v3/projects/1575e8ebaaab4650995841659b6e631b/users/5b8a09704b9b4ab2bffb813796ec6e77/roles/13bffd536e214d0893b3007e267f3301` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:11.911661 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c55c63-7587-4c01-b05c-03ed3b47f28b None admin] RBAC: Authorizing `identity:create_grant(project_id=1575e8ebaaab4650995841659b6e631b, user_id=5b8a09704b9b4ab2bffb813796ec6e77, role_id=13bffd536e214d0893b3007e267f3301)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:11.913551 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c55c63-7587-4c01-b05c-03ed3b47f28b None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:11.933158 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:11.933487 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 315/610] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Aug 18 10:50:11 2022] PUT /identity/v3/projects/1575e8ebaaab4650995841659b6e631b/users/5b8a09704b9b4ab2bffb813796ec6e77/roles/13bffd536e214d0893b3007e267f3301 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 10:50:11.934715 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c55c63-7587-4c01-b05c-03ed3b47f28b None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:11.957101 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:12.002107 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4d44bb-b095-4366-a8f1-b130ee67c4ff None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:12.088832 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ebc03c-e55d-45a4-a8b8-b5e83e9f576a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:12.089552 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ebc03c-e55d-45a4-a8b8-b5e83e9f576a None admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:12.089836 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ebc03c-e55d-45a4-a8b8-b5e83e9f576a None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:12.090117 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ebc03c-e55d-45a4-a8b8-b5e83e9f576a None admin] PATH_INFO: `/v3/projects/1575e8ebaaab4650995841659b6e631b/users/86c2cd74178f443d9c2398ff8e00cccc/roles/13bffd536e214d0893b3007e267f3301` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:12.108422 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ebc03c-e55d-45a4-a8b8-b5e83e9f576a None admin] RBAC: Authorizing `identity:create_grant(project_id=1575e8ebaaab4650995841659b6e631b, user_id=86c2cd74178f443d9c2398ff8e00cccc, role_id=13bffd536e214d0893b3007e267f3301)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:12.110027 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ebc03c-e55d-45a4-a8b8-b5e83e9f576a None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:12.122747 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c55c63-7587-4c01-b05c-03ed3b47f28b None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:12.133730 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 296/611] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Aug 18 10:50:11 2022] PUT /identity/v3/projects/1575e8ebaaab4650995841659b6e631b/users/86c2cd74178f443d9c2398ff8e00cccc/roles/13bffd536e214d0893b3007e267f3301 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 10:50:12.166533 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af994ee5-90cc-4ede-a513-5f5cfd4c76a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:12.167095 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af994ee5-90cc-4ede-a513-5f5cfd4c76a3 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:12.167372 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af994ee5-90cc-4ede-a513-5f5cfd4c76a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:12.167640 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af994ee5-90cc-4ede-a513-5f5cfd4c76a3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:12.180837 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af994ee5-90cc-4ede-a513-5f5cfd4c76a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:50:12.185772 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-af994ee5-90cc-4ede-a513-5f5cfd4c76a3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 10:50:12.185772 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:12.185772 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:12.185772 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:12.185772 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:12.185772 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:12.185772 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:12.185772 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:12.185772 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:12.185772 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:12.185772 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:12.185772 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:12.185772 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:50:12.185772 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:50:12.185772 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:50:12.185772 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:50:12.187538 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:50:12.187538 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:50:12.187538 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:50:12.187538 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:50:12.187538 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:12.187538 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:12.187538 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:12.187538 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:12.187538 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:12.187538 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:12.187538 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:12.187538 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:12.187538 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:12.187538 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:12.187538 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:12.187538 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:12.188536 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:12.188536 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:12.188536 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:12.188536 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:12.188536 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:50:12.188536 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:50:12.188536 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:50:12.188536 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:50:12.188536 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:50:12.188536 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:50:12.188536 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 10:50:12.188536 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:12.188536 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 316/612] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Aug 18 10:50:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:12.193341 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ebc03c-e55d-45a4-a8b8-b5e83e9f576a None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:12.219996 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af994ee5-90cc-4ede-a513-5f5cfd4c76a3 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:12.372701 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ebc03c-e55d-45a4-a8b8-b5e83e9f576a None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:12.384073 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:12.385952 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:12.443912 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af994ee5-90cc-4ede-a513-5f5cfd4c76a3 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:12.458174 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd29ac01-ff15-4f07-8c9e-8a3773532da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:12.459069 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd29ac01-ff15-4f07-8c9e-8a3773532da2 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:12.459514 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd29ac01-ff15-4f07-8c9e-8a3773532da2 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:12.459936 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd29ac01-ff15-4f07-8c9e-8a3773532da2 None admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:12.461363 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd29ac01-ff15-4f07-8c9e-8a3773532da2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:12.461958 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd29ac01-ff15-4f07-8c9e-8a3773532da2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:12.466103 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd29ac01-ff15-4f07-8c9e-8a3773532da2 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:12.487850 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 297/613] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Aug 18 10:50:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:12.493234 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd29ac01-ff15-4f07-8c9e-8a3773532da2 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:12.502832 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57808e6d-48af-405d-9ee1-71bed8451b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:12.504039 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57808e6d-48af-405d-9ee1-71bed8451b57 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:12.504483 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57808e6d-48af-405d-9ee1-71bed8451b57 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:12.504919 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57808e6d-48af-405d-9ee1-71bed8451b57 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:12.533099 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57808e6d-48af-405d-9ee1-71bed8451b57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:50:12.538008 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-57808e6d-48af-405d-9ee1-71bed8451b57 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 10:50:12.538008 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:12.538008 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:12.538008 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:12.538008 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:12.538008 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:12.538008 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:12.538008 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:12.538008 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:12.538008 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:12.538008 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:12.538008 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:12.538008 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:50:12.538008 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:50:12.538008 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:50:12.538008 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:50:12.539290 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:50:12.539290 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:50:12.539290 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:50:12.539290 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:50:12.539290 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:12.539290 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:12.539290 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:12.539290 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:12.539290 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:12.539290 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:12.539290 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:12.539290 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:12.539290 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:12.539290 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:12.539290 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:12.539290 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:12.540319 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:12.540319 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:12.540319 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:12.540319 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:12.540319 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:50:12.540319 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:50:12.540319 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:50:12.540319 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:50:12.540319 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:50:12.540319 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:50:12.540319 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 10:50:12.540319 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:12.547515 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 317/614] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Aug 18 10:50:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:12.554774 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57808e6d-48af-405d-9ee1-71bed8451b57 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:12.639410 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd29ac01-ff15-4f07-8c9e-8a3773532da2 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:12.675755 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbd0655-120b-4ae0-beca-7c1f74143e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:12.676565 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd0655-120b-4ae0-beca-7c1f74143e5a None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:12.676939 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd0655-120b-4ae0-beca-7c1f74143e5a None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:12.677311 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd0655-120b-4ae0-beca-7c1f74143e5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:12.691158 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbd0655-120b-4ae0-beca-7c1f74143e5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:12.692984 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbd0655-120b-4ae0-beca-7c1f74143e5a None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:12.725882 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-3bbd0655-120b-4ae0-beca-7c1f74143e5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:12.725882 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:12.725882 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:12.725882 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:12.725882 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:12.725882 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:12.725882 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:12.725882 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:12.725882 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:12.725882 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:12.725882 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:12.725882 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:12.725882 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 10:50:12.725882 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 10:50:12.725882 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 10:50:12.725882 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 10:50:12.727023 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:12.727023 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:12.727023 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:12.727023 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:12.727023 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:12.727023 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:12.727023 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:12.727023 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:12.727023 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:12.727023 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:12.727023 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:12.727023 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:12.727023 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:12.727023 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:12.727023 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:12.727023 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:12.727023 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 10:50:12.727973 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 10:50:12.727973 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:12.727973 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:12.734559 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 298/615] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:50:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:12.737011 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbd0655-120b-4ae0-beca-7c1f74143e5a None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:12.777178 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:12.865380 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbd0655-120b-4ae0-beca-7c1f74143e5a None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:12.876617 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57808e6d-48af-405d-9ee1-71bed8451b57 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:12.906669 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b95710-e8cc-42ed-bc50-51f60cbaa21f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:12.907527 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b95710-e8cc-42ed-bc50-51f60cbaa21f None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:12.907951 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b95710-e8cc-42ed-bc50-51f60cbaa21f None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:12.908467 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b95710-e8cc-42ed-bc50-51f60cbaa21f None admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:12.909253 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b95710-e8cc-42ed-bc50-51f60cbaa21f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:12.909886 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b95710-e8cc-42ed-bc50-51f60cbaa21f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:12.911403 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b95710-e8cc-42ed-bc50-51f60cbaa21f None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:12.925543 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 299/616] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 18 10:50:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:12.936280 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b95710-e8cc-42ed-bc50-51f60cbaa21f None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:12.972185 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ae24ac-5df0-4cf8-8e9f-95dd59b1acf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:12.972814 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae24ac-5df0-4cf8-8e9f-95dd59b1acf2 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:12.973081 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae24ac-5df0-4cf8-8e9f-95dd59b1acf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:12.973358 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae24ac-5df0-4cf8-8e9f-95dd59b1acf2 None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:12.974065 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ae24ac-5df0-4cf8-8e9f-95dd59b1acf2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:12.974369 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ae24ac-5df0-4cf8-8e9f-95dd59b1acf2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:12.975775 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ae24ac-5df0-4cf8-8e9f-95dd59b1acf2 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:12.979712 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:12.996133 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 318/617] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Aug 18 10:50:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 442 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 10:50:13.000547 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ae24ac-5df0-4cf8-8e9f-95dd59b1acf2 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:13.103374 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:13.124838 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b95710-e8cc-42ed-bc50-51f60cbaa21f None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:13.162908 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ae24ac-5df0-4cf8-8e9f-95dd59b1acf2 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:13.163167 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df731ef-72b7-4149-8852-c1c2d23c12a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:13.163910 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df731ef-72b7-4149-8852-c1c2d23c12a1 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:13.164363 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df731ef-72b7-4149-8852-c1c2d23c12a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:13.164710 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df731ef-72b7-4149-8852-c1c2d23c12a1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:13.173013 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df731ef-72b7-4149-8852-c1c2d23c12a1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:13.174726 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df731ef-72b7-4149-8852-c1c2d23c12a1 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:13.188404 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-8df731ef-72b7-4149-8852-c1c2d23c12a1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 18 10:50:13.188404 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:13.188404 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:13.188404 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:13.188404 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:13.188404 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:13.188404 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:13.188404 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:13.188404 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:13.188404 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:13.188404 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:13.188404 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:13.188404 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 10:50:13.188404 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 10:50:13.188404 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 10:50:13.188404 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 10:50:13.189485 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:13.189485 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:13.189485 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 10:50:13.189485 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 10:50:13.189485 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 10:50:13.189485 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 10:50:13.189485 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:13.189485 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:13.189485 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:13.189485 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:13.189485 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:13.189485 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:13.189485 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:13.189485 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:13.189485 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:13.189485 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:13.189485 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:13.189485 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:13.190424 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:13.190424 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:13.190424 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 10:50:13.190424 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 10:50:13.190424 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 10:50:13.190424 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 10:50:13.190424 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 10:50:13.190424 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 10:50:13.190424 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 18 10:50:13.190424 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:13.190424 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 300/618] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Aug 18 10:50:12 2022] GET /identity/v3/users/swift => generated 83 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:13.196275 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dbf367-c6a3-4615-ab7b-30ed979ee2c9 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:13.196275 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dbf367-c6a3-4615-ab7b-30ed979ee2c9 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:13.196275 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dbf367-c6a3-4615-ab7b-30ed979ee2c9 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:13.198184 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 301/619] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:50:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:50:13.199060 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dbf367-c6a3-4615-ab7b-30ed979ee2c9 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:13.216643 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac21191-1130-45d7-abe4-2ba1dc4021f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:13.218054 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac21191-1130-45d7-abe4-2ba1dc4021f6 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:13.218541 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac21191-1130-45d7-abe4-2ba1dc4021f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:13.219039 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac21191-1130-45d7-abe4-2ba1dc4021f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:13.233289 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac21191-1130-45d7-abe4-2ba1dc4021f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:13.234753 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac21191-1130-45d7-abe4-2ba1dc4021f6 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:13.251441 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-5ac21191-1130-45d7-abe4-2ba1dc4021f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:13.251441 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:13.251441 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:13.251441 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:13.251441 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:13.251441 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:13.251441 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:13.251441 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:13.251441 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:13.251441 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:13.251441 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:13.251441 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:13.251441 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 10:50:13.251441 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 10:50:13.251441 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 10:50:13.251441 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 10:50:13.252635 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:13.252635 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:13.252635 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:13.252635 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:13.252635 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:13.252635 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:13.252635 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:13.252635 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:13.252635 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:13.252635 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:13.252635 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:13.252635 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:13.252635 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:13.252635 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:13.252635 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:13.252635 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:13.252635 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 10:50:13.254268 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 10:50:13.254268 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:13.254268 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:13.258039 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 319/620] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:50:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:13.259544 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d2914-7bac-44b4-a864-1c95e7902fb8 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:13.259829 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d2914-7bac-44b4-a864-1c95e7902fb8 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:13.260103 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d2914-7bac-44b4-a864-1c95e7902fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:13.280260 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-a59d2914-7bac-44b4-a864-1c95e7902fb8 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:50:13.281483 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-a59d2914-7bac-44b4-a864-1c95e7902fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:50:13.330288 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:13.355516 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dbf367-c6a3-4615-ab7b-30ed979ee2c9 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:13.365549 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 320/621] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:50:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 10:50:13.365549 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59d2914-7bac-44b4-a864-1c95e7902fb8 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:13.405451 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a546ef5d-6925-46fb-b06b-d8a17ff5ab65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:13.406562 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a546ef5d-6925-46fb-b06b-d8a17ff5ab65 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:13.406997 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a546ef5d-6925-46fb-b06b-d8a17ff5ab65 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:13.407424 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a546ef5d-6925-46fb-b06b-d8a17ff5ab65 None admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:13.408796 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a546ef5d-6925-46fb-b06b-d8a17ff5ab65 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:13.409259 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a546ef5d-6925-46fb-b06b-d8a17ff5ab65 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:13.411202 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a546ef5d-6925-46fb-b06b-d8a17ff5ab65 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:13.430156 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:13.434001 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 302/622] 10.222.0.15 () {56 vars in 1135 bytes} [Thu Aug 18 10:50:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:13.441563 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a546ef5d-6925-46fb-b06b-d8a17ff5ab65 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:13.549133 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59d2914-7bac-44b4-a864-1c95e7902fb8 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:13.593687 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a195a34-24cb-44aa-ab4b-4b5b179effbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:13.594303 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a195a34-24cb-44aa-ab4b-4b5b179effbe None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:13.594581 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a195a34-24cb-44aa-ab4b-4b5b179effbe None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:13.594850 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a195a34-24cb-44aa-ab4b-4b5b179effbe None admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:13.595498 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a195a34-24cb-44aa-ab4b-4b5b179effbe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:13.595800 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a195a34-24cb-44aa-ab4b-4b5b179effbe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:13.597159 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a195a34-24cb-44aa-ab4b-4b5b179effbe None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:13.629878 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 321/623] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 18 10:50:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:13.631132 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a195a34-24cb-44aa-ab4b-4b5b179effbe None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:13.678384 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a546ef5d-6925-46fb-b06b-d8a17ff5ab65 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:13.726542 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:13.744682 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3299fe59-0e3f-406a-8508-0b0491105a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:13.745772 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3299fe59-0e3f-406a-8508-0b0491105a6b None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:13.746277 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3299fe59-0e3f-406a-8508-0b0491105a6b None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:13.746749 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3299fe59-0e3f-406a-8508-0b0491105a6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:13.759337 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3299fe59-0e3f-406a-8508-0b0491105a6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:13.761277 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3299fe59-0e3f-406a-8508-0b0491105a6b None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:13.778898 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-3299fe59-0e3f-406a-8508-0b0491105a6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:13.778898 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:13.778898 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:13.778898 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:13.778898 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:13.778898 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:13.778898 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:13.778898 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:13.778898 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:13.778898 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:13.778898 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:13.778898 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:13.778898 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 10:50:13.778898 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 10:50:13.778898 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 10:50:13.778898 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 10:50:13.779896 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:13.779896 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:13.779896 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:13.779896 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:13.779896 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:13.779896 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:13.779896 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:13.779896 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:13.779896 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:13.779896 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:13.779896 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:13.779896 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:13.779896 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:13.779896 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:13.779896 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:13.779896 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:13.779896 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 10:50:13.780788 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 10:50:13.780788 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:13.780788 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:13.783077 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 303/624] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:50:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 10:50:13.784203 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3299fe59-0e3f-406a-8508-0b0491105a6b None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:13.787494 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a195a34-24cb-44aa-ab4b-4b5b179effbe None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:13.831444 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5872827f-fa1e-4c4b-b48a-e58fd37e32fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:13.832458 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5872827f-fa1e-4c4b-b48a-e58fd37e32fc None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:13.832958 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5872827f-fa1e-4c4b-b48a-e58fd37e32fc None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:13.833431 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5872827f-fa1e-4c4b-b48a-e58fd37e32fc None admin] PATH_INFO: `/v3/users/nova` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:13.842217 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5872827f-fa1e-4c4b-b48a-e58fd37e32fc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:13.844234 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5872827f-fa1e-4c4b-b48a-e58fd37e32fc None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:13.857880 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-5872827f-fa1e-4c4b-b48a-e58fd37e32fc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 10:50:13.857880 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:13.857880 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:13.857880 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:13.857880 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:13.857880 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:13.857880 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:13.857880 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:13.857880 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:13.857880 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:13.857880 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:13.857880 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:13.857880 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 10:50:13.857880 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 10:50:13.857880 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 10:50:13.857880 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 10:50:13.858927 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:13.858927 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:13.858927 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 10:50:13.858927 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 10:50:13.858927 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 10:50:13.858927 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 10:50:13.858927 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:13.858927 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:13.858927 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:13.858927 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:13.858927 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:13.858927 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:13.858927 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:13.858927 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:13.858927 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:13.858927 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:13.858927 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:13.858927 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:13.859886 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:13.859886 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:13.859886 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 10:50:13.859886 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 10:50:13.859886 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 10:50:13.859886 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 10:50:13.859886 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 10:50:13.859886 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 10:50:13.859886 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 10:50:13.859886 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:13.861076 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:13.869936 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 322/625] 10.222.0.15 () {56 vars in 1093 bytes} [Thu Aug 18 10:50:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 10:50:13.871523 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5872827f-fa1e-4c4b-b48a-e58fd37e32fc None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:13.925334 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3299fe59-0e3f-406a-8508-0b0491105a6b None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:13.964281 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3e17d4-8b18-40b0-a6f1-a931ed5a04d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:13.965309 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e17d4-8b18-40b0-a6f1-a931ed5a04d2 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:13.965840 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e17d4-8b18-40b0-a6f1-a931ed5a04d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:13.966332 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e17d4-8b18-40b0-a6f1-a931ed5a04d2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:13.979223 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3e17d4-8b18-40b0-a6f1-a931ed5a04d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:50:13.984806 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-7f3e17d4-8b18-40b0-a6f1-a931ed5a04d2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 10:50:13.984806 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:13.984806 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:13.984806 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:13.984806 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:13.984806 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:13.984806 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:13.984806 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:13.984806 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:13.984806 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:13.984806 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:13.984806 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:13.984806 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:50:13.984806 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:50:13.984806 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:50:13.984806 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:50:13.985998 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:50:13.985998 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:50:13.985998 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:50:13.985998 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:50:13.985998 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:13.985998 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:13.985998 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:13.985998 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:13.985998 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:13.985998 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:13.985998 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:13.985998 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:13.985998 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:13.985998 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:13.985998 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:13.985998 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:13.986842 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:13.986842 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:13.986842 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:13.986842 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:13.986842 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:50:13.986842 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:50:13.986842 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:50:13.986842 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:50:13.986842 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:50:13.986842 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:50:13.986842 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 10:50:13.986842 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:13.993810 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:13.994221 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 304/626] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Aug 18 10:50:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:13.995604 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3e17d4-8b18-40b0-a6f1-a931ed5a04d2 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:13.999426 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5872827f-fa1e-4c4b-b48a-e58fd37e32fc None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:14.043226 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf58111-94a0-4f64-8cd5-8f2af02c160a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:14.044468 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf58111-94a0-4f64-8cd5-8f2af02c160a None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:14.044902 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf58111-94a0-4f64-8cd5-8f2af02c160a None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:14.045332 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf58111-94a0-4f64-8cd5-8f2af02c160a None admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:14.046448 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf58111-94a0-4f64-8cd5-8f2af02c160a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:14.046912 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf58111-94a0-4f64-8cd5-8f2af02c160a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:14.048681 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf58111-94a0-4f64-8cd5-8f2af02c160a None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:14.067934 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 323/627] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 18 10:50:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:14.067934 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf58111-94a0-4f64-8cd5-8f2af02c160a None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:14.126574 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3e17d4-8b18-40b0-a6f1-a931ed5a04d2 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:14.144859 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:14.169270 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf928d60-a8a1-408e-897f-c89e8a0d308a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:14.169962 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf928d60-a8a1-408e-897f-c89e8a0d308a None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:14.170241 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf928d60-a8a1-408e-897f-c89e8a0d308a None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:14.170516 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf928d60-a8a1-408e-897f-c89e8a0d308a None admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:14.171246 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf928d60-a8a1-408e-897f-c89e8a0d308a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:14.171553 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf928d60-a8a1-408e-897f-c89e8a0d308a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:14.172989 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf928d60-a8a1-408e-897f-c89e8a0d308a None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:14.183568 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf58111-94a0-4f64-8cd5-8f2af02c160a None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:14.191704 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 305/628] 10.222.0.15 () {56 vars in 1133 bytes} [Thu Aug 18 10:50:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:14.192436 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf928d60-a8a1-408e-897f-c89e8a0d308a None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:14.228782 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc9284-6132-4be4-ab05-4c28b65b1b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:14.229391 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc9284-6132-4be4-ab05-4c28b65b1b2b None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:14.230410 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc9284-6132-4be4-ab05-4c28b65b1b2b None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:14.230410 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc9284-6132-4be4-ab05-4c28b65b1b2b None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:14.230687 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acc9284-6132-4be4-ab05-4c28b65b1b2b None admin] RBAC: Adding query filter params (name=service) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:14.230926 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acc9284-6132-4be4-ab05-4c28b65b1b2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:14.232298 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acc9284-6132-4be4-ab05-4c28b65b1b2b None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:14.240982 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 324/629] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Aug 18 10:50:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:14.243718 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bdfaea-47c2-421e-98ef-e66c2da133b8 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:14.244002 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bdfaea-47c2-421e-98ef-e66c2da133b8 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:14.244278 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bdfaea-47c2-421e-98ef-e66c2da133b8 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:14.245683 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 325/630] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:50:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:50:14.250167 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bdfaea-47c2-421e-98ef-e66c2da133b8 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:14.277124 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:14.315543 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf928d60-a8a1-408e-897f-c89e8a0d308a None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:14.350830 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe61574c-2d76-4f1a-ae17-b5cbdbcc27e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:14.352116 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe61574c-2d76-4f1a-ae17-b5cbdbcc27e9 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:14.352394 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe61574c-2d76-4f1a-ae17-b5cbdbcc27e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:14.352668 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe61574c-2d76-4f1a-ae17-b5cbdbcc27e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:14.359409 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe61574c-2d76-4f1a-ae17-b5cbdbcc27e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:14.360828 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bdfaea-47c2-421e-98ef-e66c2da133b8 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:14.360945 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe61574c-2d76-4f1a-ae17-b5cbdbcc27e9 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:14.372936 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-fe61574c-2d76-4f1a-ae17-b5cbdbcc27e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 10:50:14.372936 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:14.372936 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:14.372936 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:14.372936 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:14.372936 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:14.372936 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:14.372936 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:14.372936 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:14.372936 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:14.372936 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:14.372936 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:14.372936 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 10:50:14.372936 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 10:50:14.372936 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 10:50:14.373916 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 10:50:14.373916 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:14.373916 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:14.373916 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:14.373916 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:14.373916 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:14.373916 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:14.373916 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:14.373916 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:14.373916 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:14.373916 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:14.373916 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:14.373916 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:14.373916 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:14.373916 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:14.373916 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:14.373916 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:14.374793 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 10:50:14.374793 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 10:50:14.374793 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 10:50:14.374793 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 10:50:14.374793 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 10:50:14.374793 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 10:50:14.374793 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 10:50:14.374793 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:14.374793 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 306/631] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 18 10:50:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:14.375289 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe61574c-2d76-4f1a-ae17-b5cbdbcc27e9 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:14.400365 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c5818-3cdd-470f-bb18-e8519cfc4411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:14.400903 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c5818-3cdd-470f-bb18-e8519cfc4411 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:14.401183 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c5818-3cdd-470f-bb18-e8519cfc4411 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:14.401458 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c5818-3cdd-470f-bb18-e8519cfc4411 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:14.407389 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:14.473533 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425c5818-3cdd-470f-bb18-e8519cfc4411 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:14.474976 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425c5818-3cdd-470f-bb18-e8519cfc4411 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:14.482931 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe61574c-2d76-4f1a-ae17-b5cbdbcc27e9 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:14.494712 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:14.521559 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b81d34-d7c8-41f2-a22b-8e9e38131032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:14.522456 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b81d34-d7c8-41f2-a22b-8e9e38131032 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:14.523019 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b81d34-d7c8-41f2-a22b-8e9e38131032 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:14.523832 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b81d34-d7c8-41f2-a22b-8e9e38131032 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:14.534663 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b81d34-d7c8-41f2-a22b-8e9e38131032 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:14.536182 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b81d34-d7c8-41f2-a22b-8e9e38131032 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:14.551083 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-36b81d34-d7c8-41f2-a22b-8e9e38131032 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:14.551083 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:14.551083 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:14.551083 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:14.551083 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:14.551083 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:14.551083 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:14.551083 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:14.551083 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:14.551083 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:14.551083 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:14.551083 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:14.551083 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 10:50:14.551083 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 10:50:14.551083 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 10:50:14.551083 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 10:50:14.552228 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:14.552228 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:14.552228 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:14.552228 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:14.552228 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:14.552228 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:14.552228 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:14.552228 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:14.552228 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:14.552228 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:14.552228 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:14.552228 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:14.552228 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:14.552228 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:14.552228 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:14.552228 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:14.552228 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 10:50:14.553231 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 10:50:14.553231 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:14.553231 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:14.557678 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 307/632] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:50:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:14.558706 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f61ac-755f-4336-bac2-a1f1545de3d7 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:14.558991 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f61ac-755f-4336-bac2-a1f1545de3d7 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:14.559266 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f61ac-755f-4336-bac2-a1f1545de3d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:14.577305 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-790f61ac-755f-4336-bac2-a1f1545de3d7 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:50:14.578562 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-790f61ac-755f-4336-bac2-a1f1545de3d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:50:14.579603 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 326/633] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 18 10:50:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 10:50:14.580864 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c8cfb1-6d63-43a9-98a0-1e035d637722 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:14.581149 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c8cfb1-6d63-43a9-98a0-1e035d637722 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:14.582040 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c8cfb1-6d63-43a9-98a0-1e035d637722 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:14.585478 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 327/634] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:50:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:50:14.585478 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c8cfb1-6d63-43a9-98a0-1e035d637722 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:14.653332 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 308/635] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:50:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 10:50:14.654218 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790f61ac-755f-4336-bac2-a1f1545de3d7 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:14.669209 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:14.698813 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c8cfb1-6d63-43a9-98a0-1e035d637722 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:14.720635 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:14.736641 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae6e4de-127c-4a98-a7b3-09e4cad9a98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:14.737253 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6e4de-127c-4a98-a7b3-09e4cad9a98a None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:14.737530 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6e4de-127c-4a98-a7b3-09e4cad9a98a None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:14.737823 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6e4de-127c-4a98-a7b3-09e4cad9a98a None admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:14.738514 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae6e4de-127c-4a98-a7b3-09e4cad9a98a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:14.738818 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae6e4de-127c-4a98-a7b3-09e4cad9a98a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:14.740235 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae6e4de-127c-4a98-a7b3-09e4cad9a98a None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:14.757793 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 328/636] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Aug 18 10:50:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:14.757793 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae6e4de-127c-4a98-a7b3-09e4cad9a98a None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:14.766588 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790f61ac-755f-4336-bac2-a1f1545de3d7 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:14.807044 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f91943a-33a5-4584-8666-1de8402e4fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:14.808105 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f91943a-33a5-4584-8666-1de8402e4fa7 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:14.808960 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f91943a-33a5-4584-8666-1de8402e4fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:14.809407 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f91943a-33a5-4584-8666-1de8402e4fa7 None admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:14.810447 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f91943a-33a5-4584-8666-1de8402e4fa7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:14.810754 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f91943a-33a5-4584-8666-1de8402e4fa7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:14.812141 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f91943a-33a5-4584-8666-1de8402e4fa7 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:14.824624 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 309/637] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 18 10:50:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:14.825922 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b26fe2d-1ee2-4abc-8033-558e0c4bca9f None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:14.826209 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b26fe2d-1ee2-4abc-8033-558e0c4bca9f None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:14.826484 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b26fe2d-1ee2-4abc-8033-558e0c4bca9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:14.845156 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-8b26fe2d-1ee2-4abc-8033-558e0c4bca9f None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:50:14.846443 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-8b26fe2d-1ee2-4abc-8033-558e0c4bca9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:50:14.871835 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae6e4de-127c-4a98-a7b3-09e4cad9a98a None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:14.910762 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc67f2-6602-4105-bfbb-963356b59630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:14.911315 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc67f2-6602-4105-bfbb-963356b59630 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:14.911597 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc67f2-6602-4105-bfbb-963356b59630 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:14.911881 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc67f2-6602-4105-bfbb-963356b59630 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:14.933548 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acc67f2-6602-4105-bfbb-963356b59630 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:14.933548 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acc67f2-6602-4105-bfbb-963356b59630 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:14.933819 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 310/638] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:50:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 10:50:14.933819 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b26fe2d-1ee2-4abc-8033-558e0c4bca9f None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:14.933819 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:14.949968 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-7acc67f2-6602-4105-bfbb-963356b59630 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:14.949968 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:14.949968 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:14.949968 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:14.949968 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:14.949968 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:14.949968 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:14.949968 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:14.949968 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:14.949968 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:14.949968 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:14.949968 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:14.949968 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 10:50:14.949968 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 10:50:14.949968 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 10:50:14.949968 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 10:50:14.951142 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:14.951142 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:14.951142 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:14.951142 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:14.951142 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:14.951142 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:14.951142 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:14.951142 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:14.951142 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:14.951142 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:14.951142 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:14.951142 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:14.951142 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:14.951142 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:14.951142 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:14.951142 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:14.951142 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 10:50:14.952086 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 10:50:14.952086 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:14.952086 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:14.952464 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 329/639] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:50:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:14.953328 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc67f2-6602-4105-bfbb-963356b59630 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:14.987123 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:15.039816 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b26fe2d-1ee2-4abc-8033-558e0c4bca9f None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:15.069185 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc67f2-6602-4105-bfbb-963356b59630 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:15.077270 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea82ca47-842f-4727-84e5-76a21e509c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:15.078587 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea82ca47-842f-4727-84e5-76a21e509c48 None admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:15.078870 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea82ca47-842f-4727-84e5-76a21e509c48 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:15.079143 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea82ca47-842f-4727-84e5-76a21e509c48 None admin] PATH_INFO: `/v3/projects/1575e8ebaaab4650995841659b6e631b/users/f97e906b1922419d8511ab1c8b9c86e4/roles/13bffd536e214d0893b3007e267f3301` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:15.095555 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea82ca47-842f-4727-84e5-76a21e509c48 None admin] RBAC: Authorizing `identity:create_grant(project_id=1575e8ebaaab4650995841659b6e631b, user_id=f97e906b1922419d8511ab1c8b9c86e4, role_id=13bffd536e214d0893b3007e267f3301)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:15.097241 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea82ca47-842f-4727-84e5-76a21e509c48 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:15.105753 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1c718e-5258-4ea4-8ed0-64e6c09a9d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:15.106577 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1c718e-5258-4ea4-8ed0-64e6c09a9d81 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:15.106703 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1c718e-5258-4ea4-8ed0-64e6c09a9d81 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:15.106930 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1c718e-5258-4ea4-8ed0-64e6c09a9d81 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:15.121545 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 311/640] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Aug 18 10:50:14 2022] PUT /identity/v3/projects/1575e8ebaaab4650995841659b6e631b/users/f97e906b1922419d8511ab1c8b9c86e4/roles/13bffd536e214d0893b3007e267f3301 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 10:50:15.121545 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea82ca47-842f-4727-84e5-76a21e509c48 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:15.121865 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1c718e-5258-4ea4-8ed0-64e6c09a9d81 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:15.121865 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1c718e-5258-4ea4-8ed0-64e6c09a9d81 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:15.136211 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-af1c718e-5258-4ea4-8ed0-64e6c09a9d81 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 18 10:50:15.136211 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:15.136211 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:15.136211 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:15.136211 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:15.136211 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:15.136211 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:15.136211 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:15.136211 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:15.136211 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:15.136211 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:15.136211 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:15.136211 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 10:50:15.136211 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 10:50:15.136211 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 10:50:15.136211 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 10:50:15.137441 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:15.137441 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:15.137441 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 10:50:15.137441 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 10:50:15.137441 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 10:50:15.137441 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 10:50:15.137441 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:15.137441 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:15.137441 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:15.137441 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:15.137441 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:15.137441 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:15.137441 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:15.137441 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:15.137441 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:15.137441 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:15.137441 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:15.137441 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:15.138608 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:15.138608 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:15.138608 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 10:50:15.138608 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 10:50:15.138608 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 10:50:15.138608 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 10:50:15.138608 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 10:50:15.138608 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 10:50:15.138608 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 18 10:50:15.138608 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:15.138608 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 330/641] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 18 10:50:14 2022] GET /identity/v3/users/glance => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:15.138608 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1c718e-5258-4ea4-8ed0-64e6c09a9d81 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:15.207879 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:15.260053 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:15.269753 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea82ca47-842f-4727-84e5-76a21e509c48 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:15.272321 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1c718e-5258-4ea4-8ed0-64e6c09a9d81 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:15.318615 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97f5291-27f0-4f67-8037-c4a552a8715a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:15.319241 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f5291-27f0-4f67-8037-c4a552a8715a None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:15.319505 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f5291-27f0-4f67-8037-c4a552a8715a None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:15.320356 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f5291-27f0-4f67-8037-c4a552a8715a None admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:15.321037 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97f5291-27f0-4f67-8037-c4a552a8715a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:15.321342 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97f5291-27f0-4f67-8037-c4a552a8715a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:15.322801 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97f5291-27f0-4f67-8037-c4a552a8715a None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:15.324495 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d16a160-e387-44d8-b4f1-78002b0a7682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:15.325695 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d16a160-e387-44d8-b4f1-78002b0a7682 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:15.326066 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d16a160-e387-44d8-b4f1-78002b0a7682 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:15.326514 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d16a160-e387-44d8-b4f1-78002b0a7682 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:15.339377 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 331/642] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 18 10:50:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:15.339377 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97f5291-27f0-4f67-8037-c4a552a8715a None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:15.343278 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d16a160-e387-44d8-b4f1-78002b0a7682 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:50:15.347969 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-1d16a160-e387-44d8-b4f1-78002b0a7682 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 10:50:15.347969 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:15.347969 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:15.347969 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:15.347969 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:15.347969 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:15.347969 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:15.347969 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:15.347969 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:15.347969 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:15.347969 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:15.347969 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:15.347969 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:50:15.347969 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:50:15.347969 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:50:15.347969 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:50:15.349164 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:50:15.349164 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:50:15.349164 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:50:15.349164 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:50:15.349164 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:15.349164 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:15.349164 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:15.349164 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:15.349164 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:15.349164 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:15.349164 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:15.349164 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:15.349164 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:15.349164 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:15.349164 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:15.349164 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:15.350247 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:15.350247 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:15.350247 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:15.350247 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:15.350247 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:50:15.350247 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:50:15.350247 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:50:15.350247 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:50:15.350247 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:50:15.350247 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:50:15.350247 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 10:50:15.350247 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:15.350247 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 312/643] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Aug 18 10:50:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:15.351194 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d16a160-e387-44d8-b4f1-78002b0a7682 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:15.456260 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97f5291-27f0-4f67-8037-c4a552a8715a None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:15.462615 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d16a160-e387-44d8-b4f1-78002b0a7682 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:15.476241 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:15.493075 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0391f977-a64a-4efa-93ee-d199a9c4f885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:15.493716 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0391f977-a64a-4efa-93ee-d199a9c4f885 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:15.493997 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0391f977-a64a-4efa-93ee-d199a9c4f885 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:15.494300 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0391f977-a64a-4efa-93ee-d199a9c4f885 None admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:15.495006 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0391f977-a64a-4efa-93ee-d199a9c4f885 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:15.495311 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0391f977-a64a-4efa-93ee-d199a9c4f885 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:15.496996 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0391f977-a64a-4efa-93ee-d199a9c4f885 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:15.501856 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d660dc5b-dccf-47d3-8518-357bbeb49a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:15.502742 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d660dc5b-dccf-47d3-8518-357bbeb49a36 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:15.503229 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d660dc5b-dccf-47d3-8518-357bbeb49a36 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:15.503722 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d660dc5b-dccf-47d3-8518-357bbeb49a36 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:15.515678 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 332/644] 10.222.0.15 () {56 vars in 1137 bytes} [Thu Aug 18 10:50:15 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:15.516169 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d660dc5b-dccf-47d3-8518-357bbeb49a36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:50:15.516521 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0391f977-a64a-4efa-93ee-d199a9c4f885 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:15.521914 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-d660dc5b-dccf-47d3-8518-357bbeb49a36 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 10:50:15.521914 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:15.521914 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:15.521914 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:15.521914 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:15.521914 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:15.521914 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:15.521914 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:15.521914 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:15.521914 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:15.521914 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:15.521914 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:15.521914 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:50:15.521914 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:50:15.521914 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:50:15.521914 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:50:15.523891 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:50:15.523891 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:50:15.523891 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:50:15.523891 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:50:15.523891 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:15.523891 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:15.523891 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:15.523891 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:15.523891 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:15.523891 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:15.523891 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:15.523891 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:15.523891 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:15.523891 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:15.523891 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:15.523891 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:15.524867 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:15.524867 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:15.524867 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:15.524867 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:15.524867 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:50:15.524867 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:50:15.524867 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:50:15.524867 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:50:15.524867 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:50:15.524867 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:50:15.524867 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 10:50:15.524867 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:15.531483 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 313/645] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Aug 18 10:50:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:15.532781 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d660dc5b-dccf-47d3-8518-357bbeb49a36 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:15.533339 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:15.646181 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0391f977-a64a-4efa-93ee-d199a9c4f885 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:15.653511 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d660dc5b-dccf-47d3-8518-357bbeb49a36 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:15.683775 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0895cd6e-a9e5-4ac6-aa63-41b733716fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:15.684413 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0895cd6e-a9e5-4ac6-aa63-41b733716fef None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:15.684688 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0895cd6e-a9e5-4ac6-aa63-41b733716fef None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:15.684960 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0895cd6e-a9e5-4ac6-aa63-41b733716fef None admin] PATH_INFO: `/v3/projects/service` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:15.691918 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a666d699-65ec-4332-a9c0-9a6cead170d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:15.692312 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0895cd6e-a9e5-4ac6-aa63-41b733716fef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:15.692887 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a666d699-65ec-4332-a9c0-9a6cead170d6 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:15.693337 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a666d699-65ec-4332-a9c0-9a6cead170d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:15.693767 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0895cd6e-a9e5-4ac6-aa63-41b733716fef None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:15.693961 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a666d699-65ec-4332-a9c0-9a6cead170d6 None admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:15.695532 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a666d699-65ec-4332-a9c0-9a6cead170d6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:15.695996 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a666d699-65ec-4332-a9c0-9a6cead170d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:15.697509 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a666d699-65ec-4332-a9c0-9a6cead170d6 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:15.707217 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-0895cd6e-a9e5-4ac6-aa63-41b733716fef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 10:50:15.707217 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:15.707217 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:15.707217 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:15.707217 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:15.707217 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:15.707217 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:15.707217 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:15.707217 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:15.707217 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:15.707217 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:15.707217 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:15.707217 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 10:50:15.707217 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 10:50:15.707217 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 10:50:15.708278 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 10:50:15.708278 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:15.708278 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:15.708278 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:15.708278 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:15.708278 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:15.708278 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:15.708278 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:15.708278 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:15.708278 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:15.708278 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:15.708278 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:15.708278 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:15.708278 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:15.708278 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:15.708278 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:15.708278 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:15.709308 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 10:50:15.709308 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 10:50:15.709308 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 10:50:15.709308 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 10:50:15.709308 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 10:50:15.709308 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 10:50:15.709308 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 10:50:15.709308 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:15.709830 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 314/646] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Aug 18 10:50:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:15.710954 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a666d699-65ec-4332-a9c0-9a6cead170d6 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:15.712977 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 333/647] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 18 10:50:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:15.713871 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0895cd6e-a9e5-4ac6-aa63-41b733716fef None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:15.747669 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:15.790347 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:15.823867 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0895cd6e-a9e5-4ac6-aa63-41b733716fef None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:15.824232 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a666d699-65ec-4332-a9c0-9a6cead170d6 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:15.863381 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b7ba3e-a303-4b5c-944c-408573c7e32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:15.863796 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3de0fe-b7bc-469e-b103-582c86ad6157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:15.863995 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b7ba3e-a303-4b5c-944c-408573c7e32f None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:15.864272 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b7ba3e-a303-4b5c-944c-408573c7e32f None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:15.864394 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3de0fe-b7bc-469e-b103-582c86ad6157 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:15.864555 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b7ba3e-a303-4b5c-944c-408573c7e32f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:15.864661 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3de0fe-b7bc-469e-b103-582c86ad6157 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:15.864908 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3de0fe-b7bc-469e-b103-582c86ad6157 None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:15.865583 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3de0fe-b7bc-469e-b103-582c86ad6157 None admin] RBAC: Adding query filter params (name=service) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:15.865882 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3de0fe-b7bc-469e-b103-582c86ad6157 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:15.867747 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3de0fe-b7bc-469e-b103-582c86ad6157 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:15.876969 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 334/648] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Aug 18 10:50:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:15.878114 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3de0fe-b7bc-469e-b103-582c86ad6157 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:15.943944 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b7ba3e-a303-4b5c-944c-408573c7e32f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:15.945446 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b7ba3e-a303-4b5c-944c-408573c7e32f None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:15.980854 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:15.984979 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3de0fe-b7bc-469e-b103-582c86ad6157 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:16.021704 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:16.030010 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a2272-3cb9-4306-b2a2-8596af784468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:16.030644 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a2272-3cb9-4306-b2a2-8596af784468 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:16.030921 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a2272-3cb9-4306-b2a2-8596af784468 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:16.031191 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a2272-3cb9-4306-b2a2-8596af784468 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:16.043614 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290a2272-3cb9-4306-b2a2-8596af784468 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:16.045068 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290a2272-3cb9-4306-b2a2-8596af784468 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:16.062908 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-290a2272-3cb9-4306-b2a2-8596af784468 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:16.062908 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:16.062908 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:16.062908 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:16.062908 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:16.062908 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:16.062908 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:16.062908 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:16.062908 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:16.062908 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:16.062908 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:16.062908 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:16.062908 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 10:50:16.062908 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 10:50:16.062908 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 10:50:16.062908 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 10:50:16.064399 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:16.064399 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:16.064399 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:16.064399 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:16.064399 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:16.064399 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:16.064399 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:16.064399 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:16.064399 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:16.064399 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:16.064399 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:16.064399 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:16.064399 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:16.064399 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:16.064399 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:16.064399 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:16.064399 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 10:50:16.065359 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 10:50:16.065359 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:16.065359 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:16.065596 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 315/649] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 18 10:50:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 10:50:16.065596 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b7ba3e-a303-4b5c-944c-408573c7e32f None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:16.066419 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 335/650] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:50:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:16.067045 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a2272-3cb9-4306-b2a2-8596af784468 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:16.174582 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b7ba3e-a303-4b5c-944c-408573c7e32f None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:16.183096 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a2272-3cb9-4306-b2a2-8596af784468 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:16.219890 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb5eec7-1ed9-4c03-b69e-ae28f0d4f919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:16.220520 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5eec7-1ed9-4c03-b69e-ae28f0d4f919 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:16.220796 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5eec7-1ed9-4c03-b69e-ae28f0d4f919 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:16.221069 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5eec7-1ed9-4c03-b69e-ae28f0d4f919 None admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:16.221868 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb5eec7-1ed9-4c03-b69e-ae28f0d4f919 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:16.222174 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb5eec7-1ed9-4c03-b69e-ae28f0d4f919 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:16.223618 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb5eec7-1ed9-4c03-b69e-ae28f0d4f919 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:16.224470 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1170696d-7cd7-4fc0-8e10-597068839087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:16.225250 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170696d-7cd7-4fc0-8e10-597068839087 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:16.225471 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170696d-7cd7-4fc0-8e10-597068839087 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:16.225791 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170696d-7cd7-4fc0-8e10-597068839087 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:16.226602 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:16.238520 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1170696d-7cd7-4fc0-8e10-597068839087 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:16.239693 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 316/651] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Aug 18 10:50:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:16.240130 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1170696d-7cd7-4fc0-8e10-597068839087 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:16.243263 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb5eec7-1ed9-4c03-b69e-ae28f0d4f919 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:16.256216 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-1170696d-7cd7-4fc0-8e10-597068839087 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:16.256216 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:16.256216 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:16.256216 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:16.256216 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:16.256216 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:16.256216 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:16.256216 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:16.256216 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:16.256216 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:16.256216 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:16.256216 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:16.256216 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 10:50:16.256216 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 10:50:16.256216 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 10:50:16.256216 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 10:50:16.257191 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:16.257191 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:16.257191 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:16.257191 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:16.257191 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:16.257191 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:16.257191 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:16.257191 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:16.257191 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:16.257191 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:16.257191 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:16.257191 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:16.257191 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:16.257191 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:16.257191 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:16.257191 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:16.257191 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 10:50:16.258233 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 10:50:16.258233 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:16.258233 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:16.262343 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 336/652] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:50:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:16.263025 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1170696d-7cd7-4fc0-8e10-597068839087 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:16.302471 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:16.359632 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb5eec7-1ed9-4c03-b69e-ae28f0d4f919 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:16.373138 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1170696d-7cd7-4fc0-8e10-597068839087 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:16.396318 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be73435-9434-4f61-89f3-9ef3a280c522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:16.397268 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be73435-9434-4f61-89f3-9ef3a280c522 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:16.397581 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be73435-9434-4f61-89f3-9ef3a280c522 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:16.398630 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be73435-9434-4f61-89f3-9ef3a280c522 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:16.408089 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f73d1e-fc8d-4825-a705-09b297867ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:16.408696 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f73d1e-fc8d-4825-a705-09b297867ffa None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:16.408984 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f73d1e-fc8d-4825-a705-09b297867ffa None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:16.409257 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f73d1e-fc8d-4825-a705-09b297867ffa None admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:16.409929 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f73d1e-fc8d-4825-a705-09b297867ffa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:16.410233 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f73d1e-fc8d-4825-a705-09b297867ffa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:16.411594 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f73d1e-fc8d-4825-a705-09b297867ffa None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:16.411768 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be73435-9434-4f61-89f3-9ef3a280c522 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:16.413380 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be73435-9434-4f61-89f3-9ef3a280c522 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:16.424360 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 337/653] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 18 10:50:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:16.425183 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f73d1e-fc8d-4825-a705-09b297867ffa None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:16.434191 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-0be73435-9434-4f61-89f3-9ef3a280c522 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:16.434191 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:16.434191 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:16.434191 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:16.434191 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:16.434191 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:16.434191 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:16.434191 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:16.434191 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:16.434191 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:16.434191 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:16.434191 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:16.434191 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 10:50:16.434191 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 10:50:16.434191 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 10:50:16.434191 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 10:50:16.435320 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:16.435320 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:16.435320 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:16.435320 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:16.435320 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:16.435320 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:16.435320 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:16.435320 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:16.435320 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:16.435320 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:16.435320 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:16.435320 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:16.435320 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:16.435320 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:16.435320 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:16.435320 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:16.435320 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 10:50:16.436287 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 10:50:16.436287 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:16.436287 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:16.437702 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 317/654] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:50:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:16.438700 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be73435-9434-4f61-89f3-9ef3a280c522 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:16.491595 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:16.533090 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:16.541246 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f73d1e-fc8d-4825-a705-09b297867ffa None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:16.551470 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be73435-9434-4f61-89f3-9ef3a280c522 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:16.578489 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0664ba-80d4-43d7-b5f9-46e720c20600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:16.579100 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0664ba-80d4-43d7-b5f9-46e720c20600 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:16.579498 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0664ba-80d4-43d7-b5f9-46e720c20600 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:16.579704 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0664ba-80d4-43d7-b5f9-46e720c20600 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:16.580436 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0664ba-80d4-43d7-b5f9-46e720c20600 None admin] RBAC: Adding query filter params (role.id=13bffd536e214d0893b3007e267f3301, scope.project.id=1575e8ebaaab4650995841659b6e631b, user.id=a005d8f0c46d44c7b6f2201a54717b12) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:16.580896 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0664ba-80d4-43d7-b5f9-46e720c20600 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:16.582191 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0664ba-80d4-43d7-b5f9-46e720c20600 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:16.597552 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 338/655] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Aug 18 10:50:16 2022] GET /identity/v3/role_assignments?user.id=a005d8f0c46d44c7b6f2201a54717b12&scope.project.id=1575e8ebaaab4650995841659b6e631b&role.id=13bffd536e214d0893b3007e267f3301 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:16.597786 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294fa47b-5c39-45a4-8183-ff41ae25a12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:16.597920 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0664ba-80d4-43d7-b5f9-46e720c20600 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:16.598019 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294fa47b-5c39-45a4-8183-ff41ae25a12a None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:16.598019 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294fa47b-5c39-45a4-8183-ff41ae25a12a None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:16.598019 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294fa47b-5c39-45a4-8183-ff41ae25a12a None admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:16.598019 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294fa47b-5c39-45a4-8183-ff41ae25a12a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:16.598019 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294fa47b-5c39-45a4-8183-ff41ae25a12a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:16.598019 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294fa47b-5c39-45a4-8183-ff41ae25a12a None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:16.615880 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 318/656] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 18 10:50:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:16.617536 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294fa47b-5c39-45a4-8183-ff41ae25a12a None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:16.728385 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0664ba-80d4-43d7-b5f9-46e720c20600 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:16.769355 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294fa47b-5c39-45a4-8183-ff41ae25a12a None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:16.777735 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b08e9f8-678e-4fe9-96f4-a67a0899759d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:16.778900 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b08e9f8-678e-4fe9-96f4-a67a0899759d None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:16.779181 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b08e9f8-678e-4fe9-96f4-a67a0899759d None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:16.779454 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b08e9f8-678e-4fe9-96f4-a67a0899759d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:16.780338 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:16.791346 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b08e9f8-678e-4fe9-96f4-a67a0899759d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:16.792820 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b08e9f8-678e-4fe9-96f4-a67a0899759d None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:16.805971 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-4b08e9f8-678e-4fe9-96f4-a67a0899759d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 10:50:16.805971 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:16.805971 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:16.805971 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:16.805971 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:16.805971 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:16.805971 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:16.805971 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:16.805971 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:16.805971 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:16.805971 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:16.805971 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:16.805971 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 10:50:16.805971 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 10:50:16.805971 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 10:50:16.805971 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 10:50:16.806956 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:16.806956 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:16.806956 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 10:50:16.806956 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 10:50:16.806956 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 10:50:16.806956 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 10:50:16.806956 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:16.806956 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:16.806956 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:16.806956 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:16.806956 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:16.806956 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:16.806956 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:16.806956 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:16.806956 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:16.806956 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:16.806956 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:16.806956 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:16.808855 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:16.808855 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:16.808855 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 10:50:16.808855 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 10:50:16.808855 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 10:50:16.808855 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 10:50:16.808855 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 10:50:16.808855 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 10:50:16.808855 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 10:50:16.808855 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:16.808855 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 339/657] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 18 10:50:16 2022] GET /identity/v3/users/cinder => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:16.808855 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b08e9f8-678e-4fe9-96f4-a67a0899759d None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:16.817452 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b3e512-5496-4fb3-98de-8392334920a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:16.818107 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b3e512-5496-4fb3-98de-8392334920a2 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:16.818388 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b3e512-5496-4fb3-98de-8392334920a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:16.818660 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b3e512-5496-4fb3-98de-8392334920a2 None admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:16.819311 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b3e512-5496-4fb3-98de-8392334920a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:16.819614 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b3e512-5496-4fb3-98de-8392334920a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:16.822021 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b3e512-5496-4fb3-98de-8392334920a2 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:16.835158 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 319/658] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 18 10:50:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:16.837330 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:16.839565 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b3e512-5496-4fb3-98de-8392334920a2 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:16.945443 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b08e9f8-678e-4fe9-96f4-a67a0899759d None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:16.971703 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b3e512-5496-4fb3-98de-8392334920a2 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:16.987851 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66b815e-71a5-49ad-a560-3db8101f71ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:16.988786 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66b815e-71a5-49ad-a560-3db8101f71ff None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:16.989066 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66b815e-71a5-49ad-a560-3db8101f71ff None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:16.989364 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66b815e-71a5-49ad-a560-3db8101f71ff None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:17.000480 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66b815e-71a5-49ad-a560-3db8101f71ff None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:17.002493 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66b815e-71a5-49ad-a560-3db8101f71ff None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:17.017543 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-b66b815e-71a5-49ad-a560-3db8101f71ff None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 18 10:50:17.017543 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:17.017543 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:17.017543 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:17.017543 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:17.017543 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:17.017543 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:17.017543 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:17.017543 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:17.017543 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:17.017543 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:17.017543 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:17.017543 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 10:50:17.017543 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 10:50:17.017543 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 10:50:17.017543 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 10:50:17.018555 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:17.018555 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:17.018555 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 10:50:17.018555 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 10:50:17.018555 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 10:50:17.018555 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 10:50:17.018555 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:17.018555 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:17.018555 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:17.018555 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:17.018555 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:17.018555 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:17.018555 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:17.018555 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:17.018555 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:17.018555 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:17.018555 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:17.018555 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:17.019527 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:17.019527 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:17.019527 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 10:50:17.019527 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 10:50:17.019527 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 10:50:17.019527 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 10:50:17.019527 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 10:50:17.019527 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 10:50:17.019527 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 18 10:50:17.019527 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:17.019527 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 340/659] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Aug 18 10:50:16 2022] GET /identity/v3/users/neutron => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:17.020144 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66b815e-71a5-49ad-a560-3db8101f71ff None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:17.021699 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d41db-822b-40f6-a60b-76f4552667ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:17.022550 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d41db-822b-40f6-a60b-76f4552667ad None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:17.023831 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d41db-822b-40f6-a60b-76f4552667ad None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:17.024532 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d41db-822b-40f6-a60b-76f4552667ad None admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:17.025504 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253d41db-822b-40f6-a60b-76f4552667ad None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:17.026049 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253d41db-822b-40f6-a60b-76f4552667ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:17.027749 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253d41db-822b-40f6-a60b-76f4552667ad None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:17.048355 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 320/660] 10.222.0.15 () {56 vars in 1137 bytes} [Thu Aug 18 10:50:16 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:17.049543 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d41db-822b-40f6-a60b-76f4552667ad None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:17.084176 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:17.106510 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:17.127216 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66b815e-71a5-49ad-a560-3db8101f71ff None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:17.167375 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ad83a-544c-4f7e-bdaf-b2c4eb00adbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:17.168018 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ad83a-544c-4f7e-bdaf-b2c4eb00adbe None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:17.168302 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ad83a-544c-4f7e-bdaf-b2c4eb00adbe None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:17.168578 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ad83a-544c-4f7e-bdaf-b2c4eb00adbe None admin] PATH_INFO: `/v3/projects/service` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:17.173946 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d41db-822b-40f6-a60b-76f4552667ad None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:17.175805 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2ad83a-544c-4f7e-bdaf-b2c4eb00adbe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:17.177266 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2ad83a-544c-4f7e-bdaf-b2c4eb00adbe None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:17.193492 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-9c2ad83a-544c-4f7e-bdaf-b2c4eb00adbe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 10:50:17.193492 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:17.193492 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:17.193492 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:17.193492 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:17.193492 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:17.193492 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:17.193492 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:17.193492 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:17.193492 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:17.193492 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:17.193492 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:17.193492 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 10:50:17.193492 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 10:50:17.193492 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 10:50:17.194472 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 10:50:17.194472 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:17.194472 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:17.194472 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:17.194472 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:17.194472 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:17.194472 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:17.194472 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:17.194472 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:17.194472 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:17.194472 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:17.194472 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:17.194472 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:17.194472 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:17.194472 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:17.194472 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:17.194472 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:17.196883 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 10:50:17.196883 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 10:50:17.196883 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 10:50:17.196883 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 10:50:17.196883 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 10:50:17.196883 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 10:50:17.196883 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 10:50:17.196883 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:17.196883 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 341/661] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 18 10:50:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:17.196883 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ad83a-544c-4f7e-bdaf-b2c4eb00adbe None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:17.219896 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60581aaf-e85e-4f4a-9557-bcd1e25c6379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:17.220616 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60581aaf-e85e-4f4a-9557-bcd1e25c6379 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:17.220879 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60581aaf-e85e-4f4a-9557-bcd1e25c6379 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:17.221080 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60581aaf-e85e-4f4a-9557-bcd1e25c6379 None admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:17.221809 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60581aaf-e85e-4f4a-9557-bcd1e25c6379 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:17.222124 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60581aaf-e85e-4f4a-9557-bcd1e25c6379 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:17.223574 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60581aaf-e85e-4f4a-9557-bcd1e25c6379 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:17.250437 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 321/662] 10.222.0.15 () {56 vars in 1139 bytes} [Thu Aug 18 10:50:17 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:17.250437 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02169c2-2ca4-4028-9b29-cd0f9858fa01 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:17.250437 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02169c2-2ca4-4028-9b29-cd0f9858fa01 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:17.250437 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02169c2-2ca4-4028-9b29-cd0f9858fa01 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:17.250437 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 322/663] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:50:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:50:17.250437 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02169c2-2ca4-4028-9b29-cd0f9858fa01 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:17.323481 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ad83a-544c-4f7e-bdaf-b2c4eb00adbe None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:17.342947 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:17.357773 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4f4ca1-6ab8-431f-bcba-ede10d9c5259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:17.358381 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4f4ca1-6ab8-431f-bcba-ede10d9c5259 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:17.358657 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4f4ca1-6ab8-431f-bcba-ede10d9c5259 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:17.358927 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4f4ca1-6ab8-431f-bcba-ede10d9c5259 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:17.365807 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02169c2-2ca4-4028-9b29-cd0f9858fa01 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:17.371841 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:17.405871 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005beb72-a5c7-4a09-952f-b2c77a6ad045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:17.406269 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005beb72-a5c7-4a09-952f-b2c77a6ad045 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:17.406509 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005beb72-a5c7-4a09-952f-b2c77a6ad045 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:17.406786 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005beb72-a5c7-4a09-952f-b2c77a6ad045 None admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:17.407483 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005beb72-a5c7-4a09-952f-b2c77a6ad045 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:17.407792 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005beb72-a5c7-4a09-952f-b2c77a6ad045 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:17.409226 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005beb72-a5c7-4a09-952f-b2c77a6ad045 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:17.427157 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 323/664] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Aug 18 10:50:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:17.427157 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005beb72-a5c7-4a09-952f-b2c77a6ad045 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:17.439733 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4f4ca1-6ab8-431f-bcba-ede10d9c5259 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:17.441193 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4f4ca1-6ab8-431f-bcba-ede10d9c5259 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:17.540160 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005beb72-a5c7-4a09-952f-b2c77a6ad045 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:17.549053 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 342/665] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 18 10:50:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 10:50:17.550882 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac331c6-628e-4ea9-8d6f-9cbc87d534f8 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:17.551171 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac331c6-628e-4ea9-8d6f-9cbc87d534f8 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:17.551447 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac331c6-628e-4ea9-8d6f-9cbc87d534f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:17.573160 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-7ac331c6-628e-4ea9-8d6f-9cbc87d534f8 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:50:17.574460 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-7ac331c6-628e-4ea9-8d6f-9cbc87d534f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:50:17.580928 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7918e0fb-f83c-4bba-903c-3ee4bb5c3ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:17.581558 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7918e0fb-f83c-4bba-903c-3ee4bb5c3ec2 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:17.581846 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7918e0fb-f83c-4bba-903c-3ee4bb5c3ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:17.582121 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7918e0fb-f83c-4bba-903c-3ee4bb5c3ec2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:17.594858 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:17.613235 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:17.657558 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 343/666] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:50:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 10:50:17.657558 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac331c6-628e-4ea9-8d6f-9cbc87d534f8 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:17.662107 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7918e0fb-f83c-4bba-903c-3ee4bb5c3ec2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:17.664202 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7918e0fb-f83c-4bba-903c-3ee4bb5c3ec2 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:17.768322 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac331c6-628e-4ea9-8d6f-9cbc87d534f8 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:17.779109 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 324/667] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 18 10:50:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 10:50:17.782560 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7918e0fb-f83c-4bba-903c-3ee4bb5c3ec2 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:17.807427 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a776f665-bd2d-4502-ba9a-ff1f45d74a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:17.808408 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a776f665-bd2d-4502-ba9a-ff1f45d74a6f None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:17.808907 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a776f665-bd2d-4502-ba9a-ff1f45d74a6f None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:17.809398 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a776f665-bd2d-4502-ba9a-ff1f45d74a6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:17.810354 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a776f665-bd2d-4502-ba9a-ff1f45d74a6f None admin] RBAC: Adding query filter params (role.id=13bffd536e214d0893b3007e267f3301, scope.project.id=1575e8ebaaab4650995841659b6e631b, user.id=77211d2dcef242c4a7fe2198556d5efc) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:17.810884 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a776f665-bd2d-4502-ba9a-ff1f45d74a6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:17.812517 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a776f665-bd2d-4502-ba9a-ff1f45d74a6f None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:17.819056 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 344/668] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Aug 18 10:50:17 2022] GET /identity/v3/role_assignments?user.id=77211d2dcef242c4a7fe2198556d5efc&scope.project.id=1575e8ebaaab4650995841659b6e631b&role.id=13bffd536e214d0893b3007e267f3301 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:17.820188 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a776f665-bd2d-4502-ba9a-ff1f45d74a6f None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:17.847060 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:17.859486 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:17.934196 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7918e0fb-f83c-4bba-903c-3ee4bb5c3ec2 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:17.984410 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbca951-9bda-436a-b551-b63d38744702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:17.985087 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbca951-9bda-436a-b551-b63d38744702 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:17.985362 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbca951-9bda-436a-b551-b63d38744702 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:17.985669 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbca951-9bda-436a-b551-b63d38744702 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:17.990741 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a776f665-bd2d-4502-ba9a-ff1f45d74a6f None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:18.000793 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbca951-9bda-436a-b551-b63d38744702 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:18.002897 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbca951-9bda-436a-b551-b63d38744702 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:18.025082 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-3dbca951-9bda-436a-b551-b63d38744702 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:18.025082 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:18.025082 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:18.025082 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:18.025082 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:18.025082 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:18.025082 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:18.025082 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:18.025082 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:18.025082 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:18.025082 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:18.025082 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:18.025082 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 10:50:18.025082 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 10:50:18.025082 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 10:50:18.025082 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 10:50:18.026118 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:18.026118 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:18.026118 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:18.026118 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:18.026118 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:18.026118 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:18.026118 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:18.026118 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:18.026118 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:18.026118 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:18.026118 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:18.026118 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:18.026118 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:18.026118 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:18.026118 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:18.026118 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:18.026118 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 10:50:18.027027 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 10:50:18.027027 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:18.027027 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:18.027027 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 325/669] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:50:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:18.027254 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbca951-9bda-436a-b551-b63d38744702 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:18.040879 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6f5311-6961-4be4-87b9-45ecc10a2322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:18.041547 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6f5311-6961-4be4-87b9-45ecc10a2322 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:18.041834 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6f5311-6961-4be4-87b9-45ecc10a2322 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:18.042347 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6f5311-6961-4be4-87b9-45ecc10a2322 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:18.058520 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6f5311-6961-4be4-87b9-45ecc10a2322 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:18.059971 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6f5311-6961-4be4-87b9-45ecc10a2322 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:18.076019 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-3c6f5311-6961-4be4-87b9-45ecc10a2322 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:18.076019 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:18.076019 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:18.076019 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:18.076019 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:18.076019 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:18.076019 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:18.076019 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:18.076019 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:18.076019 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:18.076019 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:18.076019 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:18.076019 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 10:50:18.076019 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 10:50:18.076019 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 10:50:18.076019 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 10:50:18.076979 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:18.076979 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:18.076979 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:18.076979 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:18.076979 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:18.076979 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:18.076979 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:18.076979 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:18.076979 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:18.076979 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:18.076979 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:18.076979 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:18.076979 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:18.076979 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:18.076979 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:18.076979 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:18.076979 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 10:50:18.077876 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 10:50:18.077876 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:18.077876 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:18.077876 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 345/670] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:50:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:18.079020 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6f5311-6961-4be4-87b9-45ecc10a2322 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:18.153534 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:18.161856 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbca951-9bda-436a-b551-b63d38744702 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:18.203309 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:18.209196 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe2e794-4289-416b-b4be-1159a51d99b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:18.209960 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe2e794-4289-416b-b4be-1159a51d99b3 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:18.210336 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe2e794-4289-416b-b4be-1159a51d99b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:18.211224 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe2e794-4289-416b-b4be-1159a51d99b3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:18.217358 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6f5311-6961-4be4-87b9-45ecc10a2322 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:18.229743 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe2e794-4289-416b-b4be-1159a51d99b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:50:18.235133 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-cbe2e794-4289-416b-b4be-1159a51d99b3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 10:50:18.235133 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:18.235133 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:18.235133 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:18.235133 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:18.235133 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:18.235133 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:18.235133 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:18.235133 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:18.235133 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:18.235133 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:18.235133 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:18.235133 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:50:18.235133 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:50:18.235133 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:50:18.235133 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:50:18.236060 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:50:18.236060 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:50:18.236060 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:50:18.236060 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:50:18.236060 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:18.236060 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:18.236060 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:18.236060 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:18.236060 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:18.236060 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:18.236060 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:18.236060 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:18.236060 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:18.236060 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:18.236060 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:18.236060 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:18.236889 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:18.236889 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:18.236889 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:18.236889 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:18.236889 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:50:18.236889 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:50:18.236889 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:50:18.236889 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:50:18.236889 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:50:18.236889 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:50:18.236889 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 10:50:18.236889 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:18.241110 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 326/671] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Aug 18 10:50:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:18.242149 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe2e794-4289-416b-b4be-1159a51d99b3 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:18.263764 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db153a1-c40d-4722-a02d-358f7f9688c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:18.264762 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db153a1-c40d-4722-a02d-358f7f9688c1 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:18.265252 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db153a1-c40d-4722-a02d-358f7f9688c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:18.265764 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db153a1-c40d-4722-a02d-358f7f9688c1 None admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:18.267251 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db153a1-c40d-4722-a02d-358f7f9688c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:18.268017 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db153a1-c40d-4722-a02d-358f7f9688c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:18.270301 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db153a1-c40d-4722-a02d-358f7f9688c1 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:18.292603 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 346/672] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 18 10:50:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:18.293924 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db153a1-c40d-4722-a02d-358f7f9688c1 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:18.365211 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe2e794-4289-416b-b4be-1159a51d99b3 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:18.412251 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e26b6f-4474-4f88-b5c4-3f55075349a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:18.412812 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e26b6f-4474-4f88-b5c4-3f55075349a9 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:18.413245 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e26b6f-4474-4f88-b5c4-3f55075349a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:18.413869 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e26b6f-4474-4f88-b5c4-3f55075349a9 None admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:18.414994 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e26b6f-4474-4f88-b5c4-3f55075349a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:18.415304 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e26b6f-4474-4f88-b5c4-3f55075349a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:18.417253 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e26b6f-4474-4f88-b5c4-3f55075349a9 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:18.434161 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db153a1-c40d-4722-a02d-358f7f9688c1 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:18.434819 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 327/673] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 18 10:50:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:18.435935 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e26b6f-4474-4f88-b5c4-3f55075349a9 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:18.456812 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:18.485019 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149dd3c1-f2fd-4e25-9d3c-a61e87e82758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:18.485663 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149dd3c1-f2fd-4e25-9d3c-a61e87e82758 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:18.485944 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149dd3c1-f2fd-4e25-9d3c-a61e87e82758 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:18.486220 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149dd3c1-f2fd-4e25-9d3c-a61e87e82758 None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:18.486983 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149dd3c1-f2fd-4e25-9d3c-a61e87e82758 None admin] RBAC: Adding query filter params (name=service) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:18.487290 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149dd3c1-f2fd-4e25-9d3c-a61e87e82758 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:18.488755 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149dd3c1-f2fd-4e25-9d3c-a61e87e82758 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:18.501734 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 347/674] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Aug 18 10:50:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:18.502929 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149dd3c1-f2fd-4e25-9d3c-a61e87e82758 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:18.519864 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:18.572265 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e26b6f-4474-4f88-b5c4-3f55075349a9 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:18.610492 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fe65c5-e076-4898-94d8-eb296d4da6c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:18.611139 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe65c5-e076-4898-94d8-eb296d4da6c8 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:18.611423 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe65c5-e076-4898-94d8-eb296d4da6c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:18.611700 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe65c5-e076-4898-94d8-eb296d4da6c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:18.620220 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fe65c5-e076-4898-94d8-eb296d4da6c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:18.621842 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fe65c5-e076-4898-94d8-eb296d4da6c8 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:18.622492 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149dd3c1-f2fd-4e25-9d3c-a61e87e82758 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:18.635346 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-a7fe65c5-e076-4898-94d8-eb296d4da6c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 10:50:18.635346 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:18.635346 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:18.635346 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:18.635346 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:18.635346 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:18.635346 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:18.635346 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:18.635346 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:18.635346 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:18.635346 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:18.635346 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:18.635346 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 10:50:18.635346 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 10:50:18.635346 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 10:50:18.636306 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 10:50:18.636306 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:18.636306 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:18.636306 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:18.636306 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:18.636306 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:18.636306 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:18.636306 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:18.636306 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:18.636306 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:18.636306 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:18.636306 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:18.636306 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:18.636306 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:18.636306 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:18.636306 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:18.636306 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:18.637179 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 10:50:18.637179 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 10:50:18.637179 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 10:50:18.637179 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 10:50:18.637179 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 10:50:18.637179 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 10:50:18.637179 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 10:50:18.637179 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:18.637179 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 328/675] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 18 10:50:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:18.638144 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fe65c5-e076-4898-94d8-eb296d4da6c8 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:18.663106 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7b6704-bf78-4cb1-a008-19d0ccf5c261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:18.664232 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b6704-bf78-4cb1-a008-19d0ccf5c261 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:18.664728 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b6704-bf78-4cb1-a008-19d0ccf5c261 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:18.665208 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b6704-bf78-4cb1-a008-19d0ccf5c261 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:18.672698 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7b6704-bf78-4cb1-a008-19d0ccf5c261 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:18.674490 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7b6704-bf78-4cb1-a008-19d0ccf5c261 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:18.687085 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-cc7b6704-bf78-4cb1-a008-19d0ccf5c261 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 10:50:18.687085 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:18.687085 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:18.687085 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:18.687085 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:18.687085 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:18.687085 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:18.687085 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:18.687085 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:18.687085 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:18.687085 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:18.687085 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:18.687085 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 10:50:18.687085 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 10:50:18.687085 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 10:50:18.688026 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 10:50:18.688026 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:18.688026 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:18.688026 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:18.688026 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:18.688026 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:18.688026 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:18.688026 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:18.688026 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:18.688026 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:18.688026 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:18.688026 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:18.688026 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:18.688026 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:18.688026 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:18.688026 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:18.688026 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:18.688899 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 10:50:18.688899 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 10:50:18.688899 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 10:50:18.688899 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 10:50:18.688899 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 10:50:18.688899 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 10:50:18.688899 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 10:50:18.688899 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:18.691447 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 348/676] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 18 10:50:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:18.692471 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7b6704-bf78-4cb1-a008-19d0ccf5c261 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:18.727205 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:18.757120 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fe65c5-e076-4898-94d8-eb296d4da6c8 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:18.766612 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:18.797297 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fb197a-6b91-4749-87c2-2b63b90a738b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:18.797909 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb197a-6b91-4749-87c2-2b63b90a738b None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:18.798186 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb197a-6b91-4749-87c2-2b63b90a738b None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:18.798456 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb197a-6b91-4749-87c2-2b63b90a738b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:18.802813 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7b6704-bf78-4cb1-a008-19d0ccf5c261 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:18.810877 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fb197a-6b91-4749-87c2-2b63b90a738b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:18.812368 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fb197a-6b91-4749-87c2-2b63b90a738b None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:18.828113 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-e9fb197a-6b91-4749-87c2-2b63b90a738b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:18.828113 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:18.828113 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:18.828113 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:18.828113 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:18.828113 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:18.828113 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:18.828113 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:18.828113 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:18.828113 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:18.828113 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:18.828113 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:18.828113 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 10:50:18.828113 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 10:50:18.828113 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 10:50:18.828113 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 10:50:18.829214 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:18.829214 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:18.829214 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:18.829214 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:18.829214 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:18.829214 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:18.829214 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:18.829214 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:18.829214 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:18.829214 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:18.829214 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:18.829214 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:18.829214 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:18.829214 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:18.829214 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:18.829214 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:18.829214 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 10:50:18.830326 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 10:50:18.830326 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:18.830326 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:18.834081 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 329/677] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:50:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:18.834723 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fb197a-6b91-4749-87c2-2b63b90a738b None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:18.847231 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b869223d-7663-41e8-b6c5-4d08781d7ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:18.847851 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b869223d-7663-41e8-b6c5-4d08781d7ddd None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:18.848129 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b869223d-7663-41e8-b6c5-4d08781d7ddd None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:18.848403 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b869223d-7663-41e8-b6c5-4d08781d7ddd None admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:18.849095 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b869223d-7663-41e8-b6c5-4d08781d7ddd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:18.849452 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b869223d-7663-41e8-b6c5-4d08781d7ddd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:18.850867 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b869223d-7663-41e8-b6c5-4d08781d7ddd None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:18.863436 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 349/678] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Aug 18 10:50:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:18.864631 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bdcbc9-b8bb-4d07-9b93-8a342fa35d46 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:18.864915 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bdcbc9-b8bb-4d07-9b93-8a342fa35d46 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:18.865189 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bdcbc9-b8bb-4d07-9b93-8a342fa35d46 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:18.869648 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 350/679] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:50:18 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:50:18.869648 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bdcbc9-b8bb-4d07-9b93-8a342fa35d46 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:18.951710 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fb197a-6b91-4749-87c2-2b63b90a738b None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:18.978038 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:18.986112 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bdcbc9-b8bb-4d07-9b93-8a342fa35d46 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:18.987871 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd752ea-c4f2-473a-a4d1-2c73a58521ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:18.988498 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd752ea-c4f2-473a-a4d1-2c73a58521ba None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:18.988757 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd752ea-c4f2-473a-a4d1-2c73a58521ba None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:18.989024 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd752ea-c4f2-473a-a4d1-2c73a58521ba None admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:18.989746 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd752ea-c4f2-473a-a4d1-2c73a58521ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:18.990047 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd752ea-c4f2-473a-a4d1-2c73a58521ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:18.991463 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd752ea-c4f2-473a-a4d1-2c73a58521ba None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:19.009267 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 330/680] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Aug 18 10:50:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:19.009267 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd752ea-c4f2-473a-a4d1-2c73a58521ba None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:19.020220 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:19.030109 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05e2c8b-6bf1-4572-9584-9504799eddbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:19.031155 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e2c8b-6bf1-4572-9584-9504799eddbb None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:19.031429 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e2c8b-6bf1-4572-9584-9504799eddbb None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:19.031857 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e2c8b-6bf1-4572-9584-9504799eddbb None admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:19.032499 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05e2c8b-6bf1-4572-9584-9504799eddbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:19.032802 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05e2c8b-6bf1-4572-9584-9504799eddbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:19.034205 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05e2c8b-6bf1-4572-9584-9504799eddbb None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:19.046612 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 351/681] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 18 10:50:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:19.047656 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d004e0f9-a0f5-4ded-95be-075a6c033cb1 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:19.047940 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d004e0f9-a0f5-4ded-95be-075a6c033cb1 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:19.048213 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d004e0f9-a0f5-4ded-95be-075a6c033cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:19.066795 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-d004e0f9-a0f5-4ded-95be-075a6c033cb1 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:50:19.068074 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-d004e0f9-a0f5-4ded-95be-075a6c033cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:50:19.120107 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd752ea-c4f2-473a-a4d1-2c73a58521ba None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:19.141961 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 352/682] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:50:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 10:50:19.143177 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d004e0f9-a0f5-4ded-95be-075a6c033cb1 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:19.166552 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0bc5ed-2696-42d2-adf9-85fa01eb2630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:19.167163 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0bc5ed-2696-42d2-adf9-85fa01eb2630 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:19.167445 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0bc5ed-2696-42d2-adf9-85fa01eb2630 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:19.167719 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0bc5ed-2696-42d2-adf9-85fa01eb2630 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:19.168871 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0bc5ed-2696-42d2-adf9-85fa01eb2630 None admin] RBAC: Adding query filter params (role.id=13bffd536e214d0893b3007e267f3301, scope.project.id=1575e8ebaaab4650995841659b6e631b, user.id=5b8a09704b9b4ab2bffb813796ec6e77) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:19.169245 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0bc5ed-2696-42d2-adf9-85fa01eb2630 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:19.171443 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0bc5ed-2696-42d2-adf9-85fa01eb2630 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:19.186068 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 331/683] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Aug 18 10:50:19 2022] GET /identity/v3/role_assignments?user.id=5b8a09704b9b4ab2bffb813796ec6e77&scope.project.id=1575e8ebaaab4650995841659b6e631b&role.id=13bffd536e214d0893b3007e267f3301 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:19.187057 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0bc5ed-2696-42d2-adf9-85fa01eb2630 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:19.291367 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:19.312063 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d004e0f9-a0f5-4ded-95be-075a6c033cb1 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:19.333346 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:19.353308 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6b4a1e-ccda-423a-897c-fc9cd890c96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:19.354345 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b4a1e-ccda-423a-897c-fc9cd890c96e None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:19.354858 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b4a1e-ccda-423a-897c-fc9cd890c96e None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:19.355346 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b4a1e-ccda-423a-897c-fc9cd890c96e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:19.356321 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6b4a1e-ccda-423a-897c-fc9cd890c96e None admin] RBAC: Adding query filter params (role.id=13bffd536e214d0893b3007e267f3301, scope.project.id=1575e8ebaaab4650995841659b6e631b, user.id=86c2cd74178f443d9c2398ff8e00cccc) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:19.356971 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6b4a1e-ccda-423a-897c-fc9cd890c96e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:19.358682 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6b4a1e-ccda-423a-897c-fc9cd890c96e None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:19.369419 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 353/684] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Aug 18 10:50:19 2022] GET /identity/v3/role_assignments?user.id=86c2cd74178f443d9c2398ff8e00cccc&scope.project.id=1575e8ebaaab4650995841659b6e631b&role.id=13bffd536e214d0893b3007e267f3301 => generated 608 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:19.399908 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0bc5ed-2696-42d2-adf9-85fa01eb2630 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:19.433822 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6b4a1e-ccda-423a-897c-fc9cd890c96e None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:19.450879 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee6077f-a3e8-4338-8880-7d33a6082321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:19.451554 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6077f-a3e8-4338-8880-7d33a6082321 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:19.451832 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6077f-a3e8-4338-8880-7d33a6082321 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:19.452103 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6077f-a3e8-4338-8880-7d33a6082321 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:19.464436 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee6077f-a3e8-4338-8880-7d33a6082321 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:19.465929 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee6077f-a3e8-4338-8880-7d33a6082321 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:19.488322 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-6ee6077f-a3e8-4338-8880-7d33a6082321 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 18 10:50:19.488322 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:19.488322 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:19.488322 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:19.488322 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:19.488322 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:19.488322 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:19.488322 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:19.488322 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:19.488322 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:19.488322 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:19.488322 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:19.488322 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 10:50:19.488322 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 10:50:19.488322 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 10:50:19.488322 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 10:50:19.489339 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:19.489339 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:19.489339 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 10:50:19.489339 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 10:50:19.489339 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 10:50:19.489339 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 10:50:19.489339 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:19.489339 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:19.489339 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:19.489339 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:19.489339 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:19.489339 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:19.489339 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:19.489339 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:19.489339 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:19.489339 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:19.489339 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:19.489339 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:19.490306 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:19.490306 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:19.490306 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 10:50:19.490306 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 10:50:19.490306 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 10:50:19.490306 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 10:50:19.490306 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 10:50:19.490306 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 10:50:19.490306 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 18 10:50:19.490306 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:19.495409 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 332/685] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Aug 18 10:50:19 2022] GET /identity/v3/users/swift => generated 83 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:19.503439 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee6077f-a3e8-4338-8880-7d33a6082321 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:19.598534 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6b4a1e-ccda-423a-897c-fc9cd890c96e None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:19.643618 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1ecbc6-f407-47cb-9654-39b81e49eb20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:19.644270 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ecbc6-f407-47cb-9654-39b81e49eb20 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:19.644555 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ecbc6-f407-47cb-9654-39b81e49eb20 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:19.644860 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ecbc6-f407-47cb-9654-39b81e49eb20 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:19.652380 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee6077f-a3e8-4338-8880-7d33a6082321 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:19.662520 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1ecbc6-f407-47cb-9654-39b81e49eb20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:50:19.665545 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:19.672896 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-8b1ecbc6-f407-47cb-9654-39b81e49eb20 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 10:50:19.672896 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:19.672896 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:19.672896 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:19.672896 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:19.672896 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:19.672896 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:19.672896 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:19.672896 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:19.672896 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:19.672896 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:19.672896 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:19.672896 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:50:19.672896 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:50:19.672896 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:50:19.672896 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:50:19.674033 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:50:19.674033 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:50:19.674033 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:50:19.674033 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:50:19.674033 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:19.674033 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:19.674033 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:19.674033 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:19.674033 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:19.674033 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:19.674033 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:19.674033 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:19.674033 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:19.674033 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:19.674033 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:19.674033 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:19.674902 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:19.674902 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:19.674902 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:19.674902 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:19.674902 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:50:19.674902 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:50:19.674902 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:50:19.674902 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:50:19.674902 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:50:19.674902 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:50:19.674902 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 10:50:19.674902 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:19.674902 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 354/686] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Aug 18 10:50:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 10:50:19.680521 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1ecbc6-f407-47cb-9654-39b81e49eb20 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:19.711996 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64474357-70ff-4ed9-8606-77a06dff872a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:19.712887 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64474357-70ff-4ed9-8606-77a06dff872a None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:19.713270 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64474357-70ff-4ed9-8606-77a06dff872a None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:19.713696 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64474357-70ff-4ed9-8606-77a06dff872a None admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:19.716873 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64474357-70ff-4ed9-8606-77a06dff872a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:19.717241 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64474357-70ff-4ed9-8606-77a06dff872a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:19.718903 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64474357-70ff-4ed9-8606-77a06dff872a None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:19.763097 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 333/687] 10.222.0.15 () {56 vars in 1135 bytes} [Thu Aug 18 10:50:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 10:50:19.768001 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:19.769362 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64474357-70ff-4ed9-8606-77a06dff872a None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:19.864105 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1ecbc6-f407-47cb-9654-39b81e49eb20 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:19.907875 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c6ad8d-e8a6-46ec-afda-94caedd21031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:19.908579 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c6ad8d-e8a6-46ec-afda-94caedd21031 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:19.908931 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c6ad8d-e8a6-46ec-afda-94caedd21031 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:19.909274 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c6ad8d-e8a6-46ec-afda-94caedd21031 None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:19.910050 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c6ad8d-e8a6-46ec-afda-94caedd21031 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:19.910864 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c6ad8d-e8a6-46ec-afda-94caedd21031 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:19.912314 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c6ad8d-e8a6-46ec-afda-94caedd21031 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:19.924395 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 355/688] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 18 10:50:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:19.931915 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c6ad8d-e8a6-46ec-afda-94caedd21031 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:20.012719 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64474357-70ff-4ed9-8606-77a06dff872a None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:20.071903 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93094c6-a04c-4c2e-a7cc-c3a87ae91402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:20.072671 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93094c6-a04c-4c2e-a7cc-c3a87ae91402 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:20.072955 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93094c6-a04c-4c2e-a7cc-c3a87ae91402 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:20.073227 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93094c6-a04c-4c2e-a7cc-c3a87ae91402 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:20.081641 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c6ad8d-e8a6-46ec-afda-94caedd21031 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:20.084236 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:20.127057 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:20.128149 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b78d50f-645d-42d3-9f86-3fdbd2fda413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:20.128930 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b78d50f-645d-42d3-9f86-3fdbd2fda413 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:20.129300 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b78d50f-645d-42d3-9f86-3fdbd2fda413 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:20.130724 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b78d50f-645d-42d3-9f86-3fdbd2fda413 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:20.156286 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b78d50f-645d-42d3-9f86-3fdbd2fda413 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:20.158107 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b78d50f-645d-42d3-9f86-3fdbd2fda413 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:20.190724 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-3b78d50f-645d-42d3-9f86-3fdbd2fda413 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:20.190724 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:20.190724 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:20.190724 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:20.190724 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:20.190724 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:20.190724 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:20.190724 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:20.190724 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:20.190724 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:20.190724 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:20.190724 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:20.190724 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 10:50:20.190724 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 10:50:20.190724 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 10:50:20.190724 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 10:50:20.191992 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:20.191992 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:20.191992 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:20.191992 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:20.191992 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:20.191992 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:20.191992 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:20.191992 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:20.191992 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:20.191992 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:20.191992 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:20.191992 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:20.191992 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:20.191992 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:20.191992 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:20.191992 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:20.191992 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 10:50:20.193104 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 10:50:20.193104 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:20.193104 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:20.199559 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 356/689] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:50:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:20.201924 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93094c6-a04c-4c2e-a7cc-c3a87ae91402 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:20.203515 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93094c6-a04c-4c2e-a7cc-c3a87ae91402 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:20.206714 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b78d50f-645d-42d3-9f86-3fdbd2fda413 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:20.345684 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 334/690] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 18 10:50:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 573 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 10:50:20.345684 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4beab5-6390-484b-8409-acbfb98b569d None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:20.345684 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4beab5-6390-484b-8409-acbfb98b569d None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:20.345684 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4beab5-6390-484b-8409-acbfb98b569d None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:20.345684 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 335/691] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:50:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:50:20.348284 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4beab5-6390-484b-8409-acbfb98b569d None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:20.354866 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b78d50f-645d-42d3-9f86-3fdbd2fda413 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:20.402520 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822be92a-31a7-425b-918a-9eae72a8dfef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:20.403144 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822be92a-31a7-425b-918a-9eae72a8dfef None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:20.403431 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822be92a-31a7-425b-918a-9eae72a8dfef None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:20.403712 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822be92a-31a7-425b-918a-9eae72a8dfef None admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:20.404366 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822be92a-31a7-425b-918a-9eae72a8dfef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:20.405075 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822be92a-31a7-425b-918a-9eae72a8dfef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:20.406786 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822be92a-31a7-425b-918a-9eae72a8dfef None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:20.424415 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 357/692] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 18 10:50:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 10:50:20.426267 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99bfbb3-4fb9-443c-a900-e9ba6a4675bb None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:20.426548 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99bfbb3-4fb9-443c-a900-e9ba6a4675bb None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:20.426826 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99bfbb3-4fb9-443c-a900-e9ba6a4675bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:20.435440 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:20.454389 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-c99bfbb3-4fb9-443c-a900-e9ba6a4675bb None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:50:20.456332 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-c99bfbb3-4fb9-443c-a900-e9ba6a4675bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:50:20.472319 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:20.478813 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4beab5-6390-484b-8409-acbfb98b569d None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:20.525913 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0651aacc-33e4-41ed-a5e3-88d70e244bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:20.526934 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0651aacc-33e4-41ed-a5e3-88d70e244bb5 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:20.527447 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0651aacc-33e4-41ed-a5e3-88d70e244bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:20.527982 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0651aacc-33e4-41ed-a5e3-88d70e244bb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:20.540231 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0651aacc-33e4-41ed-a5e3-88d70e244bb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:20.542092 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0651aacc-33e4-41ed-a5e3-88d70e244bb5 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:20.553856 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 358/693] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:50:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 10:50:20.555474 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99bfbb3-4fb9-443c-a900-e9ba6a4675bb None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:20.560320 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-0651aacc-33e4-41ed-a5e3-88d70e244bb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:20.560320 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:20.560320 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:20.560320 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:20.560320 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:20.560320 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:20.560320 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:20.560320 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:20.560320 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:20.560320 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:20.560320 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:20.560320 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:20.560320 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 10:50:20.560320 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 10:50:20.560320 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 10:50:20.560320 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 10:50:20.561289 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:20.561289 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:20.561289 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:20.561289 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:20.561289 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:20.561289 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:20.561289 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:20.561289 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:20.561289 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:20.561289 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:20.561289 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:20.561289 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:20.561289 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:20.561289 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:20.561289 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:20.561289 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:20.561289 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 10:50:20.562229 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 10:50:20.562229 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:20.562229 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:20.564356 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 336/694] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:50:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:20.574679 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0651aacc-33e4-41ed-a5e3-88d70e244bb5 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:20.683958 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99bfbb3-4fb9-443c-a900-e9ba6a4675bb None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:20.747494 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0651aacc-33e4-41ed-a5e3-88d70e244bb5 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:20.749986 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896650f6-e689-4524-904a-90ff1b852e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:20.750625 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896650f6-e689-4524-904a-90ff1b852e35 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:20.750900 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896650f6-e689-4524-904a-90ff1b852e35 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:20.751172 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896650f6-e689-4524-904a-90ff1b852e35 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:20.765855 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896650f6-e689-4524-904a-90ff1b852e35 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:20.767313 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896650f6-e689-4524-904a-90ff1b852e35 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:20.785637 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-896650f6-e689-4524-904a-90ff1b852e35 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 10:50:20.785637 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:20.785637 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:20.785637 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:20.785637 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:20.785637 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:20.785637 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:20.785637 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:20.785637 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:20.785637 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:20.785637 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:20.785637 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:20.785637 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 10:50:20.785637 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 10:50:20.785637 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 10:50:20.785637 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 10:50:20.786663 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:20.786663 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:20.786663 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 10:50:20.786663 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 10:50:20.786663 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 10:50:20.786663 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 10:50:20.786663 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:20.786663 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:20.786663 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:20.786663 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:20.786663 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:20.786663 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:20.786663 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:20.786663 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:20.786663 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:20.786663 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:20.786663 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:20.786663 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:20.788030 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:20.788030 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:20.788030 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 10:50:20.788030 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 10:50:20.788030 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 10:50:20.788030 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 10:50:20.788030 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 10:50:20.788030 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 10:50:20.788030 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 10:50:20.788030 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:20.788030 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 359/695] 10.222.0.15 () {56 vars in 1093 bytes} [Thu Aug 18 10:50:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:20.793482 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896650f6-e689-4524-904a-90ff1b852e35 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:20.801915 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:20.808960 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:20.819307 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfad2772-3499-4f37-9fcb-06f508c7359b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:20.820028 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad2772-3499-4f37-9fcb-06f508c7359b None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:20.820311 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad2772-3499-4f37-9fcb-06f508c7359b None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:20.820783 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad2772-3499-4f37-9fcb-06f508c7359b None admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:20.821441 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfad2772-3499-4f37-9fcb-06f508c7359b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:20.821776 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfad2772-3499-4f37-9fcb-06f508c7359b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:20.823450 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfad2772-3499-4f37-9fcb-06f508c7359b None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:20.838777 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 337/696] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 18 10:50:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:20.844597 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfad2772-3499-4f37-9fcb-06f508c7359b None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:20.953058 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896650f6-e689-4524-904a-90ff1b852e35 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:20.968446 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfad2772-3499-4f37-9fcb-06f508c7359b None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:20.989587 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7412086f-b849-4011-a2fc-89351805e246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:20.990294 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7412086f-b849-4011-a2fc-89351805e246 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:20.990595 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7412086f-b849-4011-a2fc-89351805e246 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:20.990874 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7412086f-b849-4011-a2fc-89351805e246 None admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:20.992265 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7412086f-b849-4011-a2fc-89351805e246 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:20.992616 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7412086f-b849-4011-a2fc-89351805e246 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:20.994343 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7412086f-b849-4011-a2fc-89351805e246 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:21.012439 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96476495-6119-47a3-b65d-187c053e7a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:21.013434 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96476495-6119-47a3-b65d-187c053e7a56 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:21.014256 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 360/697] 10.222.0.15 () {56 vars in 1133 bytes} [Thu Aug 18 10:50:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 10:50:21.014654 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96476495-6119-47a3-b65d-187c053e7a56 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:21.015121 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7412086f-b849-4011-a2fc-89351805e246 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:21.015434 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96476495-6119-47a3-b65d-187c053e7a56 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:21.024356 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96476495-6119-47a3-b65d-187c053e7a56 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:21.026155 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96476495-6119-47a3-b65d-187c053e7a56 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:21.038739 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-96476495-6119-47a3-b65d-187c053e7a56 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 10:50:21.038739 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:21.038739 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:21.038739 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:21.038739 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:21.038739 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:21.038739 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:21.038739 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:21.038739 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:21.038739 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:21.038739 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:21.038739 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:21.038739 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 10:50:21.038739 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 10:50:21.038739 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 10:50:21.039645 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 10:50:21.039645 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:21.039645 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:21.039645 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:21.039645 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:21.039645 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:21.039645 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:21.039645 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:21.039645 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:21.039645 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:21.039645 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:21.039645 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:21.039645 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:21.039645 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:21.039645 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:21.039645 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:21.039645 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:21.040555 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 10:50:21.040555 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 10:50:21.040555 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 10:50:21.040555 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 10:50:21.040555 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 10:50:21.040555 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 10:50:21.040555 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 10:50:21.040555 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:21.047508 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 338/698] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 18 10:50:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:21.048770 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96476495-6119-47a3-b65d-187c053e7a56 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:21.084677 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:21.098959 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:21.130136 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7412086f-b849-4011-a2fc-89351805e246 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:21.165246 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96476495-6119-47a3-b65d-187c053e7a56 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:21.170173 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a191bf03-e962-435e-95ee-a9a06334f8cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:21.171107 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a191bf03-e962-435e-95ee-a9a06334f8cf None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:21.171539 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a191bf03-e962-435e-95ee-a9a06334f8cf None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:21.171961 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a191bf03-e962-435e-95ee-a9a06334f8cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:21.184439 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a191bf03-e962-435e-95ee-a9a06334f8cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:21.186417 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a191bf03-e962-435e-95ee-a9a06334f8cf None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:21.206908 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-a191bf03-e962-435e-95ee-a9a06334f8cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:21.206908 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:21.206908 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:21.206908 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:21.206908 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:21.206908 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:21.206908 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:21.206908 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:21.206908 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:21.206908 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:21.206908 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:21.206908 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:21.206908 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 10:50:21.206908 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 10:50:21.206908 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 10:50:21.206908 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 10:50:21.208012 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:21.208012 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:21.208012 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:21.208012 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:21.208012 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:21.208012 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:21.208012 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:21.208012 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:21.208012 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:21.208012 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:21.208012 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:21.208012 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:21.208012 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:21.208012 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:21.208012 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:21.208012 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:21.208012 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 10:50:21.208966 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 10:50:21.208966 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:21.208966 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:21.208966 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 361/699] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:50:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:21.209693 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a191bf03-e962-435e-95ee-a9a06334f8cf None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:21.222198 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88740a9c-4928-4d94-9d1a-f66628c954ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:21.223172 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88740a9c-4928-4d94-9d1a-f66628c954ee None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:21.223679 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88740a9c-4928-4d94-9d1a-f66628c954ee None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:21.224664 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88740a9c-4928-4d94-9d1a-f66628c954ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:21.330934 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88740a9c-4928-4d94-9d1a-f66628c954ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:21.333819 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88740a9c-4928-4d94-9d1a-f66628c954ee None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:21.346072 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a191bf03-e962-435e-95ee-a9a06334f8cf None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:21.366281 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:21.391982 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1b4c55-d599-4ca0-87f9-22beb5febb75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:21.392729 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b4c55-d599-4ca0-87f9-22beb5febb75 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:21.393071 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b4c55-d599-4ca0-87f9-22beb5febb75 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:21.393413 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b4c55-d599-4ca0-87f9-22beb5febb75 None admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:21.394200 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1b4c55-d599-4ca0-87f9-22beb5febb75 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:21.394527 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:21.394651 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1b4c55-d599-4ca0-87f9-22beb5febb75 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:21.396470 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1b4c55-d599-4ca0-87f9-22beb5febb75 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:21.420505 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 362/700] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Aug 18 10:50:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:21.421545 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1b4c55-d599-4ca0-87f9-22beb5febb75 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:21.478451 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 339/701] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 18 10:50:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 10:50:21.479982 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88740a9c-4928-4d94-9d1a-f66628c954ee None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:21.528389 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1b4c55-d599-4ca0-87f9-22beb5febb75 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:21.565210 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cded13-82a6-468d-a840-70c065bdd89b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:21.565997 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cded13-82a6-468d-a840-70c065bdd89b None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:21.566273 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cded13-82a6-468d-a840-70c065bdd89b None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:21.566849 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cded13-82a6-468d-a840-70c065bdd89b None admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:21.567811 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cded13-82a6-468d-a840-70c065bdd89b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:21.568196 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cded13-82a6-468d-a840-70c065bdd89b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:21.569539 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cded13-82a6-468d-a840-70c065bdd89b None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:21.583419 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 363/702] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 18 10:50:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:21.584318 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cded13-82a6-468d-a840-70c065bdd89b None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:21.609162 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88740a9c-4928-4d94-9d1a-f66628c954ee None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:21.625233 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:21.653105 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e765fa02-e491-4e81-ba81-af4be6c3e5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:21.653744 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e765fa02-e491-4e81-ba81-af4be6c3e5d8 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:21.654029 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e765fa02-e491-4e81-ba81-af4be6c3e5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:21.654309 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e765fa02-e491-4e81-ba81-af4be6c3e5d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:21.655103 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e765fa02-e491-4e81-ba81-af4be6c3e5d8 None admin] RBAC: Adding query filter params (role.id=13bffd536e214d0893b3007e267f3301, scope.project.id=1575e8ebaaab4650995841659b6e631b, user.id=f97e906b1922419d8511ab1c8b9c86e4) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:21.655417 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e765fa02-e491-4e81-ba81-af4be6c3e5d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:21.656850 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e765fa02-e491-4e81-ba81-af4be6c3e5d8 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:21.662767 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 340/703] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Aug 18 10:50:21 2022] GET /identity/v3/role_assignments?user.id=f97e906b1922419d8511ab1c8b9c86e4&scope.project.id=1575e8ebaaab4650995841659b6e631b&role.id=13bffd536e214d0893b3007e267f3301 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:21.664667 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc61f20-e0b5-4c99-9018-46ca4370ec6c None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:21.664952 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc61f20-e0b5-4c99-9018-46ca4370ec6c None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:21.665228 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc61f20-e0b5-4c99-9018-46ca4370ec6c None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:21.666659 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 341/704] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:50:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:50:21.667165 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc61f20-e0b5-4c99-9018-46ca4370ec6c None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:21.671792 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:21.717007 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cded13-82a6-468d-a840-70c065bdd89b None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:21.756279 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d2f128-73f9-4196-80e0-358cbdf01973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:21.756980 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d2f128-73f9-4196-80e0-358cbdf01973 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:21.757251 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d2f128-73f9-4196-80e0-358cbdf01973 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:21.757566 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d2f128-73f9-4196-80e0-358cbdf01973 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:21.769509 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d2f128-73f9-4196-80e0-358cbdf01973 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:21.770995 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d2f128-73f9-4196-80e0-358cbdf01973 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:21.786865 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-97d2f128-73f9-4196-80e0-358cbdf01973 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:21.786865 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:21.786865 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:21.786865 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:21.786865 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:21.786865 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:21.786865 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:21.786865 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:21.786865 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:21.786865 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:21.786865 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:21.786865 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:21.786865 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 10:50:21.786865 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 10:50:21.786865 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 10:50:21.786865 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 10:50:21.787920 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:21.787920 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:21.787920 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:21.787920 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:21.787920 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:21.787920 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:21.787920 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:21.787920 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:21.787920 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:21.787920 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:21.787920 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:21.787920 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:21.787920 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:21.787920 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:21.787920 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:21.787920 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:21.787920 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 10:50:21.789422 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 10:50:21.789422 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:21.789422 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:21.789422 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 364/705] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:50:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:21.790225 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6059ef07-c857-4ef5-8fdb-cac4c2368826 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:21.790447 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6059ef07-c857-4ef5-8fdb-cac4c2368826 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:21.790724 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6059ef07-c857-4ef5-8fdb-cac4c2368826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:21.807674 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc61f20-e0b5-4c99-9018-46ca4370ec6c None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:21.811887 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-6059ef07-c857-4ef5-8fdb-cac4c2368826 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:50:21.813110 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-6059ef07-c857-4ef5-8fdb-cac4c2368826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:50:21.855902 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63ff6a8-af6e-44ca-bb41-81ae3d72d1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:21.856855 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ff6a8-af6e-44ca-bb41-81ae3d72d1b0 None admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:21.857334 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ff6a8-af6e-44ca-bb41-81ae3d72d1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:21.857847 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ff6a8-af6e-44ca-bb41-81ae3d72d1b0 None admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:21.859055 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63ff6a8-af6e-44ca-bb41-81ae3d72d1b0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:21.861122 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63ff6a8-af6e-44ca-bb41-81ae3d72d1b0 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:21.891000 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 342/706] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Aug 18 10:50:21 2022] POST /identity/v3/users => generated 254 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 10:50:21.892360 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647390aa-d13a-4e82-9663-6e762ccf0c22 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:21.892637 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647390aa-d13a-4e82-9663-6e762ccf0c22 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:21.892968 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647390aa-d13a-4e82-9663-6e762ccf0c22 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:21.895338 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 343/707] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:50:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:50:21.895917 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647390aa-d13a-4e82-9663-6e762ccf0c22 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:21.905172 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 365/708] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:50:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 10:50:21.907074 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb2caa8-da92-4464-8b84-b220525ec2d5 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:21.907615 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb2caa8-da92-4464-8b84-b220525ec2d5 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:21.908126 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb2caa8-da92-4464-8b84-b220525ec2d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:21.932120 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-3fb2caa8-da92-4464-8b84-b220525ec2d5 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:50:21.933866 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-3fb2caa8-da92-4464-8b84-b220525ec2d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:50:21.950387 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:22.013666 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:22.062009 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 366/709] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:50:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 10:50:22.081334 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647390aa-d13a-4e82-9663-6e762ccf0c22 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:22.116890 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b1b301-7172-4201-b548-6de0bd9fdb1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:22.117495 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b1b301-7172-4201-b548-6de0bd9fdb1f None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:22.117858 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b1b301-7172-4201-b548-6de0bd9fdb1f None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:22.118131 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b1b301-7172-4201-b548-6de0bd9fdb1f None admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:22.118814 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b1b301-7172-4201-b548-6de0bd9fdb1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:22.119118 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b1b301-7172-4201-b548-6de0bd9fdb1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:22.120623 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b1b301-7172-4201-b548-6de0bd9fdb1f None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:22.134720 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 344/710] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 18 10:50:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:22.142665 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb2caa8-da92-4464-8b84-b220525ec2d5 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:22.223918 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b1b301-7172-4201-b548-6de0bd9fdb1f None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:22.268114 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb2caa8-da92-4464-8b84-b220525ec2d5 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:22.316907 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d849cee-98b5-456f-b888-6643520b6cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:22.317822 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d849cee-98b5-456f-b888-6643520b6cb6 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:22.318268 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d849cee-98b5-456f-b888-6643520b6cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:22.318684 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d849cee-98b5-456f-b888-6643520b6cb6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:22.328210 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d849cee-98b5-456f-b888-6643520b6cb6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:22.330549 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d849cee-98b5-456f-b888-6643520b6cb6 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:22.346983 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-1d849cee-98b5-456f-b888-6643520b6cb6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 10:50:22.346983 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:22.346983 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:22.346983 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:22.346983 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:22.346983 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:22.346983 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:22.346983 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:22.346983 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:22.346983 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:22.346983 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:22.346983 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:22.346983 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 10:50:22.346983 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 10:50:22.346983 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 10:50:22.348088 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 10:50:22.348088 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:22.348088 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:22.348088 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:22.348088 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:22.348088 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:22.348088 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:22.348088 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:22.348088 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:22.348088 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:22.348088 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:22.348088 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:22.348088 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:22.348088 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:22.348088 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:22.348088 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:22.348088 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:22.349184 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 10:50:22.349184 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 10:50:22.349184 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 10:50:22.349184 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 10:50:22.349184 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 10:50:22.349184 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 10:50:22.349184 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 10:50:22.349184 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:22.351705 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 367/711] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 18 10:50:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:22.357426 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d849cee-98b5-456f-b888-6643520b6cb6 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:22.360966 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b1b301-7172-4201-b548-6de0bd9fdb1f None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:22.373946 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:22.386222 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:22.422804 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba2b871-6d4a-4bec-87e4-e6ad9f9c36ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:22.423569 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba2b871-6d4a-4bec-87e4-e6ad9f9c36ab None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:22.423852 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba2b871-6d4a-4bec-87e4-e6ad9f9c36ab None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:22.424374 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba2b871-6d4a-4bec-87e4-e6ad9f9c36ab None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:22.424990 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba2b871-6d4a-4bec-87e4-e6ad9f9c36ab None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:22.426958 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba2b871-6d4a-4bec-87e4-e6ad9f9c36ab None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:22.442415 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-cba2b871-6d4a-4bec-87e4-e6ad9f9c36ab None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 10:50:22.442415 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:22.442415 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 10:50:22.442415 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 10:50:22.442415 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 10:50:22.442415 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 10:50:22.442415 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 10:50:22.442415 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 10:50:22.442415 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 10:50:22.442415 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:22.442415 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 10:50:22.442415 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:22.442415 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:22.442415 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:22.442415 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:22.442415 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:22.442415 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:22.443723 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:22.443723 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:22.443723 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:22.443723 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:22.443723 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:22.443723 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:22.443723 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 10:50:22.443723 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 10:50:22.443723 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 10:50:22.443723 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 10:50:22.443723 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:22.443723 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:22.443723 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:22.443723 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:22.443723 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:22.443723 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:22.444762 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:22.444762 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:22.444762 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:22.444762 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:22.444762 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:22.444762 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:22.444762 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:22.444762 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:22.444762 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:22.444762 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:22.444762 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 10:50:22.444762 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 10:50:22.444762 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 10:50:22.444762 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:22.444762 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 345/712] 10.222.0.15 () {56 vars in 1129 bytes} [Thu Aug 18 10:50:22 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:22.446228 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba2b871-6d4a-4bec-87e4-e6ad9f9c36ab None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:22.495152 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d849cee-98b5-456f-b888-6643520b6cb6 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:22.543554 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ac6cc9-f118-457a-95e1-9f6e85135f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:22.544491 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac6cc9-f118-457a-95e1-9f6e85135f49 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:22.544945 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac6cc9-f118-457a-95e1-9f6e85135f49 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:22.545401 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac6cc9-f118-457a-95e1-9f6e85135f49 None admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:22.546286 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ac6cc9-f118-457a-95e1-9f6e85135f49 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:22.546770 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ac6cc9-f118-457a-95e1-9f6e85135f49 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:22.549044 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ac6cc9-f118-457a-95e1-9f6e85135f49 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:22.566569 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 368/713] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Aug 18 10:50:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:22.571699 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ac6cc9-f118-457a-95e1-9f6e85135f49 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:22.581233 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba2b871-6d4a-4bec-87e4-e6ad9f9c36ab None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:22.628634 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14c7a97-afd1-4cd6-9e42-b617776303f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:22.629898 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14c7a97-afd1-4cd6-9e42-b617776303f0 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:22.630642 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14c7a97-afd1-4cd6-9e42-b617776303f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:22.631544 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14c7a97-afd1-4cd6-9e42-b617776303f0 None admin] PATH_INFO: `/v3/services/network` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:22.632798 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14c7a97-afd1-4cd6-9e42-b617776303f0 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:22.635251 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14c7a97-afd1-4cd6-9e42-b617776303f0 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:22.643542 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:22.652807 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-c14c7a97-afd1-4cd6-9e42-b617776303f0 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 10:50:22.652807 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:22.652807 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 10:50:22.652807 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 10:50:22.652807 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 10:50:22.652807 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 10:50:22.652807 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 10:50:22.652807 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 10:50:22.652807 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 10:50:22.652807 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:22.652807 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 10:50:22.652807 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:22.652807 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:22.652807 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:22.652807 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:22.652807 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:22.652807 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:22.653895 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:22.653895 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:22.653895 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:22.653895 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:22.653895 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:22.653895 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:22.653895 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 10:50:22.653895 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 10:50:22.653895 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 10:50:22.653895 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 10:50:22.653895 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:22.653895 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:22.653895 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:22.653895 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:22.653895 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:22.653895 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:22.654732 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:22.654732 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:22.654732 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:22.654732 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:22.654732 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:22.654732 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:22.654732 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:22.654732 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:22.654732 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:22.654732 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:22.654732 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 10:50:22.654732 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 10:50:22.654732 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 10:50:22.654732 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:22.658043 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 346/714] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 18 10:50:22 2022] GET /identity/v3/services/network => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:22.659184 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14c7a97-afd1-4cd6-9e42-b617776303f0 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:22.700229 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ac6cc9-f118-457a-95e1-9f6e85135f49 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:22.715209 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:22.756084 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2d0f37-f595-4f05-a185-763d269b0760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:22.756956 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d0f37-f595-4f05-a185-763d269b0760 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:22.758785 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d0f37-f595-4f05-a185-763d269b0760 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:22.759072 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d0f37-f595-4f05-a185-763d269b0760 None admin] PATH_INFO: `/v3/services` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:22.759722 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2d0f37-f595-4f05-a185-763d269b0760 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:22.760032 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2d0f37-f595-4f05-a185-763d269b0760 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:22.762005 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2d0f37-f595-4f05-a185-763d269b0760 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:22.769686 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 369/715] 10.222.0.15 () {56 vars in 1124 bytes} [Thu Aug 18 10:50:22 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:22.770992 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2d0f37-f595-4f05-a185-763d269b0760 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:22.782720 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14c7a97-afd1-4cd6-9e42-b617776303f0 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:22.834215 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3905a087-0ea4-4966-835e-013be0ae4e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:22.834742 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3905a087-0ea4-4966-835e-013be0ae4e57 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:22.835524 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3905a087-0ea4-4966-835e-013be0ae4e57 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:22.835867 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3905a087-0ea4-4966-835e-013be0ae4e57 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:22.836725 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3905a087-0ea4-4966-835e-013be0ae4e57 None admin] RBAC: Adding query filter params (role.id=127fdc7ef05b4e0b98a940b334e5fcab, scope.project.id=1575e8ebaaab4650995841659b6e631b, user.id=a005d8f0c46d44c7b6f2201a54717b12) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:22.837035 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3905a087-0ea4-4966-835e-013be0ae4e57 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:22.838508 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3905a087-0ea4-4966-835e-013be0ae4e57 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:22.845866 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 347/716] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Aug 18 10:50:22 2022] GET /identity/v3/role_assignments?user.id=a005d8f0c46d44c7b6f2201a54717b12&scope.project.id=1575e8ebaaab4650995841659b6e631b&role.id=127fdc7ef05b4e0b98a940b334e5fcab => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:22.847390 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3905a087-0ea4-4966-835e-013be0ae4e57 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:22.947934 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2d0f37-f595-4f05-a185-763d269b0760 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:23.011072 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3905a087-0ea4-4966-835e-013be0ae4e57 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:23.026363 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:23.029237 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:23.035109 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d132ec-38c9-45b7-86be-4d491ee75e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:23.035921 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d132ec-38c9-45b7-86be-4d491ee75e05 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:23.036371 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d132ec-38c9-45b7-86be-4d491ee75e05 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:23.036726 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d132ec-38c9-45b7-86be-4d491ee75e05 None admin] PATH_INFO: `/v3/services` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:23.038080 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d132ec-38c9-45b7-86be-4d491ee75e05 None admin] RBAC: Adding query filter params (name=network) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:23.038645 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d132ec-38c9-45b7-86be-4d491ee75e05 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:23.040662 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d132ec-38c9-45b7-86be-4d491ee75e05 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:23.059259 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad554344-fa9d-4611-977e-fb57cf1c1a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:23.059896 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad554344-fa9d-4611-977e-fb57cf1c1a38 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:23.060178 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad554344-fa9d-4611-977e-fb57cf1c1a38 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:23.060454 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad554344-fa9d-4611-977e-fb57cf1c1a38 None admin] PATH_INFO: `/v3/services` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:23.061105 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad554344-fa9d-4611-977e-fb57cf1c1a38 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:23.061411 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad554344-fa9d-4611-977e-fb57cf1c1a38 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:23.063848 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 370/717] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Aug 18 10:50:22 2022] GET /identity/v3/services?name=network => generated 124 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:23.065011 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad554344-fa9d-4611-977e-fb57cf1c1a38 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:23.071829 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d132ec-38c9-45b7-86be-4d491ee75e05 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:23.078740 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 348/718] 10.222.0.15 () {56 vars in 1124 bytes} [Thu Aug 18 10:50:22 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:23.209695 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d132ec-38c9-45b7-86be-4d491ee75e05 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:23.262868 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24199743-34ee-4c50-a603-3ddfd16ed0a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:23.263500 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24199743-34ee-4c50-a603-3ddfd16ed0a0 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:23.263782 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24199743-34ee-4c50-a603-3ddfd16ed0a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:23.264057 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24199743-34ee-4c50-a603-3ddfd16ed0a0 None admin] PATH_INFO: `/v3/services` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:23.264705 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24199743-34ee-4c50-a603-3ddfd16ed0a0 None admin] RBAC: Adding query filter params (type=network) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:23.265007 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24199743-34ee-4c50-a603-3ddfd16ed0a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:23.266414 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24199743-34ee-4c50-a603-3ddfd16ed0a0 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:23.278026 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 371/719] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Aug 18 10:50:23 2022] GET /identity/v3/services?type=network => generated 124 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:23.864675 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640eb50f-29c8-49c5-b93a-c684b317d738 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:23.865097 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640eb50f-29c8-49c5-b93a-c684b317d738 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:23.865273 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640eb50f-29c8-49c5-b93a-c684b317d738 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:23.867576 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 349/720] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:50:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:50:23.873038 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef08e0-761e-4ad8-8aec-a28608f6bea4 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:23.873328 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef08e0-761e-4ad8-8aec-a28608f6bea4 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:23.873635 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef08e0-761e-4ad8-8aec-a28608f6bea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:23.896484 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-e6ef08e0-761e-4ad8-8aec-a28608f6bea4 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:50:23.897770 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-e6ef08e0-761e-4ad8-8aec-a28608f6bea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:50:23.973890 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:23.990474 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 372/721] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:50:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 10:50:24.394769 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640eb50f-29c8-49c5-b93a-c684b317d738 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:24.409465 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963e8073-e48d-4945-b8c6-b5cd86ece65b None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:24.409979 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963e8073-e48d-4945-b8c6-b5cd86ece65b None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:24.410197 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963e8073-e48d-4945-b8c6-b5cd86ece65b None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:24.414889 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 373/722] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:50:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:50:24.422022 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbf7243-f4e4-40dc-be01-edc2371663d1 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:24.422599 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbf7243-f4e4-40dc-be01-edc2371663d1 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:24.423100 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbf7243-f4e4-40dc-be01-edc2371663d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:24.441874 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-4bbf7243-f4e4-40dc-be01-edc2371663d1 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:50:24.443561 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-4bbf7243-f4e4-40dc-be01-edc2371663d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:50:24.529089 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 374/723] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:50:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 10:50:24.566864 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640eb50f-29c8-49c5-b93a-c684b317d738 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:24.623123 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf3f6f1-b24d-476a-bf11-cdde9b9a1b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:24.624173 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf3f6f1-b24d-476a-bf11-cdde9b9a1b5e None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:24.624681 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf3f6f1-b24d-476a-bf11-cdde9b9a1b5e None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:24.625177 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf3f6f1-b24d-476a-bf11-cdde9b9a1b5e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:24.643853 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf3f6f1-b24d-476a-bf11-cdde9b9a1b5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:50:24.649381 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-0bf3f6f1-b24d-476a-bf11-cdde9b9a1b5e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 10:50:24.649381 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:24.649381 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:24.649381 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:24.649381 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:24.649381 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:24.649381 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:24.649381 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:24.649381 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:24.649381 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:24.649381 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:24.649381 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:24.649381 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:50:24.649381 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:50:24.649381 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:50:24.649381 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:50:24.650427 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:50:24.650427 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:50:24.650427 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:50:24.650427 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:50:24.650427 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:24.650427 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:24.650427 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:24.650427 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:24.650427 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:24.650427 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:24.650427 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:24.650427 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:24.650427 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:24.650427 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:24.650427 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:24.650427 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:24.651526 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:24.651526 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:24.651526 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:24.651526 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:24.651526 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:50:24.651526 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:50:24.651526 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:50:24.651526 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:50:24.651526 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:50:24.651526 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:50:24.651526 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 10:50:24.651526 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:24.654249 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 350/724] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Aug 18 10:50:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:24.659834 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbf7243-f4e4-40dc-be01-edc2371663d1 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:24.779634 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbf7243-f4e4-40dc-be01-edc2371663d1 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:24.800666 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:24.817935 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25014619-4cc9-44e0-8af0-a7fcefcc5365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:24.819499 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf3f6f1-b24d-476a-bf11-cdde9b9a1b5e None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:24.820692 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25014619-4cc9-44e0-8af0-a7fcefcc5365 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:24.821197 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25014619-4cc9-44e0-8af0-a7fcefcc5365 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:24.821732 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25014619-4cc9-44e0-8af0-a7fcefcc5365 None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:24.822634 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25014619-4cc9-44e0-8af0-a7fcefcc5365 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:24.823171 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25014619-4cc9-44e0-8af0-a7fcefcc5365 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:24.824765 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25014619-4cc9-44e0-8af0-a7fcefcc5365 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:24.840662 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 375/725] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 18 10:50:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 10:50:24.842162 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25014619-4cc9-44e0-8af0-a7fcefcc5365 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:24.873543 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:24.947160 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf3f6f1-b24d-476a-bf11-cdde9b9a1b5e None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:24.985887 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0026a75-15ef-427d-b957-d9132f10aec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:24.986535 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0026a75-15ef-427d-b957-d9132f10aec4 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:24.986826 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0026a75-15ef-427d-b957-d9132f10aec4 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:24.987754 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0026a75-15ef-427d-b957-d9132f10aec4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:25.000907 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0026a75-15ef-427d-b957-d9132f10aec4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:50:25.006887 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-e0026a75-15ef-427d-b957-d9132f10aec4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 10:50:25.006887 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:25.006887 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:25.006887 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:25.006887 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:25.006887 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:25.006887 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:25.006887 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:25.006887 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:25.006887 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:25.006887 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:25.006887 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:25.006887 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:50:25.006887 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:50:25.006887 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:50:25.006887 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:50:25.008506 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:50:25.008506 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:50:25.008506 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:50:25.008506 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:50:25.008506 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:25.008506 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:25.008506 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:25.008506 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:25.008506 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:25.008506 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:25.008506 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:25.008506 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:25.008506 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:25.008506 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:25.008506 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:25.008506 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:25.009336 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:25.009336 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:25.009336 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:25.009336 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:25.009336 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:50:25.009336 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:50:25.009336 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:50:25.009336 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:50:25.009336 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:50:25.009336 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:50:25.009336 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 10:50:25.009336 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:25.009336 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 351/726] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Aug 18 10:50:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 10:50:25.016166 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0026a75-15ef-427d-b957-d9132f10aec4 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:25.086045 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25014619-4cc9-44e0-8af0-a7fcefcc5365 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:25.134577 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42deb1d-23cb-4183-b414-3ab961e2850b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:25.135385 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42deb1d-23cb-4183-b414-3ab961e2850b None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:25.135770 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42deb1d-23cb-4183-b414-3ab961e2850b None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:25.136052 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42deb1d-23cb-4183-b414-3ab961e2850b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:25.148542 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42deb1d-23cb-4183-b414-3ab961e2850b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:25.150241 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42deb1d-23cb-4183-b414-3ab961e2850b None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:25.165692 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-a42deb1d-23cb-4183-b414-3ab961e2850b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:25.165692 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:25.165692 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:25.165692 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:25.165692 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:25.165692 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:25.165692 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:25.165692 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:25.165692 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:25.165692 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:25.165692 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:25.165692 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:25.165692 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 10:50:25.165692 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 10:50:25.165692 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 10:50:25.165692 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 10:50:25.167860 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:25.167860 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:25.167860 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:25.167860 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:25.167860 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:25.167860 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:25.167860 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:25.167860 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:25.167860 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:25.167860 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:25.167860 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:25.167860 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:25.167860 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:25.167860 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:25.167860 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:25.167860 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:25.167860 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 10:50:25.169600 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 10:50:25.169600 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:25.169600 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:25.169600 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 376/727] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:50:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:25.175744 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42deb1d-23cb-4183-b414-3ab961e2850b None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:25.178726 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:25.185035 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0026a75-15ef-427d-b957-d9132f10aec4 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:25.221930 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90c946d-9130-440f-949f-0771bffa2ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:25.222547 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c946d-9130-440f-949f-0771bffa2ec4 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:25.222828 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c946d-9130-440f-949f-0771bffa2ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:25.223152 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c946d-9130-440f-949f-0771bffa2ec4 None admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:25.223831 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90c946d-9130-440f-949f-0771bffa2ec4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:25.224137 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90c946d-9130-440f-949f-0771bffa2ec4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:25.225616 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90c946d-9130-440f-949f-0771bffa2ec4 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:25.238504 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 352/728] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Aug 18 10:50:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:25.245077 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90c946d-9130-440f-949f-0771bffa2ec4 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:25.256319 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:25.329685 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42deb1d-23cb-4183-b414-3ab961e2850b None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:25.379769 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16708ba-0cbc-4358-a2ad-9268432ac7bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:25.380306 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16708ba-0cbc-4358-a2ad-9268432ac7bf None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:25.380588 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16708ba-0cbc-4358-a2ad-9268432ac7bf None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:25.380864 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16708ba-0cbc-4358-a2ad-9268432ac7bf None admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:25.381812 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16708ba-0cbc-4358-a2ad-9268432ac7bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:25.382267 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16708ba-0cbc-4358-a2ad-9268432ac7bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:25.386146 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16708ba-0cbc-4358-a2ad-9268432ac7bf None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:25.391487 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90c946d-9130-440f-949f-0771bffa2ec4 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:25.408619 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 377/729] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 18 10:50:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:25.417541 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963b282-65c3-4019-86ca-ac8a7f6aad68 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:25.417541 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963b282-65c3-4019-86ca-ac8a7f6aad68 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:25.417541 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963b282-65c3-4019-86ca-ac8a7f6aad68 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:25.417541 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 378/730] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:50:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:50:25.417541 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8963b282-65c3-4019-86ca-ac8a7f6aad68 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:25.440419 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7783f3df-e05c-4d92-b84e-f5df00a41d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:25.441098 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7783f3df-e05c-4d92-b84e-f5df00a41d88 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:25.441323 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7783f3df-e05c-4d92-b84e-f5df00a41d88 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:25.441639 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7783f3df-e05c-4d92-b84e-f5df00a41d88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:25.453794 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7783f3df-e05c-4d92-b84e-f5df00a41d88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:25.455475 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7783f3df-e05c-4d92-b84e-f5df00a41d88 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:25.471268 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-7783f3df-e05c-4d92-b84e-f5df00a41d88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:25.471268 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:25.471268 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:25.471268 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:25.471268 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:25.471268 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:25.471268 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:25.471268 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:25.471268 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:25.471268 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:25.471268 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:25.471268 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:25.471268 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 10:50:25.471268 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 10:50:25.471268 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 10:50:25.471268 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 10:50:25.472258 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:25.472258 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:25.472258 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:25.472258 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:25.472258 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:25.472258 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:25.472258 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:25.472258 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:25.472258 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:25.472258 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:25.472258 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:25.472258 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:25.472258 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:25.472258 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:25.472258 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:25.472258 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:25.472258 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 10:50:25.473129 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 10:50:25.473129 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:25.473129 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:25.477728 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 353/731] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:50:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:25.479067 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e321b592-e7b4-4914-9016-85d3cb0e617a None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:25.479354 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e321b592-e7b4-4914-9016-85d3cb0e617a None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:25.479629 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e321b592-e7b4-4914-9016-85d3cb0e617a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:25.498245 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-e321b592-e7b4-4914-9016-85d3cb0e617a None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:50:25.499462 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-e321b592-e7b4-4914-9016-85d3cb0e617a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:50:25.502557 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:25.523659 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:25.532381 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8963b282-65c3-4019-86ca-ac8a7f6aad68 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:25.569815 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c456c81-8717-489b-94cb-00016920820e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:25.570504 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c456c81-8717-489b-94cb-00016920820e None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:25.570876 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c456c81-8717-489b-94cb-00016920820e None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:25.571163 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c456c81-8717-489b-94cb-00016920820e None admin] PATH_INFO: `/v3/users/swift` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:25.581552 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c456c81-8717-489b-94cb-00016920820e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:25.581552 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c456c81-8717-489b-94cb-00016920820e None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:25.582265 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 354/732] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:50:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 10:50:25.583361 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e321b592-e7b4-4914-9016-85d3cb0e617a None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:25.594487 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-9c456c81-8717-489b-94cb-00016920820e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 18 10:50:25.594487 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:25.594487 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:25.594487 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:25.594487 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:25.594487 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:25.594487 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:25.594487 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:25.594487 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:25.594487 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:25.594487 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:25.594487 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:25.594487 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 10:50:25.594487 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 10:50:25.594487 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 10:50:25.594487 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 10:50:25.595451 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:25.595451 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:25.595451 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 10:50:25.595451 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 10:50:25.595451 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 10:50:25.595451 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 10:50:25.595451 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:25.595451 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:25.595451 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:25.595451 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:25.595451 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:25.595451 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:25.595451 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:25.595451 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:25.595451 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:25.595451 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:25.595451 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:25.595451 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:25.596372 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:25.596372 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:25.596372 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 10:50:25.596372 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 10:50:25.596372 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 10:50:25.596372 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 10:50:25.596372 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 10:50:25.596372 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 10:50:25.596372 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 18 10:50:25.596372 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:25.596372 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 379/733] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Aug 18 10:50:25 2022] GET /identity/v3/users/swift => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 10:50:25.610954 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba426a-f8be-4529-ae37-5a78947e9e9a None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:25.611240 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba426a-f8be-4529-ae37-5a78947e9e9a None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:25.611510 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba426a-f8be-4529-ae37-5a78947e9e9a None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:25.612946 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 380/734] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:50:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:50:25.614052 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba426a-f8be-4529-ae37-5a78947e9e9a None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:25.707036 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e321b592-e7b4-4914-9016-85d3cb0e617a None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:25.748912 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461e9c4f-852f-47fb-b40f-ef7884f1ea0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:25.749663 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e9c4f-852f-47fb-b40f-ef7884f1ea0b None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:25.749941 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e9c4f-852f-47fb-b40f-ef7884f1ea0b None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:25.750210 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e9c4f-852f-47fb-b40f-ef7884f1ea0b None admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:25.750905 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461e9c4f-852f-47fb-b40f-ef7884f1ea0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:25.751207 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461e9c4f-852f-47fb-b40f-ef7884f1ea0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:25.752156 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba426a-f8be-4529-ae37-5a78947e9e9a None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:25.752575 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461e9c4f-852f-47fb-b40f-ef7884f1ea0b None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:25.764250 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:25.772308 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 355/735] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 18 10:50:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:25.772308 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edfa7f4-5be1-428f-815d-536effa5ac00 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:25.772308 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edfa7f4-5be1-428f-815d-536effa5ac00 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:25.772308 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edfa7f4-5be1-428f-815d-536effa5ac00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:25.792957 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-5edfa7f4-5be1-428f-815d-536effa5ac00 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:50:25.794298 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-5edfa7f4-5be1-428f-815d-536effa5ac00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:50:25.803407 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c555e179-4834-4b46-887e-1341f7e0652d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:25.806112 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555e179-4834-4b46-887e-1341f7e0652d None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:25.806393 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555e179-4834-4b46-887e-1341f7e0652d None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:25.806666 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555e179-4834-4b46-887e-1341f7e0652d None admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:25.807435 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c555e179-4834-4b46-887e-1341f7e0652d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:25.807739 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c555e179-4834-4b46-887e-1341f7e0652d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:25.809160 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c555e179-4834-4b46-887e-1341f7e0652d None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:25.839290 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 381/736] 10.222.0.15 () {56 vars in 1135 bytes} [Thu Aug 18 10:50:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:25.839290 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c555e179-4834-4b46-887e-1341f7e0652d None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:25.860923 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:25.890833 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 356/737] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:50:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 10:50:25.892095 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edfa7f4-5be1-428f-815d-536effa5ac00 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:25.969466 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c555e179-4834-4b46-887e-1341f7e0652d None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:26.010576 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f526a1-6dd9-4422-bb82-02863bd275cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:26.010576 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f526a1-6dd9-4422-bb82-02863bd275cd None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:26.010576 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f526a1-6dd9-4422-bb82-02863bd275cd None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:26.010576 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f526a1-6dd9-4422-bb82-02863bd275cd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:26.010993 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edfa7f4-5be1-428f-815d-536effa5ac00 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:26.018589 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f526a1-6dd9-4422-bb82-02863bd275cd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:26.020037 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f526a1-6dd9-4422-bb82-02863bd275cd None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:26.032724 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-f4f526a1-6dd9-4422-bb82-02863bd275cd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 10:50:26.032724 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:26.032724 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:26.032724 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:26.032724 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:26.032724 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:26.032724 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:26.032724 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:26.032724 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:26.032724 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:26.032724 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:26.032724 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:26.032724 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 10:50:26.032724 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 10:50:26.032724 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 10:50:26.032724 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 10:50:26.033729 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:26.033729 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:26.033729 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 10:50:26.033729 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 10:50:26.033729 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 10:50:26.033729 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 10:50:26.033729 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:26.033729 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:26.033729 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:26.033729 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:26.033729 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:26.033729 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:26.033729 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:26.033729 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:26.033729 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:26.033729 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:26.033729 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:26.033729 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:26.034684 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:26.034684 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:26.034684 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 10:50:26.034684 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 10:50:26.034684 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 10:50:26.034684 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 10:50:26.034684 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 10:50:26.034684 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 10:50:26.034684 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 10:50:26.034684 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:26.034684 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 382/738] 10.222.0.15 () {56 vars in 1117 bytes} [Thu Aug 18 10:50:25 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:26.035748 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f32a23a-2ce2-4d73-a5e7-6b7f9a50aeb0 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:26.035748 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f32a23a-2ce2-4d73-a5e7-6b7f9a50aeb0 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:26.035915 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f32a23a-2ce2-4d73-a5e7-6b7f9a50aeb0 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:26.037226 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 383/739] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:50:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:50:26.041552 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f32a23a-2ce2-4d73-a5e7-6b7f9a50aeb0 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:26.051161 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:26.058656 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944538d8-cf0f-4f1c-bfcc-bc3e45a68bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:26.059389 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944538d8-cf0f-4f1c-bfcc-bc3e45a68bc9 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:26.059674 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944538d8-cf0f-4f1c-bfcc-bc3e45a68bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:26.060057 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944538d8-cf0f-4f1c-bfcc-bc3e45a68bc9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:26.118945 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:26.136785 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944538d8-cf0f-4f1c-bfcc-bc3e45a68bc9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:26.138284 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944538d8-cf0f-4f1c-bfcc-bc3e45a68bc9 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:26.152541 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f32a23a-2ce2-4d73-a5e7-6b7f9a50aeb0 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:26.187251 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbcc9d6-8a39-430d-ae56-beb1bd586d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:26.187547 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbcc9d6-8a39-430d-ae56-beb1bd586d3e None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:26.187708 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbcc9d6-8a39-430d-ae56-beb1bd586d3e None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:26.188012 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbcc9d6-8a39-430d-ae56-beb1bd586d3e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:26.198816 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbcc9d6-8a39-430d-ae56-beb1bd586d3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:50:26.203899 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-ddbcc9d6-8a39-430d-ae56-beb1bd586d3e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 10:50:26.203899 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:26.203899 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:26.203899 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:26.203899 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:26.203899 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:26.203899 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:26.203899 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:26.203899 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:26.203899 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:26.203899 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:26.203899 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:26.203899 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:50:26.203899 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:50:26.203899 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:50:26.203899 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:50:26.205735 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:50:26.205735 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:50:26.205735 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:50:26.205735 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:50:26.205735 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:26.205735 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:26.205735 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:26.205735 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:26.205735 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:26.205735 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:26.205735 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:26.205735 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:26.205735 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:26.205735 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:26.205735 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:26.205735 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:26.207084 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:26.207084 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:26.207084 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:26.207084 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:26.207084 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:50:26.207084 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:50:26.207084 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:50:26.207084 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:50:26.207084 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:50:26.207084 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:50:26.207084 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 10:50:26.207084 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:26.207084 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 384/740] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Aug 18 10:50:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:26.207084 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbcc9d6-8a39-430d-ae56-beb1bd586d3e None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:26.247596 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 357/741] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 18 10:50:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 10:50:26.248833 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa08807-3962-4cca-93d2-9f8ff84232b3 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:26.249151 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa08807-3962-4cca-93d2-9f8ff84232b3 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:26.249420 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa08807-3962-4cca-93d2-9f8ff84232b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:26.267191 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-efa08807-3962-4cca-93d2-9f8ff84232b3 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:50:26.268370 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-efa08807-3962-4cca-93d2-9f8ff84232b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:50:26.293185 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:26.312042 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbcc9d6-8a39-430d-ae56-beb1bd586d3e None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:26.338121 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 358/742] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:50:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 10:50:26.338955 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa08807-3962-4cca-93d2-9f8ff84232b3 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:26.345680 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d16108-97d7-445d-94fa-745e8febf3d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:26.346287 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d16108-97d7-445d-94fa-745e8febf3d0 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:26.346562 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d16108-97d7-445d-94fa-745e8febf3d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:26.346832 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d16108-97d7-445d-94fa-745e8febf3d0 None admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:26.347552 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d16108-97d7-445d-94fa-745e8febf3d0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:26.347852 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d16108-97d7-445d-94fa-745e8febf3d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:26.349279 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d16108-97d7-445d-94fa-745e8febf3d0 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:26.351506 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:26.370191 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 385/743] 10.222.0.15 () {56 vars in 1149 bytes} [Thu Aug 18 10:50:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:26.371193 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d16108-97d7-445d-94fa-745e8febf3d0 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:26.472483 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa08807-3962-4cca-93d2-9f8ff84232b3 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:26.482335 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d16108-97d7-445d-94fa-745e8febf3d0 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:26.511642 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7529d5f9-22b2-476f-bb87-92d9bbaa82e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:26.512175 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7529d5f9-22b2-476f-bb87-92d9bbaa82e8 None admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:26.512603 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7529d5f9-22b2-476f-bb87-92d9bbaa82e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:26.512883 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7529d5f9-22b2-476f-bb87-92d9bbaa82e8 None admin] PATH_INFO: `/v3/services` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:26.513995 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7529d5f9-22b2-476f-bb87-92d9bbaa82e8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:26.515493 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7529d5f9-22b2-476f-bb87-92d9bbaa82e8 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:26.517868 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff89392b-f694-4ce9-b029-ca81f85b2029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:26.518479 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff89392b-f694-4ce9-b029-ca81f85b2029 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:26.518867 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff89392b-f694-4ce9-b029-ca81f85b2029 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:26.519034 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff89392b-f694-4ce9-b029-ca81f85b2029 None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:26.519704 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff89392b-f694-4ce9-b029-ca81f85b2029 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:26.520008 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff89392b-f694-4ce9-b029-ca81f85b2029 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:26.521353 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff89392b-f694-4ce9-b029-ca81f85b2029 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:26.532925 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 386/744] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 18 10:50:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:26.533888 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff89392b-f694-4ce9-b029-ca81f85b2029 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:26.540087 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 359/745] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Aug 18 10:50:26 2022] POST /identity/v3/services => generated 240 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 10:50:26.540935 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7529d5f9-22b2-476f-bb87-92d9bbaa82e8 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:26.584021 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:26.601642 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:26.660090 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff89392b-f694-4ce9-b029-ca81f85b2029 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:26.692334 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7529d5f9-22b2-476f-bb87-92d9bbaa82e8 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:26.699717 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80557911-372f-4eec-bba6-fc3b3cc798f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:26.700710 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80557911-372f-4eec-bba6-fc3b3cc798f7 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:26.700710 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80557911-372f-4eec-bba6-fc3b3cc798f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:26.701098 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80557911-372f-4eec-bba6-fc3b3cc798f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:26.713000 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80557911-372f-4eec-bba6-fc3b3cc798f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:26.714523 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80557911-372f-4eec-bba6-fc3b3cc798f7 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:26.731226 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-80557911-372f-4eec-bba6-fc3b3cc798f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:26.731226 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:26.731226 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:26.731226 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:26.731226 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:26.731226 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:26.731226 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:26.731226 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:26.731226 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:26.731226 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:26.731226 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:26.731226 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:26.731226 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 10:50:26.731226 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 10:50:26.731226 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 10:50:26.731226 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 10:50:26.732420 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:26.732420 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:26.732420 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:26.732420 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:26.732420 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:26.732420 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:26.732420 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:26.732420 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:26.732420 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:26.732420 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:26.732420 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:26.732420 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:26.732420 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:26.732420 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:26.732420 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:26.732420 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:26.732420 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 10:50:26.733563 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 10:50:26.733563 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:26.733563 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:26.733563 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 387/746] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:50:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:26.733563 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80557911-372f-4eec-bba6-fc3b3cc798f7 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:26.733851 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfda2e08-88c7-42e3-89bc-77c687383467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:26.734250 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda2e08-88c7-42e3-89bc-77c687383467 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:26.734536 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda2e08-88c7-42e3-89bc-77c687383467 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:26.734804 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda2e08-88c7-42e3-89bc-77c687383467 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:26.808392 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfda2e08-88c7-42e3-89bc-77c687383467 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:26.809769 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfda2e08-88c7-42e3-89bc-77c687383467 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:26.828814 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:26.844864 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80557911-372f-4eec-bba6-fc3b3cc798f7 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:26.848221 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:26.883197 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3e1121-d2e8-48b4-89d1-96fee05485f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:26.883923 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3e1121-d2e8-48b4-89d1-96fee05485f9 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:26.884211 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3e1121-d2e8-48b4-89d1-96fee05485f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:26.884474 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3e1121-d2e8-48b4-89d1-96fee05485f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:26.896047 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3e1121-d2e8-48b4-89d1-96fee05485f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:26.897548 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3e1121-d2e8-48b4-89d1-96fee05485f9 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:26.912972 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-8e3e1121-d2e8-48b4-89d1-96fee05485f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:26.912972 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:26.912972 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:26.912972 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:26.912972 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:26.912972 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:26.912972 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:26.912972 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:26.912972 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:26.912972 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:26.912972 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:26.912972 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:26.912972 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 10:50:26.912972 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 10:50:26.912972 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 10:50:26.912972 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 10:50:26.914074 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:26.914074 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:26.914074 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:26.914074 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:26.914074 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:26.914074 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:26.914074 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:26.914074 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:26.914074 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:26.914074 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:26.914074 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:26.914074 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:26.914074 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:26.914074 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:26.914074 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:26.914074 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:26.914074 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 10:50:26.915064 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 10:50:26.915064 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:26.915064 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:26.915064 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 388/747] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:50:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:26.915064 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3e1121-d2e8-48b4-89d1-96fee05485f9 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:26.932061 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 360/748] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 18 10:50:26 2022] GET /identity/v3/auth/tokens => generated 898 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 10:50:26.933212 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfda2e08-88c7-42e3-89bc-77c687383467 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:27.028250 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3e1121-d2e8-48b4-89d1-96fee05485f9 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:27.045332 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfda2e08-88c7-42e3-89bc-77c687383467 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:27.064938 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:27.066788 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91984c22-9542-4c36-b435-2f53bebafc22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:27.067524 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91984c22-9542-4c36-b435-2f53bebafc22 None admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:27.067805 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91984c22-9542-4c36-b435-2f53bebafc22 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:27.068080 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91984c22-9542-4c36-b435-2f53bebafc22 None admin] PATH_INFO: `/v3/services` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:27.068739 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91984c22-9542-4c36-b435-2f53bebafc22 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:27.070996 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91984c22-9542-4c36-b435-2f53bebafc22 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:27.089688 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 389/749] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Aug 18 10:50:26 2022] POST /identity/v3/services => generated 251 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 10:50:27.089688 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91984c22-9542-4c36-b435-2f53bebafc22 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:27.107116 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64001af-8d91-4cce-b48b-98f3c6408681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:27.107820 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64001af-8d91-4cce-b48b-98f3c6408681 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:27.108107 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64001af-8d91-4cce-b48b-98f3c6408681 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:27.108438 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64001af-8d91-4cce-b48b-98f3c6408681 None admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:27.109783 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64001af-8d91-4cce-b48b-98f3c6408681 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:27.110098 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64001af-8d91-4cce-b48b-98f3c6408681 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:27.112064 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64001af-8d91-4cce-b48b-98f3c6408681 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:27.119741 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:27.137691 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 361/750] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 18 10:50:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:27.138903 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64001af-8d91-4cce-b48b-98f3c6408681 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:27.238415 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91984c22-9542-4c36-b435-2f53bebafc22 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:27.284667 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef8322c-e36c-47af-a068-87a64ecd8ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:27.286203 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef8322c-e36c-47af-a068-87a64ecd8ebf None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:27.286203 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef8322c-e36c-47af-a068-87a64ecd8ebf None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:27.286404 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef8322c-e36c-47af-a068-87a64ecd8ebf None admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:27.287165 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef8322c-e36c-47af-a068-87a64ecd8ebf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:27.287476 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef8322c-e36c-47af-a068-87a64ecd8ebf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:27.287957 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64001af-8d91-4cce-b48b-98f3c6408681 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:27.289390 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef8322c-e36c-47af-a068-87a64ecd8ebf None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:27.305148 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 390/751] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 18 10:50:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:27.305893 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef8322c-e36c-47af-a068-87a64ecd8ebf None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:27.344408 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a053deac-505a-4b98-b4ae-93a11a7ab5dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:27.345362 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a053deac-505a-4b98-b4ae-93a11a7ab5dc None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:27.345806 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a053deac-505a-4b98-b4ae-93a11a7ab5dc None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:27.346207 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a053deac-505a-4b98-b4ae-93a11a7ab5dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:27.360490 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a053deac-505a-4b98-b4ae-93a11a7ab5dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:27.362568 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a053deac-505a-4b98-b4ae-93a11a7ab5dc None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:27.382990 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-a053deac-505a-4b98-b4ae-93a11a7ab5dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:27.382990 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:27.382990 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:27.382990 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:27.382990 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:27.382990 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:27.382990 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:27.382990 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:27.382990 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:27.382990 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:27.382990 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:27.382990 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:27.382990 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 10:50:27.382990 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 10:50:27.382990 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 10:50:27.382990 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 10:50:27.384040 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:27.384040 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:27.384040 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:27.384040 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:27.384040 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:27.384040 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:27.384040 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:27.384040 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:27.384040 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:27.384040 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:27.384040 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:27.384040 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:27.384040 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:27.384040 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:27.384040 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:27.384040 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:27.384040 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 10:50:27.384955 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 10:50:27.384955 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:27.384955 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:27.384955 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 362/752] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:50:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:27.385892 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a053deac-505a-4b98-b4ae-93a11a7ab5dc None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:27.395324 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:27.421078 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:27.424680 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef8322c-e36c-47af-a068-87a64ecd8ebf None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:27.463465 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b60e39-19e2-4f1f-9ea0-892e0aac3114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:27.464289 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b60e39-19e2-4f1f-9ea0-892e0aac3114 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:27.464676 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b60e39-19e2-4f1f-9ea0-892e0aac3114 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:27.465053 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b60e39-19e2-4f1f-9ea0-892e0aac3114 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:27.472610 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b60e39-19e2-4f1f-9ea0-892e0aac3114 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:27.474308 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b60e39-19e2-4f1f-9ea0-892e0aac3114 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:27.486777 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-16b60e39-19e2-4f1f-9ea0-892e0aac3114 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 10:50:27.486777 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:27.486777 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:27.486777 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:27.486777 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:27.486777 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:27.486777 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:27.486777 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:27.486777 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:27.486777 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:27.486777 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:27.486777 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:27.486777 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 10:50:27.486777 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 10:50:27.486777 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 10:50:27.489062 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 10:50:27.489062 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:27.489062 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:27.489062 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:27.489062 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:27.489062 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:27.489062 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:27.489062 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:27.489062 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:27.489062 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:27.489062 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:27.489062 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:27.489062 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:27.489062 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:27.489062 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:27.489062 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:27.489062 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:27.491246 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 10:50:27.491246 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 10:50:27.491246 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 10:50:27.491246 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 10:50:27.491246 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 10:50:27.491246 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 10:50:27.491246 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 10:50:27.491246 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:27.495438 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 391/753] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 18 10:50:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:27.495438 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b60e39-19e2-4f1f-9ea0-892e0aac3114 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:27.506239 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a053deac-505a-4b98-b4ae-93a11a7ab5dc None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:27.544888 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b0a1c2-3de8-4cc9-8e3c-99badf22a61c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:27.545534 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b0a1c2-3de8-4cc9-8e3c-99badf22a61c None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:27.545819 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b0a1c2-3de8-4cc9-8e3c-99badf22a61c None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:27.546091 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b0a1c2-3de8-4cc9-8e3c-99badf22a61c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:27.555979 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b0a1c2-3de8-4cc9-8e3c-99badf22a61c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:27.557670 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b0a1c2-3de8-4cc9-8e3c-99badf22a61c None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:27.570154 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-f3b0a1c2-3de8-4cc9-8e3c-99badf22a61c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 10:50:27.570154 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:27.570154 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:27.570154 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:27.570154 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:27.570154 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:27.570154 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:27.570154 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:27.570154 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:27.570154 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:27.570154 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:27.570154 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:27.570154 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 10:50:27.570154 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 10:50:27.570154 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 10:50:27.570154 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 10:50:27.572325 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:27.572325 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:27.572325 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 10:50:27.572325 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 10:50:27.572325 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 10:50:27.572325 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 10:50:27.572325 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:27.572325 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:27.572325 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:27.572325 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:27.572325 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:27.572325 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:27.572325 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:27.572325 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:27.572325 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:27.572325 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:27.572325 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:27.572325 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:27.574688 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:27.574688 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:27.574688 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 10:50:27.574688 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 10:50:27.574688 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 10:50:27.574688 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 10:50:27.574688 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 10:50:27.574688 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 10:50:27.574688 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 10:50:27.574688 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:27.574688 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 363/754] 10.222.0.15 () {56 vars in 1093 bytes} [Thu Aug 18 10:50:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:27.574688 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b0a1c2-3de8-4cc9-8e3c-99badf22a61c None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:27.606972 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b60e39-19e2-4f1f-9ea0-892e0aac3114 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:27.643135 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31aac70-e0fc-4c25-9818-f1fea6bfb98b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:27.643796 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31aac70-e0fc-4c25-9818-f1fea6bfb98b None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:27.644081 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31aac70-e0fc-4c25-9818-f1fea6bfb98b None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:27.644356 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31aac70-e0fc-4c25-9818-f1fea6bfb98b None admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:27.645018 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31aac70-e0fc-4c25-9818-f1fea6bfb98b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:27.645317 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31aac70-e0fc-4c25-9818-f1fea6bfb98b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:27.646732 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31aac70-e0fc-4c25-9818-f1fea6bfb98b None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:27.650448 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:27.661167 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 392/755] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 18 10:50:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:27.662347 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31aac70-e0fc-4c25-9818-f1fea6bfb98b None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:27.669431 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:27.687943 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b0a1c2-3de8-4cc9-8e3c-99badf22a61c None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:27.726458 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8712fb49-33d3-407d-b540-e7b3005ec681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:27.727353 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8712fb49-33d3-407d-b540-e7b3005ec681 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:27.727900 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8712fb49-33d3-407d-b540-e7b3005ec681 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:27.728430 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8712fb49-33d3-407d-b540-e7b3005ec681 None admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:27.729408 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8712fb49-33d3-407d-b540-e7b3005ec681 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:27.729913 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8712fb49-33d3-407d-b540-e7b3005ec681 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:27.731564 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8712fb49-33d3-407d-b540-e7b3005ec681 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:27.747004 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 364/756] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Aug 18 10:50:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:27.748091 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8712fb49-33d3-407d-b540-e7b3005ec681 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:27.793557 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31aac70-e0fc-4c25-9818-f1fea6bfb98b None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:27.835732 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2664a96-1b18-41f5-8da7-8dd5674be2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:27.836522 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2664a96-1b18-41f5-8da7-8dd5674be2c8 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:27.836901 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2664a96-1b18-41f5-8da7-8dd5674be2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:27.837277 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2664a96-1b18-41f5-8da7-8dd5674be2c8 None admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:27.838184 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2664a96-1b18-41f5-8da7-8dd5674be2c8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:27.838787 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2664a96-1b18-41f5-8da7-8dd5674be2c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:27.840221 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2664a96-1b18-41f5-8da7-8dd5674be2c8 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:27.865109 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 393/757] 10.222.0.15 () {56 vars in 1133 bytes} [Thu Aug 18 10:50:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:27.865465 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8712fb49-33d3-407d-b540-e7b3005ec681 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:27.866829 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2664a96-1b18-41f5-8da7-8dd5674be2c8 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:27.904685 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3248aa0e-9cb5-443a-b00d-3756c082c2b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:27.905718 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248aa0e-9cb5-443a-b00d-3756c082c2b4 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:27.906268 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248aa0e-9cb5-443a-b00d-3756c082c2b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:27.906774 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248aa0e-9cb5-443a-b00d-3756c082c2b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:27.914882 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3248aa0e-9cb5-443a-b00d-3756c082c2b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:27.916674 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3248aa0e-9cb5-443a-b00d-3756c082c2b4 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:27.928335 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:27.930455 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-3248aa0e-9cb5-443a-b00d-3756c082c2b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 10:50:27.930455 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:27.930455 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:27.930455 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:27.930455 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:27.930455 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:27.930455 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:27.930455 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:27.930455 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:27.930455 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:27.930455 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:27.930455 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:27.930455 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 10:50:27.930455 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 10:50:27.930455 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 10:50:27.931323 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 10:50:27.931323 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:27.931323 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:27.931323 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:27.931323 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:27.931323 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:27.931323 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:27.931323 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:27.931323 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:27.931323 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:27.931323 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:27.931323 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:27.931323 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:27.931323 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:27.931323 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:27.931323 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:27.931323 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:27.932195 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 10:50:27.932195 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 10:50:27.932195 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 10:50:27.932195 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 10:50:27.932195 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 10:50:27.932195 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 10:50:27.932195 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 10:50:27.932195 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:27.934512 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 365/758] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 18 10:50:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:27.935509 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3248aa0e-9cb5-443a-b00d-3756c082c2b4 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:27.939599 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:27.980163 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2664a96-1b18-41f5-8da7-8dd5674be2c8 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:28.018608 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce6968a-55bc-4c56-9ac4-ebfd78c0290b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:28.019475 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce6968a-55bc-4c56-9ac4-ebfd78c0290b None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:28.020011 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce6968a-55bc-4c56-9ac4-ebfd78c0290b None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:28.020462 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce6968a-55bc-4c56-9ac4-ebfd78c0290b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:28.021336 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce6968a-55bc-4c56-9ac4-ebfd78c0290b None admin] RBAC: Adding query filter params (role.id=127fdc7ef05b4e0b98a940b334e5fcab, scope.project.id=1575e8ebaaab4650995841659b6e631b, user.id=f97e906b1922419d8511ab1c8b9c86e4) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:28.021940 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce6968a-55bc-4c56-9ac4-ebfd78c0290b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:28.023986 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce6968a-55bc-4c56-9ac4-ebfd78c0290b None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:28.030518 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 394/759] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Aug 18 10:50:27 2022] GET /identity/v3/role_assignments?user.id=f97e906b1922419d8511ab1c8b9c86e4&scope.project.id=1575e8ebaaab4650995841659b6e631b&role.id=127fdc7ef05b4e0b98a940b334e5fcab => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:28.031520 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce6968a-55bc-4c56-9ac4-ebfd78c0290b None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:28.046138 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3248aa0e-9cb5-443a-b00d-3756c082c2b4 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:28.088704 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1689ca09-98cf-42d6-bd67-6dd8a1259442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:28.089578 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1689ca09-98cf-42d6-bd67-6dd8a1259442 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:28.089955 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1689ca09-98cf-42d6-bd67-6dd8a1259442 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:28.090320 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1689ca09-98cf-42d6-bd67-6dd8a1259442 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:28.109561 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1689ca09-98cf-42d6-bd67-6dd8a1259442 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:28.109561 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1689ca09-98cf-42d6-bd67-6dd8a1259442 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:28.126585 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-1689ca09-98cf-42d6-bd67-6dd8a1259442 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:28.126585 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:28.126585 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:28.126585 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:28.126585 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:28.126585 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:28.126585 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:28.126585 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:28.126585 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:28.126585 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:28.126585 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:28.126585 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:28.126585 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 10:50:28.126585 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 10:50:28.126585 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 10:50:28.126585 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 10:50:28.127798 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:28.127798 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:28.127798 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:28.127798 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:28.127798 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:28.127798 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:28.127798 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:28.127798 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:28.127798 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:28.127798 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:28.127798 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:28.127798 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:28.127798 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:28.127798 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:28.127798 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:28.127798 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:28.127798 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 10:50:28.128930 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 10:50:28.128930 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:28.128930 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:28.130311 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 366/760] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:50:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:28.141545 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1689ca09-98cf-42d6-bd67-6dd8a1259442 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:28.203830 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:28.253502 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce6968a-55bc-4c56-9ac4-ebfd78c0290b None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:28.266845 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1689ca09-98cf-42d6-bd67-6dd8a1259442 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:28.274368 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:28.310212 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e16b712-e4cf-4d7e-ada9-abf0ce0a659b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:28.311249 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e16b712-e4cf-4d7e-ada9-abf0ce0a659b None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:28.311530 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e16b712-e4cf-4d7e-ada9-abf0ce0a659b None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:28.311804 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e16b712-e4cf-4d7e-ada9-abf0ce0a659b None admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:28.312458 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e16b712-e4cf-4d7e-ada9-abf0ce0a659b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:28.312760 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e16b712-e4cf-4d7e-ada9-abf0ce0a659b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:28.314195 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e16b712-e4cf-4d7e-ada9-abf0ce0a659b None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:28.331058 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 367/761] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 18 10:50:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 10:50:28.337749 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e16b712-e4cf-4d7e-ada9-abf0ce0a659b None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:28.342310 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6122e53f-a883-4172-83ff-b789bb443194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:28.342937 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6122e53f-a883-4172-83ff-b789bb443194 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:28.343215 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6122e53f-a883-4172-83ff-b789bb443194 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:28.343485 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6122e53f-a883-4172-83ff-b789bb443194 None admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:28.344185 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6122e53f-a883-4172-83ff-b789bb443194 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:28.344512 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6122e53f-a883-4172-83ff-b789bb443194 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:28.345996 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6122e53f-a883-4172-83ff-b789bb443194 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:28.373622 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 395/762] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Aug 18 10:50:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:28.383556 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6122e53f-a883-4172-83ff-b789bb443194 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:28.552790 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e16b712-e4cf-4d7e-ada9-abf0ce0a659b None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:28.589566 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:28.595221 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6122e53f-a883-4172-83ff-b789bb443194 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:28.627648 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9237e3-0eed-4f63-b1a8-f41925952435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:28.628286 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9237e3-0eed-4f63-b1a8-f41925952435 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:28.628560 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9237e3-0eed-4f63-b1a8-f41925952435 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:28.628829 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9237e3-0eed-4f63-b1a8-f41925952435 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:28.643845 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9237e3-0eed-4f63-b1a8-f41925952435 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:28.645541 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9237e3-0eed-4f63-b1a8-f41925952435 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:28.666086 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-fc9237e3-0eed-4f63-b1a8-f41925952435 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 10:50:28.666086 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:28.666086 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:28.666086 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:28.666086 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:28.666086 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:28.666086 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:28.666086 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:28.666086 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:28.666086 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:28.666086 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:28.666086 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:28.666086 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 10:50:28.666086 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 10:50:28.666086 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 10:50:28.667226 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 10:50:28.667226 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:28.667226 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:28.667226 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:28.667226 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:28.667226 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:28.667226 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:28.667226 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:28.667226 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:28.667226 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:28.667226 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:28.667226 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:28.667226 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:28.667226 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:28.667226 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:28.667226 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:28.667226 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:28.668332 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 10:50:28.668332 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 10:50:28.668332 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 10:50:28.668332 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 10:50:28.668332 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 10:50:28.668332 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 10:50:28.668332 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 10:50:28.668332 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:28.670502 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0404f3f0-2307-4f6b-b5a1-c8ee9a8ae0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:28.671298 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0404f3f0-2307-4f6b-b5a1-c8ee9a8ae0cc None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:28.671735 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0404f3f0-2307-4f6b-b5a1-c8ee9a8ae0cc None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:28.672264 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0404f3f0-2307-4f6b-b5a1-c8ee9a8ae0cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:28.673143 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0404f3f0-2307-4f6b-b5a1-c8ee9a8ae0cc None admin] RBAC: Adding query filter params (role.id=13bffd536e214d0893b3007e267f3301, scope.project.id=1575e8ebaaab4650995841659b6e631b, user.id=bcacf809f13043ab90716607160a70db) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:28.673619 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0404f3f0-2307-4f6b-b5a1-c8ee9a8ae0cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:28.675200 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0404f3f0-2307-4f6b-b5a1-c8ee9a8ae0cc None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:28.678226 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 368/763] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 18 10:50:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 10:50:28.683536 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 396/764] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Aug 18 10:50:28 2022] GET /identity/v3/role_assignments?user.id=bcacf809f13043ab90716607160a70db&scope.project.id=1575e8ebaaab4650995841659b6e631b&role.id=13bffd536e214d0893b3007e267f3301 => generated 259 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:28.684649 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9237e3-0eed-4f63-b1a8-f41925952435 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:28.692445 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ee35cc-d5ac-4491-bcf2-88f33d532362 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:28.694065 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ee35cc-d5ac-4491-bcf2-88f33d532362 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:28.695178 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ee35cc-d5ac-4491-bcf2-88f33d532362 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:28.702015 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 397/765] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:50:28 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:50:28.711640 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8201c5-d8b4-4a28-ab39-6abf6e165e67 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:28.712314 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8201c5-d8b4-4a28-ab39-6abf6e165e67 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:28.712830 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8201c5-d8b4-4a28-ab39-6abf6e165e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:28.746179 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-1b8201c5-d8b4-4a28-ab39-6abf6e165e67 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:50:28.747946 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-1b8201c5-d8b4-4a28-ab39-6abf6e165e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:50:28.836489 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:28.888508 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9237e3-0eed-4f63-b1a8-f41925952435 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:28.917415 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 398/766] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:50:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 10:50:28.942811 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917d6254-f382-4a72-b0af-3a9689a8ef5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:28.943433 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d6254-f382-4a72-b0af-3a9689a8ef5a None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:28.943717 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d6254-f382-4a72-b0af-3a9689a8ef5a None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:28.943993 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d6254-f382-4a72-b0af-3a9689a8ef5a None admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:28.946076 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917d6254-f382-4a72-b0af-3a9689a8ef5a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:28.946400 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917d6254-f382-4a72-b0af-3a9689a8ef5a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:28.947858 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917d6254-f382-4a72-b0af-3a9689a8ef5a None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:28.964509 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 369/767] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Aug 18 10:50:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:28.970358 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8201c5-d8b4-4a28-ab39-6abf6e165e67 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:29.122255 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8201c5-d8b4-4a28-ab39-6abf6e165e67 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:29.179731 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252fe5ca-5db5-4695-957c-b73ba95c4d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:29.180775 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252fe5ca-5db5-4695-957c-b73ba95c4d80 None admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:29.181260 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252fe5ca-5db5-4695-957c-b73ba95c4d80 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:29.181759 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252fe5ca-5db5-4695-957c-b73ba95c4d80 None admin] PATH_INFO: `/v3/projects/1575e8ebaaab4650995841659b6e631b/users/a005d8f0c46d44c7b6f2201a54717b12/roles/127fdc7ef05b4e0b98a940b334e5fcab` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:29.183990 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252fe5ca-5db5-4695-957c-b73ba95c4d80 None admin] RBAC: Authorizing `identity:create_grant(project_id=1575e8ebaaab4650995841659b6e631b, user_id=a005d8f0c46d44c7b6f2201a54717b12, role_id=127fdc7ef05b4e0b98a940b334e5fcab)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:29.185681 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252fe5ca-5db5-4695-957c-b73ba95c4d80 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:29.219872 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 399/768] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Aug 18 10:50:28 2022] PUT /identity/v3/projects/1575e8ebaaab4650995841659b6e631b/users/a005d8f0c46d44c7b6f2201a54717b12/roles/127fdc7ef05b4e0b98a940b334e5fcab => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 10:50:29.305245 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b06041-4e2a-4469-99b7-759e8bdf4627 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:29.305490 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b06041-4e2a-4469-99b7-759e8bdf4627 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:29.305757 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b06041-4e2a-4469-99b7-759e8bdf4627 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:29.307563 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 370/769] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:50:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:50:29.313453 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e960410d-2e46-419d-b1c1-541d6801fe01 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:29.313806 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e960410d-2e46-419d-b1c1-541d6801fe01 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:29.314049 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e960410d-2e46-419d-b1c1-541d6801fe01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:29.334508 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-e960410d-2e46-419d-b1c1-541d6801fe01 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:50:29.336652 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-e960410d-2e46-419d-b1c1-541d6801fe01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:50:29.358563 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b06041-4e2a-4469-99b7-759e8bdf4627 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:29.378372 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:29.425951 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:29.449301 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 400/770] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:50:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 10:50:29.500751 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b06041-4e2a-4469-99b7-759e8bdf4627 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:29.547678 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99508f1c-ba1a-4f11-8f4f-c42f7264a729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:29.548364 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99508f1c-ba1a-4f11-8f4f-c42f7264a729 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:29.548641 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99508f1c-ba1a-4f11-8f4f-c42f7264a729 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:29.548915 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99508f1c-ba1a-4f11-8f4f-c42f7264a729 None admin] PATH_INFO: `/v3/services/network` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:29.549496 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99508f1c-ba1a-4f11-8f4f-c42f7264a729 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:29.550941 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99508f1c-ba1a-4f11-8f4f-c42f7264a729 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:29.561692 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-99508f1c-ba1a-4f11-8f4f-c42f7264a729 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 10:50:29.561692 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:29.561692 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 10:50:29.561692 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 10:50:29.561692 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 10:50:29.561692 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 10:50:29.561692 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 10:50:29.561692 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 10:50:29.561692 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 10:50:29.561692 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:29.561692 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 10:50:29.561692 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:29.561692 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:29.561692 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:29.561692 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:29.561692 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:29.561692 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:29.564417 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:29.564417 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:29.564417 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:29.564417 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:29.564417 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:29.564417 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:29.564417 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 10:50:29.564417 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 10:50:29.564417 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 10:50:29.564417 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 10:50:29.564417 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:29.564417 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:29.564417 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:29.564417 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:29.564417 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:29.564417 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:29.565253 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:29.565253 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:29.565253 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:29.565253 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:29.565253 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:29.565253 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:29.565253 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:29.565253 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:29.565253 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:29.565253 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:29.565253 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 10:50:29.565253 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 10:50:29.565253 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 10:50:29.565253 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:29.565253 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 371/771] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 18 10:50:29 2022] GET /identity/v3/services/network => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:29.568945 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e960410d-2e46-419d-b1c1-541d6801fe01 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:29.701796 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e960410d-2e46-419d-b1c1-541d6801fe01 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:29.752972 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e43360-f333-450a-839c-fe4f6b7132ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:29.753619 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e43360-f333-450a-839c-fe4f6b7132ac None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:29.753906 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e43360-f333-450a-839c-fe4f6b7132ac None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:29.754179 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e43360-f333-450a-839c-fe4f6b7132ac None admin] PATH_INFO: `/v3/services` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:29.754823 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e43360-f333-450a-839c-fe4f6b7132ac None admin] RBAC: Adding query filter params (name=network) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:29.755125 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e43360-f333-450a-839c-fe4f6b7132ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:29.756575 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e43360-f333-450a-839c-fe4f6b7132ac None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:29.761972 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 401/772] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Aug 18 10:50:29 2022] GET /identity/v3/services?name=network => generated 124 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:29.767211 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99508f1c-ba1a-4f11-8f4f-c42f7264a729 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:29.874293 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:29.880764 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99508f1c-ba1a-4f11-8f4f-c42f7264a729 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:29.893037 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e43360-f333-450a-839c-fe4f6b7132ac None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:29.944065 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e974b-a7c2-4f64-9c3b-d867297d8548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:29.944863 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e974b-a7c2-4f64-9c3b-d867297d8548 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:29.945572 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e974b-a7c2-4f64-9c3b-d867297d8548 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:29.945797 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e974b-a7c2-4f64-9c3b-d867297d8548 None admin] PATH_INFO: `/v3/services` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:29.947310 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7e974b-a7c2-4f64-9c3b-d867297d8548 None admin] RBAC: Adding query filter params (type=network) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:29.947615 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7e974b-a7c2-4f64-9c3b-d867297d8548 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:29.949001 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7e974b-a7c2-4f64-9c3b-d867297d8548 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:29.952838 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:29.960788 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 372/773] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Aug 18 10:50:29 2022] GET /identity/v3/services?type=network => generated 350 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:29.968361 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e974b-a7c2-4f64-9c3b-d867297d8548 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:30.111629 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e974b-a7c2-4f64-9c3b-d867297d8548 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:30.129443 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e43360-f333-450a-839c-fe4f6b7132ac None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:30.153339 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cea074-5cd4-47d5-b719-06877ad514bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:30.153982 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cea074-5cd4-47d5-b719-06877ad514bd None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:30.154263 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cea074-5cd4-47d5-b719-06877ad514bd None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:30.154539 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cea074-5cd4-47d5-b719-06877ad514bd None admin] PATH_INFO: `/v3/endpoints` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:30.155314 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cea074-5cd4-47d5-b719-06877ad514bd None admin] RBAC: Adding query filter params (interface=public, service_id=514818c1126248c98c366ebb7e9fe51e, region_id=RegionOne) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:30.155624 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cea074-5cd4-47d5-b719-06877ad514bd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:30.157177 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cea074-5cd4-47d5-b719-06877ad514bd None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:30.172467 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 373/774] 10.222.0.15 () {56 vars in 1251 bytes} [Thu Aug 18 10:50:29 2022] GET /identity/v3/endpoints?service_id=514818c1126248c98c366ebb7e9fe51e&interface=public®ion_id=RegionOne => generated 194 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:30.177503 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cea074-5cd4-47d5-b719-06877ad514bd None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:30.270785 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171e078e-9fad-4f4d-b771-e5ea140920ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:30.271765 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e078e-9fad-4f4d-b771-e5ea140920ed None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:30.271765 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e078e-9fad-4f4d-b771-e5ea140920ed None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:30.271964 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:30.272050 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e078e-9fad-4f4d-b771-e5ea140920ed None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:30.273376 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171e078e-9fad-4f4d-b771-e5ea140920ed None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:30.279039 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171e078e-9fad-4f4d-b771-e5ea140920ed None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:30.299401 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cea074-5cd4-47d5-b719-06877ad514bd None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:30.307626 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-171e078e-9fad-4f4d-b771-e5ea140920ed None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 10:50:30.307626 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:30.307626 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 10:50:30.307626 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 10:50:30.307626 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 10:50:30.307626 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 10:50:30.307626 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 10:50:30.307626 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 10:50:30.307626 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 10:50:30.307626 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:30.307626 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 10:50:30.307626 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:30.307626 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:30.307626 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:30.307626 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:30.307626 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:30.307626 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:30.308629 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:30.308629 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:30.308629 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:30.308629 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:30.308629 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:30.308629 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:30.308629 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 10:50:30.308629 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 10:50:30.308629 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 10:50:30.308629 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 10:50:30.308629 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:30.308629 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:30.308629 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:30.308629 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:30.308629 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:30.308629 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:30.309459 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:30.309459 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:30.309459 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:30.309459 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:30.309459 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:30.309459 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:30.309459 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:30.309459 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:30.309459 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:30.309459 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:30.309459 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 10:50:30.309459 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 10:50:30.309459 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 10:50:30.309459 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:30.317956 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 402/775] 10.222.0.15 () {56 vars in 1129 bytes} [Thu Aug 18 10:50:29 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 425 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 10:50:30.330561 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171e078e-9fad-4f4d-b771-e5ea140920ed None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:30.345234 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9edad2-46eb-48a3-9818-14a225140f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:30.346066 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9edad2-46eb-48a3-9818-14a225140f8f None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:30.346475 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9edad2-46eb-48a3-9818-14a225140f8f None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:30.346822 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9edad2-46eb-48a3-9818-14a225140f8f None admin] PATH_INFO: `/v3/services` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:30.347570 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9edad2-46eb-48a3-9818-14a225140f8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:30.349557 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9edad2-46eb-48a3-9818-14a225140f8f None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:30.357853 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 374/776] 10.222.0.15 () {56 vars in 1087 bytes} [Thu Aug 18 10:50:30 2022] GET /identity/v3/services => generated 772 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:30.524021 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:30.530463 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171e078e-9fad-4f4d-b771-e5ea140920ed None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:30.571100 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285d8205-2fb4-4d0e-8014-f2153672b167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:30.571718 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285d8205-2fb4-4d0e-8014-f2153672b167 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:30.571997 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285d8205-2fb4-4d0e-8014-f2153672b167 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:30.572266 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285d8205-2fb4-4d0e-8014-f2153672b167 None admin] PATH_INFO: `/v3/services` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:30.572903 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285d8205-2fb4-4d0e-8014-f2153672b167 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:30.573202 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285d8205-2fb4-4d0e-8014-f2153672b167 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:30.574871 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285d8205-2fb4-4d0e-8014-f2153672b167 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:30.580384 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 403/777] 10.222.0.15 () {56 vars in 1124 bytes} [Thu Aug 18 10:50:30 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:30.587798 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9edad2-46eb-48a3-9818-14a225140f8f None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:30.644592 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a38fe-d4b8-4f5c-a582-c04d5196be1e None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:30.644893 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a38fe-d4b8-4f5c-a582-c04d5196be1e None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:30.645145 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a38fe-d4b8-4f5c-a582-c04d5196be1e None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:30.646951 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 404/778] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:50:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 10:50:30.659135 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c600a7-5ae6-4c7e-8108-a3d3ddf62415 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:30.659434 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c600a7-5ae6-4c7e-8108-a3d3ddf62415 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:30.659693 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c600a7-5ae6-4c7e-8108-a3d3ddf62415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:30.697349 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-67c600a7-5ae6-4c7e-8108-a3d3ddf62415 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:50:30.698102 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-67c600a7-5ae6-4c7e-8108-a3d3ddf62415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:50:30.708214 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:30.720045 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9edad2-46eb-48a3-9818-14a225140f8f None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:30.802181 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd180f1a-f50d-4b09-a518-792d72bf087b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:30.802722 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd180f1a-f50d-4b09-a518-792d72bf087b None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:30.804509 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd180f1a-f50d-4b09-a518-792d72bf087b None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:30.804793 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd180f1a-f50d-4b09-a518-792d72bf087b None admin] PATH_INFO: `/v3/services` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:30.805449 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd180f1a-f50d-4b09-a518-792d72bf087b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:30.805785 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd180f1a-f50d-4b09-a518-792d72bf087b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:30.807223 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd180f1a-f50d-4b09-a518-792d72bf087b None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:30.820264 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 375/779] 10.222.0.15 () {56 vars in 1124 bytes} [Thu Aug 18 10:50:30 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:30.828212 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd180f1a-f50d-4b09-a518-792d72bf087b None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:30.862877 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 405/780] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:50:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 10:50:31.025545 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd180f1a-f50d-4b09-a518-792d72bf087b None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:31.072017 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0bfc63-481d-4502-84b4-3f6b3148327e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:31.072986 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0bfc63-481d-4502-84b4-3f6b3148327e None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:31.073480 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0bfc63-481d-4502-84b4-3f6b3148327e None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:31.073974 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0bfc63-481d-4502-84b4-3f6b3148327e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:31.074872 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0bfc63-481d-4502-84b4-3f6b3148327e None admin] RBAC: Adding query filter params (interface=public, service_id=ad75107d55eb4d09b643f762aaad16f4, region_id=RegionOne) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:31.075374 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0bfc63-481d-4502-84b4-3f6b3148327e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:31.076948 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0bfc63-481d-4502-84b4-3f6b3148327e None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:31.083193 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 376/781] 10.222.0.15 () {56 vars in 1251 bytes} [Thu Aug 18 10:50:30 2022] GET /identity/v3/endpoints?service_id=ad75107d55eb4d09b643f762aaad16f4&interface=public®ion_id=RegionOne => generated 194 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:31.090267 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c600a7-5ae6-4c7e-8108-a3d3ddf62415 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:31.135024 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00075e91-6454-4df3-ae73-2a0807c0a5bb None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:31.135024 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00075e91-6454-4df3-ae73-2a0807c0a5bb None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:31.135309 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00075e91-6454-4df3-ae73-2a0807c0a5bb None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:31.136892 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 377/782] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:50:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:50:31.142066 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be62c42c-40cb-4985-bd72-3b0c36e69a1d None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:31.142354 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be62c42c-40cb-4985-bd72-3b0c36e69a1d None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:31.142631 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be62c42c-40cb-4985-bd72-3b0c36e69a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:31.166260 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-be62c42c-40cb-4985-bd72-3b0c36e69a1d None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:50:31.167489 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-be62c42c-40cb-4985-bd72-3b0c36e69a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:50:31.200447 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:31.273915 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 378/783] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:50:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 10:50:31.275075 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be62c42c-40cb-4985-bd72-3b0c36e69a1d None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:31.283095 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:31.325571 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c600a7-5ae6-4c7e-8108-a3d3ddf62415 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:31.428418 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be62c42c-40cb-4985-bd72-3b0c36e69a1d None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:31.438320 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91d8140-b344-42de-91f6-53eeb6eca741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:31.438954 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d8140-b344-42de-91f6-53eeb6eca741 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:31.439237 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d8140-b344-42de-91f6-53eeb6eca741 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:31.439516 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d8140-b344-42de-91f6-53eeb6eca741 None admin] PATH_INFO: `/v3/services` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:31.440138 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91d8140-b344-42de-91f6-53eeb6eca741 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:31.441539 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91d8140-b344-42de-91f6-53eeb6eca741 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:31.460817 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 406/784] 10.222.0.15 () {56 vars in 1087 bytes} [Thu Aug 18 10:50:31 2022] GET /identity/v3/services => generated 772 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:31.468707 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ab71f3-0fd4-4644-98d2-296c9bc065f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:31.469375 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab71f3-0fd4-4644-98d2-296c9bc065f4 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:31.469753 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab71f3-0fd4-4644-98d2-296c9bc065f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:31.470036 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab71f3-0fd4-4644-98d2-296c9bc065f4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:31.484531 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ab71f3-0fd4-4644-98d2-296c9bc065f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:50:31.489697 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-07ab71f3-0fd4-4644-98d2-296c9bc065f4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 10:50:31.489697 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:31.489697 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:31.489697 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:31.489697 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:31.489697 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:31.489697 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:31.489697 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:31.489697 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:31.489697 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:31.489697 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:31.489697 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:31.489697 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:50:31.489697 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:50:31.489697 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:50:31.489697 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:50:31.490691 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:50:31.490691 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:50:31.490691 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:50:31.490691 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:50:31.490691 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:31.490691 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:31.490691 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:31.490691 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:31.490691 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:31.490691 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:31.490691 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:31.490691 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:31.490691 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:31.490691 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:31.490691 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:31.490691 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:31.491959 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:31.491959 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:31.491959 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:31.491959 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:31.491959 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:50:31.491959 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:50:31.491959 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:50:31.491959 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:50:31.491959 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:50:31.491959 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:50:31.491959 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 10:50:31.491959 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:31.491959 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 379/785] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Aug 18 10:50:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:31.502710 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91d8140-b344-42de-91f6-53eeb6eca741 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:31.615671 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ab71f3-0fd4-4644-98d2-296c9bc065f4 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:31.646637 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:31.681093 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91d8140-b344-42de-91f6-53eeb6eca741 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:31.723931 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c617c1-119a-4aaf-a948-28371f392111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:31.724554 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c617c1-119a-4aaf-a948-28371f392111 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:31.724838 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c617c1-119a-4aaf-a948-28371f392111 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:31.725113 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c617c1-119a-4aaf-a948-28371f392111 None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:31.727727 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c617c1-119a-4aaf-a948-28371f392111 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:31.727727 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c617c1-119a-4aaf-a948-28371f392111 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:31.727727 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c617c1-119a-4aaf-a948-28371f392111 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:31.736969 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 407/786] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 18 10:50:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:31.742718 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c617c1-119a-4aaf-a948-28371f392111 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:31.756672 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:31.780093 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ab71f3-0fd4-4644-98d2-296c9bc065f4 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:31.871566 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c617c1-119a-4aaf-a948-28371f392111 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:31.909807 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2bc05c-b1c8-4f14-9faa-400aa3732ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:31.910603 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2bc05c-b1c8-4f14-9faa-400aa3732ade None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:31.910982 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2bc05c-b1c8-4f14-9faa-400aa3732ade None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:31.911364 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2bc05c-b1c8-4f14-9faa-400aa3732ade None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:31.924610 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2bc05c-b1c8-4f14-9faa-400aa3732ade None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:31.926454 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2bc05c-b1c8-4f14-9faa-400aa3732ade None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:31.942051 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-df2bc05c-b1c8-4f14-9faa-400aa3732ade None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:31.942051 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:31.942051 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:31.942051 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:31.942051 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:31.942051 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:31.942051 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:31.942051 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:31.942051 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:31.942051 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:31.942051 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:31.942051 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:31.942051 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 10:50:31.942051 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 10:50:31.942051 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 10:50:31.942051 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 10:50:31.943250 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:31.943250 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:31.943250 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:31.943250 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:31.943250 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:31.943250 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:31.943250 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:31.943250 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:31.943250 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:31.943250 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:31.943250 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:31.943250 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:31.943250 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:31.943250 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:31.943250 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:31.943250 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:31.943250 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 10:50:31.944440 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 10:50:31.944440 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:31.944440 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:31.947062 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 408/787] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:50:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:31.947179 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a1ed4d-4fcb-4ae1-a633-c5313064d2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:31.947179 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a1ed4d-4fcb-4ae1-a633-c5313064d2ee None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:31.947179 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a1ed4d-4fcb-4ae1-a633-c5313064d2ee None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:31.947179 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a1ed4d-4fcb-4ae1-a633-c5313064d2ee None admin] PATH_INFO: `/v3/roles/service` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:31.947468 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa30793-0e0d-41e8-918f-23d8c5fa3d9a None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:31.947468 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa30793-0e0d-41e8-918f-23d8c5fa3d9a None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:31.947468 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa30793-0e0d-41e8-918f-23d8c5fa3d9a None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:31.952520 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 409/788] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:50:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:50:31.953377 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa30793-0e0d-41e8-918f-23d8c5fa3d9a None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:31.963994 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a1ed4d-4fcb-4ae1-a633-c5313064d2ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:50:31.971924 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-89a1ed4d-4fcb-4ae1-a633-c5313064d2ee None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 10:50:31.971924 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:31.971924 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:31.971924 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:31.971924 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:31.971924 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:31.971924 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:31.971924 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:31.971924 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:31.971924 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:31.971924 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:31.971924 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:31.971924 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:50:31.971924 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:50:31.971924 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:50:31.971924 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:50:31.973076 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:50:31.973076 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:50:31.973076 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:50:31.973076 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:50:31.973076 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:31.973076 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:31.973076 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:31.973076 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:31.973076 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:31.973076 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:31.973076 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:31.973076 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:31.973076 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:31.973076 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:31.973076 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:31.973076 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:31.974202 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:31.974202 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:31.974202 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:31.974202 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:31.974202 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:50:31.974202 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:50:31.974202 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:50:31.974202 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:50:31.974202 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:50:31.974202 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:50:31.974202 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 10:50:31.974202 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:31.981117 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 380/789] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Aug 18 10:50:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 10:50:31.982806 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d37a8-ab13-4bb3-9b86-9a3a9618610b None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:31.983095 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d37a8-ab13-4bb3-9b86-9a3a9618610b None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:31.983429 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d37a8-ab13-4bb3-9b86-9a3a9618610b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:32.004800 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-7d0d37a8-ab13-4bb3-9b86-9a3a9618610b None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:50:32.006338 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-7d0d37a8-ab13-4bb3-9b86-9a3a9618610b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:50:32.021650 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:32.063587 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa30793-0e0d-41e8-918f-23d8c5fa3d9a None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:32.081312 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:32.096304 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 381/790] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:50:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 10:50:32.101592 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0d37a8-ab13-4bb3-9b86-9a3a9618610b None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:32.103599 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90f365d-5c6c-4764-b843-cbb619ae5d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:32.104389 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90f365d-5c6c-4764-b843-cbb619ae5d24 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:32.104677 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90f365d-5c6c-4764-b843-cbb619ae5d24 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:32.104951 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90f365d-5c6c-4764-b843-cbb619ae5d24 None admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:32.105804 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90f365d-5c6c-4764-b843-cbb619ae5d24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:32.106175 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90f365d-5c6c-4764-b843-cbb619ae5d24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:32.107670 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90f365d-5c6c-4764-b843-cbb619ae5d24 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:32.127415 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 410/791] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 18 10:50:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:32.134799 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90f365d-5c6c-4764-b843-cbb619ae5d24 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:32.307361 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0d37a8-ab13-4bb3-9b86-9a3a9618610b None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:32.339153 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90f365d-5c6c-4764-b843-cbb619ae5d24 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:32.377232 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:32.380134 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e139e380-ba8f-4dfa-8d6b-f42f55e093ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:32.381126 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e139e380-ba8f-4dfa-8d6b-f42f55e093ba None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:32.381993 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e139e380-ba8f-4dfa-8d6b-f42f55e093ba None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:32.382827 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e139e380-ba8f-4dfa-8d6b-f42f55e093ba None admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:32.383731 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e139e380-ba8f-4dfa-8d6b-f42f55e093ba None admin] RBAC: Adding query filter params (name=service) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:32.384372 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e139e380-ba8f-4dfa-8d6b-f42f55e093ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:32.386545 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e139e380-ba8f-4dfa-8d6b-f42f55e093ba None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:32.390196 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d03194-78e1-4c77-a9aa-601dce7f9b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:32.390832 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d03194-78e1-4c77-a9aa-601dce7f9b6b None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:32.391117 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d03194-78e1-4c77-a9aa-601dce7f9b6b None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:32.391393 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d03194-78e1-4c77-a9aa-601dce7f9b6b None admin] PATH_INFO: `/v3/users/swift` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:32.397226 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 382/792] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Aug 18 10:50:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:32.399573 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e139e380-ba8f-4dfa-8d6b-f42f55e093ba None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:32.399862 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d03194-78e1-4c77-a9aa-601dce7f9b6b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:32.401332 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d03194-78e1-4c77-a9aa-601dce7f9b6b None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:32.415061 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-95d03194-78e1-4c77-a9aa-601dce7f9b6b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 18 10:50:32.415061 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:32.415061 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:32.415061 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:32.415061 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:32.415061 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:32.415061 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:32.415061 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:32.415061 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:32.415061 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:32.415061 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:32.415061 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:32.415061 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 10:50:32.415061 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 10:50:32.415061 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 10:50:32.415061 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 10:50:32.416058 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:32.416058 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:32.416058 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 10:50:32.416058 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 10:50:32.416058 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 10:50:32.416058 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 10:50:32.416058 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:32.416058 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:32.416058 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:32.416058 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:32.416058 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:32.416058 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:32.416058 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:32.416058 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:32.416058 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:32.416058 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:32.416058 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:32.416058 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:32.417413 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:32.417413 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:32.417413 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 10:50:32.417413 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 10:50:32.417413 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 10:50:32.417413 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 10:50:32.417413 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 10:50:32.417413 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 10:50:32.417413 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 18 10:50:32.417413 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:32.417413 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 411/793] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Aug 18 10:50:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:32.417413 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d03194-78e1-4c77-a9aa-601dce7f9b6b None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:32.482025 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:32.540696 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d03194-78e1-4c77-a9aa-601dce7f9b6b None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:32.542689 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e139e380-ba8f-4dfa-8d6b-f42f55e093ba None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:32.579156 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0721835f-9b66-4c6d-bd83-c4afa9776ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:32.580277 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0721835f-9b66-4c6d-bd83-c4afa9776ac5 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:32.580754 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0721835f-9b66-4c6d-bd83-c4afa9776ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:32.581286 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0721835f-9b66-4c6d-bd83-c4afa9776ac5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:32.587034 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf49d175-d889-4e1e-9ace-1ee20f5a21cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:32.587684 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49d175-d889-4e1e-9ace-1ee20f5a21cb None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:32.587954 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49d175-d889-4e1e-9ace-1ee20f5a21cb None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:32.588247 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49d175-d889-4e1e-9ace-1ee20f5a21cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:32.595003 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0721835f-9b66-4c6d-bd83-c4afa9776ac5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:50:32.599938 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-0721835f-9b66-4c6d-bd83-c4afa9776ac5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 10:50:32.599938 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:32.599938 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:32.599938 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:32.599938 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:32.599938 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:32.599938 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:32.599938 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:32.599938 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:32.599938 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:32.599938 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:32.599938 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:32.599938 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:50:32.599938 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:50:32.599938 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:50:32.599938 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:50:32.601399 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:50:32.601399 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:50:32.601399 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:50:32.601399 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:50:32.601399 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:32.601399 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:32.601399 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:32.601399 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:32.601399 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:32.601399 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:32.601399 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:32.601399 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:32.601399 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:32.601399 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:32.601399 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:32.601399 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:32.602293 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:32.602293 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:32.602293 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:32.602293 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:32.602293 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:50:32.602293 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:50:32.602293 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:50:32.602293 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:50:32.602293 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:50:32.602293 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:50:32.602293 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 10:50:32.602293 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:32.603406 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf49d175-d889-4e1e-9ace-1ee20f5a21cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:32.604491 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf49d175-d889-4e1e-9ace-1ee20f5a21cb None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:32.610295 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 383/794] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Aug 18 10:50:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:32.611427 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0721835f-9b66-4c6d-bd83-c4afa9776ac5 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:32.627701 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-cf49d175-d889-4e1e-9ace-1ee20f5a21cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:32.627701 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:32.627701 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:32.627701 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:32.627701 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:32.627701 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:32.627701 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:32.627701 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:32.627701 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:32.627701 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:32.627701 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:32.627701 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:32.627701 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 10:50:32.627701 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 10:50:32.627701 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 10:50:32.627701 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 10:50:32.628698 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:32.628698 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:32.628698 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:32.628698 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:32.628698 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:32.628698 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:32.628698 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:32.628698 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:32.628698 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:32.628698 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:32.628698 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:32.628698 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:32.628698 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:32.628698 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:32.628698 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:32.628698 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:32.628698 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 10:50:32.630069 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 10:50:32.630069 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:32.630069 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:32.632014 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 412/795] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:50:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:32.633239 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf49d175-d889-4e1e-9ace-1ee20f5a21cb None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:32.670376 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:32.742257 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0721835f-9b66-4c6d-bd83-c4afa9776ac5 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:32.760314 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf49d175-d889-4e1e-9ace-1ee20f5a21cb None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:32.770151 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:32.784278 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbf4914-fbce-4625-a664-23ee68b6f1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:32.784884 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf4914-fbce-4625-a664-23ee68b6f1a7 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:32.785161 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf4914-fbce-4625-a664-23ee68b6f1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:32.785431 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf4914-fbce-4625-a664-23ee68b6f1a7 None admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:32.786616 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbf4914-fbce-4625-a664-23ee68b6f1a7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:32.786917 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbf4914-fbce-4625-a664-23ee68b6f1a7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:32.789213 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbf4914-fbce-4625-a664-23ee68b6f1a7 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:32.803400 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f9f3e-4bb8-4af4-808c-dc71a6f81209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:32.804648 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f9f3e-4bb8-4af4-808c-dc71a6f81209 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:32.804926 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f9f3e-4bb8-4af4-808c-dc71a6f81209 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:32.805295 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f9f3e-4bb8-4af4-808c-dc71a6f81209 None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:32.805910 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9f9f3e-4bb8-4af4-808c-dc71a6f81209 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:32.806890 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9f9f3e-4bb8-4af4-808c-dc71a6f81209 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:32.808291 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9f9f3e-4bb8-4af4-808c-dc71a6f81209 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:32.810497 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 384/796] 10.222.0.15 () {56 vars in 1135 bytes} [Thu Aug 18 10:50:32 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:32.811159 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbf4914-fbce-4625-a664-23ee68b6f1a7 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:32.825076 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 413/797] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 18 10:50:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:32.826566 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c965f460-ad36-4ecb-9d92-fc1a0c92dd5e None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:32.826728 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c965f460-ad36-4ecb-9d92-fc1a0c92dd5e None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:32.826987 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c965f460-ad36-4ecb-9d92-fc1a0c92dd5e None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:32.832114 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 414/798] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:50:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:50:32.832114 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c965f460-ad36-4ecb-9d92-fc1a0c92dd5e None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:32.930180 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbf4914-fbce-4625-a664-23ee68b6f1a7 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:32.937925 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:32.947506 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c965f460-ad36-4ecb-9d92-fc1a0c92dd5e None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:32.966832 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493290f4-932c-4489-b8ec-3fd5b914f142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:32.967432 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493290f4-932c-4489-b8ec-3fd5b914f142 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:32.967705 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493290f4-932c-4489-b8ec-3fd5b914f142 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:32.967979 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493290f4-932c-4489-b8ec-3fd5b914f142 None admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:32.968606 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493290f4-932c-4489-b8ec-3fd5b914f142 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:32.968903 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493290f4-932c-4489-b8ec-3fd5b914f142 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:32.970277 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493290f4-932c-4489-b8ec-3fd5b914f142 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:32.982328 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 385/799] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 18 10:50:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:32.982524 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4d9ab6-a8a1-40c5-90b1-9cafaa5dfb2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:32.982975 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d9ab6-a8a1-40c5-90b1-9cafaa5dfb2a None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:32.983250 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d9ab6-a8a1-40c5-90b1-9cafaa5dfb2a None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:32.983598 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d9ab6-a8a1-40c5-90b1-9cafaa5dfb2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:32.984312 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493290f4-932c-4489-b8ec-3fd5b914f142 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:32.998064 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4d9ab6-a8a1-40c5-90b1-9cafaa5dfb2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:33.000014 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4d9ab6-a8a1-40c5-90b1-9cafaa5dfb2a None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:33.016390 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-ba4d9ab6-a8a1-40c5-90b1-9cafaa5dfb2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:33.016390 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:33.016390 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:33.016390 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:33.016390 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:33.016390 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:33.016390 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:33.016390 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:33.016390 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:33.016390 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:33.016390 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:33.016390 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:33.016390 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 10:50:33.016390 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 10:50:33.016390 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 10:50:33.016390 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 10:50:33.017543 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:33.017543 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:33.017543 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:33.017543 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:33.017543 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:33.017543 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:33.017543 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:33.017543 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:33.017543 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:33.017543 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:33.017543 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:33.017543 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:33.017543 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:33.017543 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:33.017543 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:33.017543 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:33.017543 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 10:50:33.018429 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 10:50:33.018429 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:33.018429 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:33.018429 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 415/800] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:50:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:33.018984 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe0c178-715b-4452-b78e-03750c0f12bf None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:33.018984 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe0c178-715b-4452-b78e-03750c0f12bf None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:33.019330 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe0c178-715b-4452-b78e-03750c0f12bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:33.036345 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:33.039163 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-abe0c178-715b-4452-b78e-03750c0f12bf None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:50:33.040456 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-abe0c178-715b-4452-b78e-03750c0f12bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:50:33.109287 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493290f4-932c-4489-b8ec-3fd5b914f142 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:33.121572 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 416/801] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:50:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 10:50:33.121572 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe0c178-715b-4452-b78e-03750c0f12bf None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:33.158417 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49815d29-bb4f-4ba5-b582-89f935fe0316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:33.159259 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49815d29-bb4f-4ba5-b582-89f935fe0316 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:33.159608 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49815d29-bb4f-4ba5-b582-89f935fe0316 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:33.159952 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49815d29-bb4f-4ba5-b582-89f935fe0316 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:33.172161 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49815d29-bb4f-4ba5-b582-89f935fe0316 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:33.173886 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49815d29-bb4f-4ba5-b582-89f935fe0316 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:33.190216 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-49815d29-bb4f-4ba5-b582-89f935fe0316 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:33.190216 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:33.190216 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:33.190216 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:33.190216 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:33.190216 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:33.190216 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:33.190216 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:33.190216 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:33.190216 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:33.190216 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:33.190216 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:33.190216 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 10:50:33.190216 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 10:50:33.190216 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 10:50:33.190216 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 10:50:33.191376 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:33.191376 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:33.191376 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:33.191376 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:33.191376 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:33.191376 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:33.191376 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:33.191376 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:33.191376 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:33.191376 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:33.191376 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:33.191376 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:33.191376 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:33.191376 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:33.191376 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:33.191376 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:33.191376 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 10:50:33.192501 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 10:50:33.192501 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:33.192501 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:33.193323 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 386/802] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:50:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:33.199096 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49815d29-bb4f-4ba5-b582-89f935fe0316 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:33.219922 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:33.245619 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe0c178-715b-4452-b78e-03750c0f12bf None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:33.282829 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88886f7f-bade-4e0d-80b8-bf0667de8c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:33.283773 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88886f7f-bade-4e0d-80b8-bf0667de8c58 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:33.284313 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88886f7f-bade-4e0d-80b8-bf0667de8c58 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:33.284780 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88886f7f-bade-4e0d-80b8-bf0667de8c58 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:33.293703 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88886f7f-bade-4e0d-80b8-bf0667de8c58 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:33.295329 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88886f7f-bade-4e0d-80b8-bf0667de8c58 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:33.311977 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-88886f7f-bade-4e0d-80b8-bf0667de8c58 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 10:50:33.311977 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:33.311977 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:33.311977 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:33.311977 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:33.311977 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:33.311977 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:33.311977 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:33.311977 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:33.311977 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:33.311977 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:33.311977 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:33.311977 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 10:50:33.311977 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 10:50:33.311977 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 10:50:33.311977 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 10:50:33.313164 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:33.313164 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:33.313164 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 10:50:33.313164 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 10:50:33.313164 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 10:50:33.313164 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 10:50:33.313164 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:33.313164 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:33.313164 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:33.313164 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:33.313164 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:33.313164 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:33.313164 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:33.313164 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:33.313164 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:33.313164 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:33.313164 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:33.313164 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:33.314225 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:33.314225 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:33.314225 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 10:50:33.314225 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 10:50:33.314225 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 10:50:33.314225 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 10:50:33.314225 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 10:50:33.314225 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 10:50:33.314225 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 10:50:33.314225 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:33.316484 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 417/803] 10.222.0.15 () {56 vars in 1117 bytes} [Thu Aug 18 10:50:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:33.317569 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88886f7f-bade-4e0d-80b8-bf0667de8c58 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:33.323556 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:33.332758 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49815d29-bb4f-4ba5-b582-89f935fe0316 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:33.370848 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf37e26-77fe-456d-9464-1ad22b6dd2df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:33.371479 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf37e26-77fe-456d-9464-1ad22b6dd2df None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:33.371759 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf37e26-77fe-456d-9464-1ad22b6dd2df None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:33.372031 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf37e26-77fe-456d-9464-1ad22b6dd2df None admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:33.372671 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf37e26-77fe-456d-9464-1ad22b6dd2df None admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:33.372972 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf37e26-77fe-456d-9464-1ad22b6dd2df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:33.374467 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf37e26-77fe-456d-9464-1ad22b6dd2df None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:33.391935 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 387/804] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 18 10:50:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:33.392954 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf37e26-77fe-456d-9464-1ad22b6dd2df None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:33.433799 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88886f7f-bade-4e0d-80b8-bf0667de8c58 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:33.470394 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e9ae91-b311-4eaa-863c-d6792a1667e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:33.471357 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e9ae91-b311-4eaa-863c-d6792a1667e1 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:33.471855 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e9ae91-b311-4eaa-863c-d6792a1667e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:33.472323 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e9ae91-b311-4eaa-863c-d6792a1667e1 None admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:33.473289 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e9ae91-b311-4eaa-863c-d6792a1667e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:33.473813 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e9ae91-b311-4eaa-863c-d6792a1667e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:33.475528 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e9ae91-b311-4eaa-863c-d6792a1667e1 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:33.484037 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:33.491850 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 418/805] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 18 10:50:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:33.493137 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e9ae91-b311-4eaa-863c-d6792a1667e1 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:33.504468 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf37e26-77fe-456d-9464-1ad22b6dd2df None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:33.543163 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c4caa8-632c-4e03-b18e-db8c4042dc47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:33.543786 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c4caa8-632c-4e03-b18e-db8c4042dc47 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:33.544065 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c4caa8-632c-4e03-b18e-db8c4042dc47 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:33.544513 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c4caa8-632c-4e03-b18e-db8c4042dc47 None admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:33.545277 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c4caa8-632c-4e03-b18e-db8c4042dc47 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:33.545612 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c4caa8-632c-4e03-b18e-db8c4042dc47 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:33.547296 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c4caa8-632c-4e03-b18e-db8c4042dc47 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:33.568339 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 388/806] 10.222.0.15 () {56 vars in 1149 bytes} [Thu Aug 18 10:50:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:33.569177 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c4caa8-632c-4e03-b18e-db8c4042dc47 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:33.582741 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:33.609483 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e9ae91-b311-4eaa-863c-d6792a1667e1 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:33.683242 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c4caa8-632c-4e03-b18e-db8c4042dc47 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:33.721830 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f742cd41-93b4-40d7-b0dd-6e5d01100b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:33.722367 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f742cd41-93b4-40d7-b0dd-6e5d01100b61 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:33.722642 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f742cd41-93b4-40d7-b0dd-6e5d01100b61 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:33.722910 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f742cd41-93b4-40d7-b0dd-6e5d01100b61 None admin] PATH_INFO: `/v3/services/network` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:33.723490 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f742cd41-93b4-40d7-b0dd-6e5d01100b61 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:33.724858 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f742cd41-93b4-40d7-b0dd-6e5d01100b61 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:33.733814 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-f742cd41-93b4-40d7-b0dd-6e5d01100b61 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 10:50:33.733814 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:33.733814 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 10:50:33.733814 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 10:50:33.733814 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 10:50:33.733814 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 10:50:33.733814 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 10:50:33.733814 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 10:50:33.733814 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 10:50:33.733814 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:33.733814 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 10:50:33.733814 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:33.733814 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:33.733814 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:33.733814 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:33.733814 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:33.733814 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:33.734869 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:33.734869 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:33.734869 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:33.734869 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:33.734869 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:33.734869 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:33.734869 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 10:50:33.734869 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 10:50:33.734869 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 10:50:33.734869 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 10:50:33.734869 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:33.734869 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:33.734869 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:33.734869 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:33.734869 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:33.734869 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:33.735694 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:33.735694 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:33.735694 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:33.735694 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:33.735694 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:33.735694 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:33.735694 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:33.735694 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:33.735694 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:33.735694 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:33.735694 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 10:50:33.735694 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 10:50:33.735694 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 10:50:33.735694 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:33.735694 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 389/807] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 18 10:50:33 2022] GET /identity/v3/services/network => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:33.736496 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f742cd41-93b4-40d7-b0dd-6e5d01100b61 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:33.765960 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1192ac80-5ab1-41a2-a292-84d141cc2d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:33.766593 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1192ac80-5ab1-41a2-a292-84d141cc2d37 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:33.766871 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1192ac80-5ab1-41a2-a292-84d141cc2d37 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:33.767149 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1192ac80-5ab1-41a2-a292-84d141cc2d37 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:33.774794 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1192ac80-5ab1-41a2-a292-84d141cc2d37 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:33.776231 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1192ac80-5ab1-41a2-a292-84d141cc2d37 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:33.787263 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-1192ac80-5ab1-41a2-a292-84d141cc2d37 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 10:50:33.787263 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:33.787263 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:33.787263 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:33.787263 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:33.787263 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:33.787263 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:33.787263 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:33.787263 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:33.787263 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:33.787263 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:33.787263 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:33.787263 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 10:50:33.787263 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 10:50:33.787263 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 10:50:33.788229 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 10:50:33.788229 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:33.788229 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:33.788229 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:33.788229 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:33.788229 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:33.788229 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:33.788229 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:33.788229 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:33.788229 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:33.788229 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:33.788229 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:33.788229 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:33.788229 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:33.788229 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:33.788229 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:33.788229 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:33.789156 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 10:50:33.789156 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 10:50:33.789156 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 10:50:33.789156 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 10:50:33.789156 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 10:50:33.789156 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 10:50:33.789156 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 10:50:33.789156 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:33.789156 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 419/808] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 18 10:50:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:33.789707 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1192ac80-5ab1-41a2-a292-84d141cc2d37 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:33.820456 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:33.846210 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f742cd41-93b4-40d7-b0dd-6e5d01100b61 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:33.849008 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:33.881053 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9983df-d00a-4d88-81a9-2b264fa8525a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:33.881743 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9983df-d00a-4d88-81a9-2b264fa8525a None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:33.882802 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9983df-d00a-4d88-81a9-2b264fa8525a None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:33.883290 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9983df-d00a-4d88-81a9-2b264fa8525a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:33.891198 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1192ac80-5ab1-41a2-a292-84d141cc2d37 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:33.891666 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9983df-d00a-4d88-81a9-2b264fa8525a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:33.893129 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9983df-d00a-4d88-81a9-2b264fa8525a None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:33.905226 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-7b9983df-d00a-4d88-81a9-2b264fa8525a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 10:50:33.905226 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:33.905226 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:33.905226 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:33.905226 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:33.905226 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:33.905226 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:33.905226 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:33.905226 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:33.905226 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:33.905226 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:33.905226 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:33.905226 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 10:50:33.905226 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 10:50:33.905226 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 10:50:33.905226 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 10:50:33.906673 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:33.906673 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:33.906673 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 10:50:33.906673 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 10:50:33.906673 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 10:50:33.906673 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 10:50:33.906673 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:33.906673 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:33.906673 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:33.906673 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:33.906673 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:33.906673 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:33.906673 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:33.906673 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:33.906673 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:33.906673 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:33.906673 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:33.906673 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:33.907875 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:33.907875 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:33.907875 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 10:50:33.907875 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 10:50:33.907875 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 10:50:33.907875 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 10:50:33.907875 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 10:50:33.907875 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 10:50:33.907875 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 10:50:33.907875 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:33.907875 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 390/809] 10.222.0.15 () {56 vars in 1093 bytes} [Thu Aug 18 10:50:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:33.907875 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd491d1d-76ee-4067-ae54-5ad44cbba0de None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:33.908698 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd491d1d-76ee-4067-ae54-5ad44cbba0de None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:33.908698 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd491d1d-76ee-4067-ae54-5ad44cbba0de None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:33.909675 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 391/810] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:50:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:50:33.910243 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd491d1d-76ee-4067-ae54-5ad44cbba0de None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:33.934480 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e0cbf0-8bb8-4685-aa97-aa20025b1897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:33.935106 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0cbf0-8bb8-4685-aa97-aa20025b1897 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:33.935382 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0cbf0-8bb8-4685-aa97-aa20025b1897 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:33.935652 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0cbf0-8bb8-4685-aa97-aa20025b1897 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:33.945941 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e0cbf0-8bb8-4685-aa97-aa20025b1897 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:33.947407 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e0cbf0-8bb8-4685-aa97-aa20025b1897 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:33.961912 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-22e0cbf0-8bb8-4685-aa97-aa20025b1897 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:33.961912 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:33.961912 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:33.961912 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:33.961912 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:33.961912 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:33.961912 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:33.961912 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:33.961912 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:33.961912 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:33.961912 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:33.961912 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:33.961912 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 10:50:33.961912 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 10:50:33.961912 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 10:50:33.961912 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 10:50:33.963023 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:33.963023 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:33.963023 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:33.963023 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:33.963023 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:33.963023 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:33.963023 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:33.963023 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:33.963023 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:33.963023 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:33.963023 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:33.963023 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:33.963023 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:33.963023 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:33.963023 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:33.963023 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:33.963023 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 10:50:33.964208 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 10:50:33.964208 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:33.964208 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:33.965662 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 420/811] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:50:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:33.966676 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e0cbf0-8bb8-4685-aa97-aa20025b1897 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:34.015249 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd491d1d-76ee-4067-ae54-5ad44cbba0de None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:34.049048 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9783974-bcc6-4b66-85bd-2cc0ff3f4a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:34.049682 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9783974-bcc6-4b66-85bd-2cc0ff3f4a8d None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:34.049969 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9783974-bcc6-4b66-85bd-2cc0ff3f4a8d None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:34.050243 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9783974-bcc6-4b66-85bd-2cc0ff3f4a8d None admin] PATH_INFO: `/v3/services` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:34.050870 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9783974-bcc6-4b66-85bd-2cc0ff3f4a8d None admin] RBAC: Adding query filter params (name=network) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:34.051173 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9783974-bcc6-4b66-85bd-2cc0ff3f4a8d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:34.052544 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9783974-bcc6-4b66-85bd-2cc0ff3f4a8d None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:34.054338 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:34.058915 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 392/812] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Aug 18 10:50:33 2022] GET /identity/v3/services?name=network => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:34.059826 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9783974-bcc6-4b66-85bd-2cc0ff3f4a8d None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:34.070404 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e0cbf0-8bb8-4685-aa97-aa20025b1897 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:34.081409 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:34.106436 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07386fe9-76d8-452d-8232-2a949c48a173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:34.107134 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07386fe9-76d8-452d-8232-2a949c48a173 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:34.107418 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07386fe9-76d8-452d-8232-2a949c48a173 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:34.107691 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07386fe9-76d8-452d-8232-2a949c48a173 None admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:34.108381 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07386fe9-76d8-452d-8232-2a949c48a173 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:34.108685 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07386fe9-76d8-452d-8232-2a949c48a173 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:34.110145 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07386fe9-76d8-452d-8232-2a949c48a173 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:34.122310 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 421/813] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Aug 18 10:50:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:34.123507 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c8e6d-bd02-42e1-8995-d854925394eb None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:34.123789 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c8e6d-bd02-42e1-8995-d854925394eb None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:34.124063 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c8e6d-bd02-42e1-8995-d854925394eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:34.142926 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-ac0c8e6d-bd02-42e1-8995-d854925394eb None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:50:34.144110 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-ac0c8e6d-bd02-42e1-8995-d854925394eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:50:34.161585 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9783974-bcc6-4b66-85bd-2cc0ff3f4a8d None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:34.196602 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c5bb77-929e-436b-b06f-c7189f97102a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:34.197199 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c5bb77-929e-436b-b06f-c7189f97102a None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:34.197470 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c5bb77-929e-436b-b06f-c7189f97102a None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:34.197767 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c5bb77-929e-436b-b06f-c7189f97102a None admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:34.198486 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c5bb77-929e-436b-b06f-c7189f97102a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:34.198792 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c5bb77-929e-436b-b06f-c7189f97102a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:34.200213 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c5bb77-929e-436b-b06f-c7189f97102a None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:34.211121 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 422/814] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:50:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 10:50:34.211977 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c8e6d-bd02-42e1-8995-d854925394eb None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:34.228218 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 393/815] 10.222.0.15 () {56 vars in 1133 bytes} [Thu Aug 18 10:50:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:34.228916 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c5bb77-929e-436b-b06f-c7189f97102a None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:34.293186 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:34.330088 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:34.334064 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c8e6d-bd02-42e1-8995-d854925394eb None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:34.338243 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c5bb77-929e-436b-b06f-c7189f97102a None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:34.372821 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2084f9-1525-4ed7-ab25-fec1995cd95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:34.373433 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2084f9-1525-4ed7-ab25-fec1995cd95b None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:34.373735 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2084f9-1525-4ed7-ab25-fec1995cd95b None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:34.374033 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2084f9-1525-4ed7-ab25-fec1995cd95b None admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:34.374628 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2084f9-1525-4ed7-ab25-fec1995cd95b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:34.374924 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2084f9-1525-4ed7-ab25-fec1995cd95b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:34.375221 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f2f85a-7f6d-4409-bbbf-694781de02ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:34.375831 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f2f85a-7f6d-4409-bbbf-694781de02ce None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:34.376105 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f2f85a-7f6d-4409-bbbf-694781de02ce None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:34.376279 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2084f9-1525-4ed7-ab25-fec1995cd95b None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:34.376372 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f2f85a-7f6d-4409-bbbf-694781de02ce None admin] PATH_INFO: `/v3/services` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:34.376998 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f2f85a-7f6d-4409-bbbf-694781de02ce None admin] RBAC: Adding query filter params (type=network) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:34.377302 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f2f85a-7f6d-4409-bbbf-694781de02ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:34.378719 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f2f85a-7f6d-4409-bbbf-694781de02ce None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:34.384179 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 394/816] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Aug 18 10:50:34 2022] GET /identity/v3/services?type=network => generated 350 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:34.384977 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f2f85a-7f6d-4409-bbbf-694781de02ce None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:34.396565 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 423/817] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 18 10:50:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:34.398448 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2084f9-1525-4ed7-ab25-fec1995cd95b None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:34.497308 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f2f85a-7f6d-4409-bbbf-694781de02ce None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:34.504401 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2084f9-1525-4ed7-ab25-fec1995cd95b None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:34.520816 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:34.537138 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb91324e-144d-4975-8c27-f955ace90660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:34.537814 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb91324e-144d-4975-8c27-f955ace90660 None admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:34.538691 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb91324e-144d-4975-8c27-f955ace90660 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:34.538964 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb91324e-144d-4975-8c27-f955ace90660 None admin] PATH_INFO: `/v3/projects/1575e8ebaaab4650995841659b6e631b/users/f97e906b1922419d8511ab1c8b9c86e4/roles/127fdc7ef05b4e0b98a940b334e5fcab` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:34.540887 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb91324e-144d-4975-8c27-f955ace90660 None admin] RBAC: Authorizing `identity:create_grant(project_id=1575e8ebaaab4650995841659b6e631b, user_id=f97e906b1922419d8511ab1c8b9c86e4, role_id=127fdc7ef05b4e0b98a940b334e5fcab)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:34.542346 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb91324e-144d-4975-8c27-f955ace90660 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:34.544160 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c4213-feaf-4fa9-8836-541d8158e16c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:34.544710 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c4213-feaf-4fa9-8836-541d8158e16c None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:34.544985 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c4213-feaf-4fa9-8836-541d8158e16c None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:34.545266 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c4213-feaf-4fa9-8836-541d8158e16c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:34.554637 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 395/818] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Aug 18 10:50:34 2022] PUT /identity/v3/projects/1575e8ebaaab4650995841659b6e631b/users/f97e906b1922419d8511ab1c8b9c86e4/roles/127fdc7ef05b4e0b98a940b334e5fcab => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 10:50:34.555455 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb91324e-144d-4975-8c27-f955ace90660 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:34.591208 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:34.649246 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659c4213-feaf-4fa9-8836-541d8158e16c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:34.650741 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659c4213-feaf-4fa9-8836-541d8158e16c None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:34.697403 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb91324e-144d-4975-8c27-f955ace90660 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:34.749354 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d7a411-785e-443d-ae48-7ac65737363c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:34.750007 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d7a411-785e-443d-ae48-7ac65737363c None admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:34.750283 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d7a411-785e-443d-ae48-7ac65737363c None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:34.750553 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d7a411-785e-443d-ae48-7ac65737363c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:34.751215 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d7a411-785e-443d-ae48-7ac65737363c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:34.752576 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d7a411-785e-443d-ae48-7ac65737363c None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:34.777133 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 396/819] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 10:50:34 2022] POST /identity/v3/endpoints => generated 337 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 10:50:34.778477 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d7a411-785e-443d-ae48-7ac65737363c None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:34.790066 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 424/820] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 18 10:50:34 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 10:50:34.791317 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c4213-feaf-4fa9-8836-541d8158e16c None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:34.830696 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:34.870785 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:34.930706 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c4213-feaf-4fa9-8836-541d8158e16c None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:34.942170 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d7a411-785e-443d-ae48-7ac65737363c None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:34.982299 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfb4c0d-c8e1-411c-b8a2-f12001d6737f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:34.983664 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfb4c0d-c8e1-411c-b8a2-f12001d6737f None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:34.984091 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfb4c0d-c8e1-411c-b8a2-f12001d6737f None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:34.984510 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfb4c0d-c8e1-411c-b8a2-f12001d6737f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:34.985362 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfb4c0d-c8e1-411c-b8a2-f12001d6737f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:34.986716 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b27b39-58b5-47b9-8546-bed0f9656eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:34.987212 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfb4c0d-c8e1-411c-b8a2-f12001d6737f None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:34.987338 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b27b39-58b5-47b9-8546-bed0f9656eb7 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:34.987617 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b27b39-58b5-47b9-8546-bed0f9656eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:34.987891 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b27b39-58b5-47b9-8546-bed0f9656eb7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:34.996212 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b27b39-58b5-47b9-8546-bed0f9656eb7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:34.997729 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b27b39-58b5-47b9-8546-bed0f9656eb7 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:34.999762 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-7bfb4c0d-c8e1-411c-b8a2-f12001d6737f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 10:50:34.999762 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:34.999762 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 10:50:34.999762 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 10:50:34.999762 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 10:50:34.999762 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 10:50:34.999762 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 10:50:34.999762 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 10:50:34.999762 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 10:50:34.999762 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:34.999762 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 10:50:34.999762 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:34.999762 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:34.999762 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:34.999762 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:34.999762 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:34.999762 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:35.000942 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:35.000942 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:35.000942 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:35.000942 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:35.000942 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:35.000942 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:35.000942 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 10:50:35.000942 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 10:50:35.000942 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 10:50:35.000942 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 10:50:35.000942 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:35.000942 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:35.000942 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:35.000942 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:35.000942 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:35.000942 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:35.001879 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:35.001879 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:35.001879 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:35.001879 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:35.001879 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:35.001879 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:35.001879 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:35.001879 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:35.001879 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:35.001879 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:35.001879 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 10:50:35.001879 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 10:50:35.001879 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 10:50:35.001879 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:35.004248 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 425/821] 10.222.0.15 () {56 vars in 1129 bytes} [Thu Aug 18 10:50:34 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:35.005244 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfb4c0d-c8e1-411c-b8a2-f12001d6737f None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:35.011287 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-56b27b39-58b5-47b9-8546-bed0f9656eb7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 10:50:35.011287 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:35.011287 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:35.011287 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:35.011287 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:35.011287 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:35.011287 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:35.011287 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:35.011287 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:35.011287 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:35.011287 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:35.011287 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:35.011287 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 10:50:35.011287 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 10:50:35.011287 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 10:50:35.012202 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 10:50:35.012202 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:35.012202 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:35.012202 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:35.012202 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:35.012202 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:35.012202 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:35.012202 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:35.012202 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:35.012202 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:35.012202 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:35.012202 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:35.012202 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:35.012202 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:35.012202 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:35.012202 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:35.012202 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:35.013123 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 10:50:35.013123 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 10:50:35.013123 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 10:50:35.013123 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 10:50:35.013123 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 10:50:35.013123 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 10:50:35.013123 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 10:50:35.013123 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:35.013123 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 397/822] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 18 10:50:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:35.013670 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b27b39-58b5-47b9-8546-bed0f9656eb7 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:35.137755 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfb4c0d-c8e1-411c-b8a2-f12001d6737f None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:35.140633 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:35.151491 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b27b39-58b5-47b9-8546-bed0f9656eb7 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:35.162718 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:35.176232 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3864f0c-b49b-42ad-9848-9ae75ae9e825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:35.177204 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3864f0c-b49b-42ad-9848-9ae75ae9e825 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:35.177484 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3864f0c-b49b-42ad-9848-9ae75ae9e825 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:35.178055 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3864f0c-b49b-42ad-9848-9ae75ae9e825 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:35.187924 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044b1f68-0ec9-4ffa-b196-85613798046e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:35.188539 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b1f68-0ec9-4ffa-b196-85613798046e None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:35.188822 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b1f68-0ec9-4ffa-b196-85613798046e None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:35.189097 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b1f68-0ec9-4ffa-b196-85613798046e None admin] PATH_INFO: `/v3/services` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:35.189766 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044b1f68-0ec9-4ffa-b196-85613798046e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:35.190073 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044b1f68-0ec9-4ffa-b196-85613798046e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:35.191447 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044b1f68-0ec9-4ffa-b196-85613798046e None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:35.193335 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3864f0c-b49b-42ad-9848-9ae75ae9e825 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:35.195838 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3864f0c-b49b-42ad-9848-9ae75ae9e825 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:35.197283 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 398/823] 10.222.0.15 () {56 vars in 1124 bytes} [Thu Aug 18 10:50:35 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:35.198125 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044b1f68-0ec9-4ffa-b196-85613798046e None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:35.224622 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-f3864f0c-b49b-42ad-9848-9ae75ae9e825 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:35.224622 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:35.224622 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:35.224622 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:35.224622 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:35.224622 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:35.224622 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:35.224622 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:35.224622 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:35.224622 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:35.224622 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:35.224622 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:35.224622 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 10:50:35.224622 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 10:50:35.224622 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 10:50:35.224622 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 10:50:35.226430 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:35.226430 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:35.226430 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:35.226430 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:35.226430 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:35.226430 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:35.226430 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:35.226430 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:35.226430 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:35.226430 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:35.226430 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:35.226430 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:35.226430 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:35.226430 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:35.226430 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:35.226430 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:35.226430 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 10:50:35.227502 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 10:50:35.227502 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:35.227502 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:35.228918 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 426/824] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:50:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:35.229882 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3864f0c-b49b-42ad-9848-9ae75ae9e825 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:35.330630 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044b1f68-0ec9-4ffa-b196-85613798046e None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:35.336953 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3864f0c-b49b-42ad-9848-9ae75ae9e825 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:35.373482 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bad818d-e261-44a9-b1bb-15c44c698606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:35.374144 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad818d-e261-44a9-b1bb-15c44c698606 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:35.374417 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad818d-e261-44a9-b1bb-15c44c698606 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:35.374687 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad818d-e261-44a9-b1bb-15c44c698606 None admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:35.374931 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed4bc89-f835-40bf-a8b3-947844c40546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:35.375377 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bad818d-e261-44a9-b1bb-15c44c698606 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:35.375536 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed4bc89-f835-40bf-a8b3-947844c40546 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:35.375709 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bad818d-e261-44a9-b1bb-15c44c698606 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:35.375800 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed4bc89-f835-40bf-a8b3-947844c40546 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:35.376062 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed4bc89-f835-40bf-a8b3-947844c40546 None admin] PATH_INFO: `/v3/services` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:35.376679 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed4bc89-f835-40bf-a8b3-947844c40546 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:35.376974 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed4bc89-f835-40bf-a8b3-947844c40546 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:35.377077 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bad818d-e261-44a9-b1bb-15c44c698606 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:35.378426 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed4bc89-f835-40bf-a8b3-947844c40546 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:35.383836 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 427/825] 10.222.0.15 () {56 vars in 1124 bytes} [Thu Aug 18 10:50:35 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:35.384858 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed4bc89-f835-40bf-a8b3-947844c40546 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:35.396424 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 399/826] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Aug 18 10:50:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:35.396424 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bad818d-e261-44a9-b1bb-15c44c698606 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:35.417441 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:35.435881 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:35.502480 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed4bc89-f835-40bf-a8b3-947844c40546 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:35.516871 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bad818d-e261-44a9-b1bb-15c44c698606 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:35.537980 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453356eb-8ec2-4f41-9a7d-301f93b8ad34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:35.538697 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453356eb-8ec2-4f41-9a7d-301f93b8ad34 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:35.539043 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453356eb-8ec2-4f41-9a7d-301f93b8ad34 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:35.539313 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453356eb-8ec2-4f41-9a7d-301f93b8ad34 None admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:35.539955 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453356eb-8ec2-4f41-9a7d-301f93b8ad34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:35.540253 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453356eb-8ec2-4f41-9a7d-301f93b8ad34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:35.541649 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453356eb-8ec2-4f41-9a7d-301f93b8ad34 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:35.561565 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 428/827] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 18 10:50:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:35.561565 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453356eb-8ec2-4f41-9a7d-301f93b8ad34 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:35.562152 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f813ce0d-be1f-4e35-b623-a064f1276fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:35.562769 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f813ce0d-be1f-4e35-b623-a064f1276fdb None admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:35.563047 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f813ce0d-be1f-4e35-b623-a064f1276fdb None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:35.563322 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f813ce0d-be1f-4e35-b623-a064f1276fdb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:35.565565 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f813ce0d-be1f-4e35-b623-a064f1276fdb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:35.565565 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f813ce0d-be1f-4e35-b623-a064f1276fdb None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:35.597549 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 400/828] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 10:50:35 2022] POST /identity/v3/endpoints => generated 346 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 10:50:35.597549 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f813ce0d-be1f-4e35-b623-a064f1276fdb None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:35.687384 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:35.715251 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453356eb-8ec2-4f41-9a7d-301f93b8ad34 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:35.724013 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:35.739899 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f813ce0d-be1f-4e35-b623-a064f1276fdb None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:35.760926 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03a6955-a37a-40e8-a55d-c2c942d1aebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:35.761909 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a6955-a37a-40e8-a55d-c2c942d1aebb None admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:35.762180 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a6955-a37a-40e8-a55d-c2c942d1aebb None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:35.762448 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a6955-a37a-40e8-a55d-c2c942d1aebb None admin] PATH_INFO: `/v3/projects/1575e8ebaaab4650995841659b6e631b/users/bcacf809f13043ab90716607160a70db/roles/13bffd536e214d0893b3007e267f3301` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:35.786450 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03a6955-a37a-40e8-a55d-c2c942d1aebb None admin] RBAC: Authorizing `identity:create_grant(project_id=1575e8ebaaab4650995841659b6e631b, user_id=bcacf809f13043ab90716607160a70db, role_id=13bffd536e214d0893b3007e267f3301)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:35.787974 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03a6955-a37a-40e8-a55d-c2c942d1aebb None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:35.796861 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e63b14-2ac4-4f3d-a575-2ee76ccb96dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:35.797660 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e63b14-2ac4-4f3d-a575-2ee76ccb96dc None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:35.798041 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e63b14-2ac4-4f3d-a575-2ee76ccb96dc None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:35.798645 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e63b14-2ac4-4f3d-a575-2ee76ccb96dc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:35.806368 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 429/829] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Aug 18 10:50:35 2022] PUT /identity/v3/projects/1575e8ebaaab4650995841659b6e631b/users/bcacf809f13043ab90716607160a70db/roles/13bffd536e214d0893b3007e267f3301 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 10:50:35.808786 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e63b14-2ac4-4f3d-a575-2ee76ccb96dc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:35.810360 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e63b14-2ac4-4f3d-a575-2ee76ccb96dc None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:35.826063 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-e8e63b14-2ac4-4f3d-a575-2ee76ccb96dc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 10:50:35.826063 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:35.826063 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:35.826063 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:35.826063 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:35.826063 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:35.826063 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:35.826063 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:35.826063 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:35.826063 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:35.826063 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:35.826063 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:35.826063 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 10:50:35.826063 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 10:50:35.826063 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 10:50:35.827246 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 10:50:35.827246 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:35.827246 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:35.827246 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:35.827246 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:35.827246 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:35.827246 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:35.827246 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:35.827246 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:35.827246 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:35.827246 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:35.827246 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:35.827246 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:35.827246 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:35.827246 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:35.827246 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:35.827246 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:35.828442 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 10:50:35.828442 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 10:50:35.828442 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 10:50:35.828442 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 10:50:35.828442 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 10:50:35.828442 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 10:50:35.828442 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 10:50:35.828442 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:35.829001 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 401/830] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 18 10:50:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:35.835912 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03a6955-a37a-40e8-a55d-c2c942d1aebb None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:35.963053 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03a6955-a37a-40e8-a55d-c2c942d1aebb None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:36.005788 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce26959-5892-408c-ba38-3d78d3fd7485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:36.006406 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce26959-5892-408c-ba38-3d78d3fd7485 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:36.006678 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce26959-5892-408c-ba38-3d78d3fd7485 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:36.007589 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce26959-5892-408c-ba38-3d78d3fd7485 None admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:36.008443 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce26959-5892-408c-ba38-3d78d3fd7485 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:36.008742 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce26959-5892-408c-ba38-3d78d3fd7485 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:36.010215 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce26959-5892-408c-ba38-3d78d3fd7485 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:36.027656 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 430/831] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Aug 18 10:50:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:36.033328 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e63b14-2ac4-4f3d-a575-2ee76ccb96dc None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:36.146063 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e63b14-2ac4-4f3d-a575-2ee76ccb96dc None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:36.175396 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:36.183828 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeab5d4b-6420-46c0-8077-3651f075aa97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:36.184442 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeab5d4b-6420-46c0-8077-3651f075aa97 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:36.184720 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeab5d4b-6420-46c0-8077-3651f075aa97 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:36.184991 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeab5d4b-6420-46c0-8077-3651f075aa97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:36.185760 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeab5d4b-6420-46c0-8077-3651f075aa97 None admin] RBAC: Adding query filter params (role.id=127fdc7ef05b4e0b98a940b334e5fcab, scope.project.id=1575e8ebaaab4650995841659b6e631b, user.id=a005d8f0c46d44c7b6f2201a54717b12) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:36.186069 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeab5d4b-6420-46c0-8077-3651f075aa97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:36.187627 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeab5d4b-6420-46c0-8077-3651f075aa97 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:36.194976 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 402/832] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Aug 18 10:50:36 2022] GET /identity/v3/role_assignments?user.id=a005d8f0c46d44c7b6f2201a54717b12&scope.project.id=1575e8ebaaab4650995841659b6e631b&role.id=127fdc7ef05b4e0b98a940b334e5fcab => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:36.558650 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc262a-2194-461d-8b40-255b5be9d382 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:36.559166 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc262a-2194-461d-8b40-255b5be9d382 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:36.559673 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc262a-2194-461d-8b40-255b5be9d382 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:36.561433 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 431/833] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:50:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:50:36.567228 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb988767-0c56-4d06-a963-8432b421c62d None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:36.567525 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb988767-0c56-4d06-a963-8432b421c62d None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:36.567807 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb988767-0c56-4d06-a963-8432b421c62d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:36.588777 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-fb988767-0c56-4d06-a963-8432b421c62d None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:50:36.590568 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-fb988767-0c56-4d06-a963-8432b421c62d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:50:36.666201 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 403/834] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:50:36 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 10:50:36.959879 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bc262a-2194-461d-8b40-255b5be9d382 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:36.974040 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:37.079531 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bc262a-2194-461d-8b40-255b5be9d382 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:37.115122 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394a76d7-e2dc-47f5-a030-d5134faa348d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:37.115751 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a76d7-e2dc-47f5-a030-d5134faa348d None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:37.116659 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a76d7-e2dc-47f5-a030-d5134faa348d None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:37.117060 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a76d7-e2dc-47f5-a030-d5134faa348d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:37.128483 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394a76d7-e2dc-47f5-a030-d5134faa348d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:50:37.133608 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-394a76d7-e2dc-47f5-a030-d5134faa348d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 10:50:37.133608 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:37.133608 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:37.133608 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:37.133608 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:37.133608 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:37.133608 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:37.133608 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:37.133608 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:37.133608 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:37.133608 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:37.133608 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:37.133608 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:50:37.133608 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:50:37.133608 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:50:37.133608 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:50:37.134539 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:50:37.134539 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:50:37.134539 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:50:37.134539 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:50:37.134539 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:37.134539 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:37.134539 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:37.134539 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:37.134539 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:37.134539 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:37.134539 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:37.134539 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:37.134539 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:37.134539 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:37.134539 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:37.134539 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:37.135381 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:37.135381 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:37.135381 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:37.135381 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:37.135381 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:50:37.135381 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:50:37.135381 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:50:37.135381 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:50:37.135381 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:50:37.135381 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:50:37.135381 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 10:50:37.135381 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:37.135381 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 432/835] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Aug 18 10:50:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:37.140698 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb988767-0c56-4d06-a963-8432b421c62d None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:37.248525 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb988767-0c56-4d06-a963-8432b421c62d None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:37.275258 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:37.287855 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a65104-6336-4167-b736-3988ee83481d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:37.289078 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a65104-6336-4167-b736-3988ee83481d None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:37.289360 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a65104-6336-4167-b736-3988ee83481d None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:37.289660 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a65104-6336-4167-b736-3988ee83481d None admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:37.290334 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a65104-6336-4167-b736-3988ee83481d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:37.290634 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a65104-6336-4167-b736-3988ee83481d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:37.292009 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a65104-6336-4167-b736-3988ee83481d None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:37.301274 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 404/836] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 18 10:50:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:37.306812 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394a76d7-e2dc-47f5-a030-d5134faa348d None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:37.387125 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:37.421549 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394a76d7-e2dc-47f5-a030-d5134faa348d None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:37.456241 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1711dcc-abf6-4aa8-a0fa-ad224fb49adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:37.456871 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1711dcc-abf6-4aa8-a0fa-ad224fb49adc None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:37.457150 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1711dcc-abf6-4aa8-a0fa-ad224fb49adc None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:37.457423 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1711dcc-abf6-4aa8-a0fa-ad224fb49adc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:37.469117 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1711dcc-abf6-4aa8-a0fa-ad224fb49adc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:37.470587 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1711dcc-abf6-4aa8-a0fa-ad224fb49adc None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:37.485246 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-e1711dcc-abf6-4aa8-a0fa-ad224fb49adc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:37.485246 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:37.485246 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:37.485246 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:37.485246 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:37.485246 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:37.485246 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:37.485246 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:37.485246 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:37.485246 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:37.485246 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:37.485246 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:37.485246 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 10:50:37.485246 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 10:50:37.485246 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 10:50:37.485246 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 10:50:37.486205 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:37.486205 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:37.486205 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:37.486205 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:37.486205 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:37.486205 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:37.486205 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:37.486205 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:37.486205 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:37.486205 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:37.486205 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:37.486205 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:37.486205 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:37.486205 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:37.486205 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:37.486205 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:37.486205 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 10:50:37.487111 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 10:50:37.487111 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:37.487111 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:37.487111 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 433/837] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:50:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:37.492510 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a65104-6336-4167-b736-3988ee83481d None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:37.597900 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a65104-6336-4167-b736-3988ee83481d None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:37.634096 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a32092-0e18-4fb5-8df6-ddf13e5aafd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:37.634712 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a32092-0e18-4fb5-8df6-ddf13e5aafd8 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:37.634990 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a32092-0e18-4fb5-8df6-ddf13e5aafd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:37.635262 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a32092-0e18-4fb5-8df6-ddf13e5aafd8 None admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:37.635907 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a32092-0e18-4fb5-8df6-ddf13e5aafd8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:37.636206 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a32092-0e18-4fb5-8df6-ddf13e5aafd8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:37.637588 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a32092-0e18-4fb5-8df6-ddf13e5aafd8 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:37.651662 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b5cac6-48a2-4c71-b666-62ff8c252d15 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:37.651950 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 405/838] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 18 10:50:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 10:50:37.652121 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b5cac6-48a2-4c71-b666-62ff8c252d15 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:37.652266 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b5cac6-48a2-4c71-b666-62ff8c252d15 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:37.655834 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 434/839] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:50:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 10:50:37.658563 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a32092-0e18-4fb5-8df6-ddf13e5aafd8 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:37.662585 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2b3b4-849f-48d1-aff7-082e737b14fb None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:37.662868 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2b3b4-849f-48d1-aff7-082e737b14fb None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:37.663917 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2b3b4-849f-48d1-aff7-082e737b14fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:37.682839 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-72b2b3b4-849f-48d1-aff7-082e737b14fb None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:50:37.684044 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-72b2b3b4-849f-48d1-aff7-082e737b14fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:50:37.711262 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:37.774114 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 435/840] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:50:37 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 10:50:37.780047 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a32092-0e18-4fb5-8df6-ddf13e5aafd8 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:37.821369 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00db4859-de91-46da-a2f0-0fecae55f1bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:37.822341 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db4859-de91-46da-a2f0-0fecae55f1bf None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:37.822807 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db4859-de91-46da-a2f0-0fecae55f1bf None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:37.823263 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db4859-de91-46da-a2f0-0fecae55f1bf None admin] PATH_INFO: `/v3/users/swift` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:37.831197 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00db4859-de91-46da-a2f0-0fecae55f1bf None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:37.832854 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00db4859-de91-46da-a2f0-0fecae55f1bf None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:37.848437 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-00db4859-de91-46da-a2f0-0fecae55f1bf None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 18 10:50:37.848437 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:37.848437 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:37.848437 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:37.848437 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:37.848437 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:37.848437 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:37.848437 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:37.848437 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:37.848437 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:37.848437 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:37.848437 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:37.848437 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 10:50:37.848437 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 10:50:37.848437 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 10:50:37.848437 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 10:50:37.849418 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:37.849418 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:37.849418 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 10:50:37.849418 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 10:50:37.849418 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 10:50:37.849418 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 10:50:37.849418 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:37.849418 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:37.849418 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:37.849418 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:37.849418 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:37.849418 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:37.849418 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:37.849418 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:37.849418 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:37.849418 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:37.849418 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:37.849418 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:37.850948 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:37.850948 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:37.850948 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 10:50:37.850948 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 10:50:37.850948 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 10:50:37.850948 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 10:50:37.850948 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 10:50:37.850948 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 10:50:37.850948 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 18 10:50:37.850948 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:37.853165 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 406/841] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Aug 18 10:50:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:37.859152 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b2b3b4-849f-48d1-aff7-082e737b14fb None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:37.917903 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:37.959160 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3faeb3c-0fae-4e4c-b850-f3706475578b None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:37.959788 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3faeb3c-0fae-4e4c-b850-f3706475578b None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:37.960303 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3faeb3c-0fae-4e4c-b850-f3706475578b None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:37.962325 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 407/842] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:50:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 10:50:37.967467 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86e44a9-e327-49cc-964c-834bd9e59881 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:37.968522 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86e44a9-e327-49cc-964c-834bd9e59881 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:37.969270 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86e44a9-e327-49cc-964c-834bd9e59881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:37.974011 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b2b3b4-849f-48d1-aff7-082e737b14fb None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:37.995306 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-e86e44a9-e327-49cc-964c-834bd9e59881 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:50:37.996875 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-e86e44a9-e327-49cc-964c-834bd9e59881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:50:38.013173 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a046ded2-6d44-441c-bb4e-1da4b16cd044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:38.014023 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a046ded2-6d44-441c-bb4e-1da4b16cd044 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:38.014210 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a046ded2-6d44-441c-bb4e-1da4b16cd044 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:38.014443 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a046ded2-6d44-441c-bb4e-1da4b16cd044 None admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:38.015228 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a046ded2-6d44-441c-bb4e-1da4b16cd044 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:38.015477 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a046ded2-6d44-441c-bb4e-1da4b16cd044 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:38.016899 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a046ded2-6d44-441c-bb4e-1da4b16cd044 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:38.041302 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 436/843] 10.222.0.15 () {56 vars in 1135 bytes} [Thu Aug 18 10:50:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:38.042493 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a046ded2-6d44-441c-bb4e-1da4b16cd044 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:38.087797 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 408/844] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:50:37 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 10:50:38.089157 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86e44a9-e327-49cc-964c-834bd9e59881 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:38.138908 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:38.154242 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a046ded2-6d44-441c-bb4e-1da4b16cd044 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:38.168088 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:38.198555 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33fd159-8afd-483b-b990-20d8128c9d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:38.199163 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33fd159-8afd-483b-b990-20d8128c9d64 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:38.199497 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33fd159-8afd-483b-b990-20d8128c9d64 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:38.199772 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33fd159-8afd-483b-b990-20d8128c9d64 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:38.237855 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86e44a9-e327-49cc-964c-834bd9e59881 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:38.273728 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33fd159-8afd-483b-b990-20d8128c9d64 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:38.275167 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33fd159-8afd-483b-b990-20d8128c9d64 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:38.279854 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52349128-84c0-4343-bd00-d527687c0d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:38.280686 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52349128-84c0-4343-bd00-d527687c0d68 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:38.281139 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52349128-84c0-4343-bd00-d527687c0d68 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:38.281588 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52349128-84c0-4343-bd00-d527687c0d68 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:38.282317 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52349128-84c0-4343-bd00-d527687c0d68 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:38.283939 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52349128-84c0-4343-bd00-d527687c0d68 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:38.294618 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-52349128-84c0-4343-bd00-d527687c0d68 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 10:50:38.294618 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:38.294618 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 10:50:38.294618 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 10:50:38.294618 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 10:50:38.294618 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 10:50:38.294618 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 10:50:38.294618 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 10:50:38.294618 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 10:50:38.294618 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:38.294618 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 10:50:38.294618 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:38.294618 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:38.294618 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:38.294618 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:38.294618 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:38.294618 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:38.295798 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:38.295798 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:38.295798 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:38.295798 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:38.295798 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:38.295798 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:38.295798 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 10:50:38.295798 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 10:50:38.295798 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 10:50:38.295798 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 10:50:38.295798 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:38.295798 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:38.295798 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:38.295798 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:38.295798 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:38.295798 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:38.296746 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:38.296746 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:38.296746 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:38.296746 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:38.296746 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:38.296746 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:38.296746 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:38.296746 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:38.296746 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:38.296746 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:38.296746 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 10:50:38.296746 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 10:50:38.296746 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 10:50:38.296746 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:38.299107 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 409/845] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Aug 18 10:50:38 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:38.300869 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0757f24e-35f6-485c-823b-7cc797880d28 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:38.301185 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0757f24e-35f6-485c-823b-7cc797880d28 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:38.301568 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0757f24e-35f6-485c-823b-7cc797880d28 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:38.303074 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 410/846] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:50:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:50:38.308351 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0757f24e-35f6-485c-823b-7cc797880d28 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:38.386608 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 437/847] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 18 10:50:38 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 10:50:38.387945 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68f3693-2772-4df9-9392-23622ef0e3b1 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:38.388230 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68f3693-2772-4df9-9392-23622ef0e3b1 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:38.388520 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68f3693-2772-4df9-9392-23622ef0e3b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:38.406653 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-f68f3693-2772-4df9-9392-23622ef0e3b1 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:50:38.407769 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-f68f3693-2772-4df9-9392-23622ef0e3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:50:38.410539 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:38.411976 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:38.417911 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0757f24e-35f6-485c-823b-7cc797880d28 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:38.453351 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257dd129-c255-4a83-9575-a35990b5f52d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:38.453987 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257dd129-c255-4a83-9575-a35990b5f52d None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:38.454268 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257dd129-c255-4a83-9575-a35990b5f52d None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:38.454545 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257dd129-c255-4a83-9575-a35990b5f52d None admin] PATH_INFO: `/v3/services` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:38.455181 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257dd129-c255-4a83-9575-a35990b5f52d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:38.455485 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257dd129-c255-4a83-9575-a35990b5f52d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:38.456850 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257dd129-c255-4a83-9575-a35990b5f52d None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:38.462191 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 411/848] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Aug 18 10:50:38 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:38.462995 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257dd129-c255-4a83-9575-a35990b5f52d None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:38.475088 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 438/849] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:50:38 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 10:50:38.475933 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68f3693-2772-4df9-9392-23622ef0e3b1 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:38.571791 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257dd129-c255-4a83-9575-a35990b5f52d None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:38.584164 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68f3693-2772-4df9-9392-23622ef0e3b1 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:38.608525 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bbe37f-b2db-47ec-9d7a-bd0474150bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:38.609153 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bbe37f-b2db-47ec-9d7a-bd0474150bb1 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:38.609432 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bbe37f-b2db-47ec-9d7a-bd0474150bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:38.609731 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bbe37f-b2db-47ec-9d7a-bd0474150bb1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:38.620189 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bbe37f-b2db-47ec-9d7a-bd0474150bb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:50:38.620365 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea82489-694e-498a-8e07-bb277d0bb70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:38.620869 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea82489-694e-498a-8e07-bb277d0bb70a None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:38.621146 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea82489-694e-498a-8e07-bb277d0bb70a None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:38.621416 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea82489-694e-498a-8e07-bb277d0bb70a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:38.626162 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-b9bbe37f-b2db-47ec-9d7a-bd0474150bb1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 10:50:38.626162 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:38.626162 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:38.626162 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:38.626162 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:38.626162 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:38.626162 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:38.626162 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:38.626162 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:38.626162 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:38.626162 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:38.626162 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:38.626162 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:50:38.626162 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:50:38.626162 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:50:38.626162 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:50:38.627288 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:50:38.627288 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:50:38.627288 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:50:38.627288 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:50:38.627288 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:38.627288 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:38.627288 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:38.627288 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:38.627288 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:38.627288 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:38.627288 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:38.627288 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:38.627288 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:38.627288 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:38.627288 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:38.627288 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:38.628196 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:38.628196 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:38.628196 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:38.628196 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:38.628196 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:50:38.628196 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:50:38.628196 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:50:38.628196 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:50:38.628196 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:50:38.628196 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:50:38.628196 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 10:50:38.628196 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:38.628196 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 412/850] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Aug 18 10:50:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:38.629011 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bbe37f-b2db-47ec-9d7a-bd0474150bb1 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:38.634848 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:38.636155 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea82489-694e-498a-8e07-bb277d0bb70a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:38.638004 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea82489-694e-498a-8e07-bb277d0bb70a None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:38.655967 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-2ea82489-694e-498a-8e07-bb277d0bb70a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:38.655967 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:38.655967 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:38.655967 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:38.655967 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:38.655967 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:38.655967 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:38.655967 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:38.655967 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:38.655967 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:38.655967 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:38.655967 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:38.655967 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 10:50:38.655967 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 10:50:38.655967 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 10:50:38.655967 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 10:50:38.656972 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:38.656972 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:38.656972 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:38.656972 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:38.656972 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:38.656972 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:38.656972 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:38.656972 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:38.656972 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:38.656972 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:38.656972 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:38.656972 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:38.656972 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:38.656972 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:38.656972 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:38.656972 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:38.656972 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 10:50:38.657886 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 10:50:38.657886 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:38.657886 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:38.657886 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 439/851] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:50:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:38.658107 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea82489-694e-498a-8e07-bb277d0bb70a None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:38.659238 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:38.746436 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bbe37f-b2db-47ec-9d7a-bd0474150bb1 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:38.766996 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea82489-694e-498a-8e07-bb277d0bb70a None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:38.781665 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec0a2a2-dc60-4369-bbd2-39669bd9faeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:38.782275 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec0a2a2-dc60-4369-bbd2-39669bd9faeb None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:38.782557 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec0a2a2-dc60-4369-bbd2-39669bd9faeb None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:38.782832 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec0a2a2-dc60-4369-bbd2-39669bd9faeb None admin] PATH_INFO: `/v3/services` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:38.783474 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec0a2a2-dc60-4369-bbd2-39669bd9faeb None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:38.783776 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec0a2a2-dc60-4369-bbd2-39669bd9faeb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:38.785154 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec0a2a2-dc60-4369-bbd2-39669bd9faeb None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:38.789853 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 413/852] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Aug 18 10:50:38 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:38.790646 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec0a2a2-dc60-4369-bbd2-39669bd9faeb None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:38.811328 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880129c1-637a-4626-b889-2f5a3d3ebf95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:38.812236 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880129c1-637a-4626-b889-2f5a3d3ebf95 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:38.812484 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880129c1-637a-4626-b889-2f5a3d3ebf95 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:38.812823 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880129c1-637a-4626-b889-2f5a3d3ebf95 None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:38.813553 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880129c1-637a-4626-b889-2f5a3d3ebf95 None admin] RBAC: Adding query filter params (name=service) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:38.813862 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880129c1-637a-4626-b889-2f5a3d3ebf95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:38.815303 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880129c1-637a-4626-b889-2f5a3d3ebf95 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:38.825500 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 440/853] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Aug 18 10:50:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:38.826499 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880129c1-637a-4626-b889-2f5a3d3ebf95 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:38.909045 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:38.910583 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:38.929927 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec0a2a2-dc60-4369-bbd2-39669bd9faeb None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:38.963800 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880129c1-637a-4626-b889-2f5a3d3ebf95 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:38.967275 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30650915-c4d4-45ee-a33c-0abd9b9d920f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:38.967892 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30650915-c4d4-45ee-a33c-0abd9b9d920f None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:38.968174 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30650915-c4d4-45ee-a33c-0abd9b9d920f None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:38.968451 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30650915-c4d4-45ee-a33c-0abd9b9d920f None admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:38.969098 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30650915-c4d4-45ee-a33c-0abd9b9d920f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:38.969402 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30650915-c4d4-45ee-a33c-0abd9b9d920f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:38.970805 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30650915-c4d4-45ee-a33c-0abd9b9d920f None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:38.984711 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 414/854] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 18 10:50:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:38.990080 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30650915-c4d4-45ee-a33c-0abd9b9d920f None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:39.002020 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e27283-3755-4964-bcaa-f5f38180d13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:39.003047 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e27283-3755-4964-bcaa-f5f38180d13b None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:39.003520 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e27283-3755-4964-bcaa-f5f38180d13b None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:39.003968 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e27283-3755-4964-bcaa-f5f38180d13b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:39.004724 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e27283-3755-4964-bcaa-f5f38180d13b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:39.006579 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e27283-3755-4964-bcaa-f5f38180d13b None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:39.018196 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-23e27283-3755-4964-bcaa-f5f38180d13b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 10:50:39.018196 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:39.018196 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 10:50:39.018196 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 10:50:39.018196 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 10:50:39.018196 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 10:50:39.018196 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 10:50:39.018196 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 10:50:39.018196 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 10:50:39.018196 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:39.018196 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 10:50:39.018196 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:39.018196 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:39.018196 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:39.018196 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:39.018196 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:39.019146 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:39.019146 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:39.019146 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:39.019146 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:39.019146 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:39.019146 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:39.019146 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:39.019146 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 10:50:39.019146 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 10:50:39.019146 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 10:50:39.019146 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 10:50:39.019146 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:39.019146 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:39.019146 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:39.019146 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:39.019146 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:39.019146 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:39.020037 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:39.020037 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:39.020037 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:39.020037 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:39.020037 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:39.020037 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:39.020037 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:39.020037 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:39.020037 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:39.020037 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:39.020037 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 10:50:39.020037 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 10:50:39.020037 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 10:50:39.020037 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:39.023539 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 441/855] 10.222.0.15 () {56 vars in 1132 bytes} [Thu Aug 18 10:50:38 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:39.023539 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e27283-3755-4964-bcaa-f5f38180d13b None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:39.098337 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30650915-c4d4-45ee-a33c-0abd9b9d920f None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:39.138322 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e27283-3755-4964-bcaa-f5f38180d13b None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:39.141591 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046949c3-02c7-48b7-bf07-32a4cbb570c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:39.142241 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046949c3-02c7-48b7-bf07-32a4cbb570c5 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:39.142529 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046949c3-02c7-48b7-bf07-32a4cbb570c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:39.142803 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046949c3-02c7-48b7-bf07-32a4cbb570c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:39.155883 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046949c3-02c7-48b7-bf07-32a4cbb570c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:39.158713 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046949c3-02c7-48b7-bf07-32a4cbb570c5 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:39.163981 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:39.170556 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:39.180618 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-046949c3-02c7-48b7-bf07-32a4cbb570c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:39.180618 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:39.180618 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:39.180618 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:39.180618 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:39.180618 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:39.180618 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:39.180618 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:39.180618 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:39.180618 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:39.180618 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:39.180618 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:39.180618 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 10:50:39.180618 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 10:50:39.180618 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 10:50:39.180618 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 10:50:39.181771 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:39.181771 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:39.181771 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:39.181771 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:39.181771 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:39.181771 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:39.181771 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:39.181771 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:39.181771 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:39.181771 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:39.181771 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:39.181771 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:39.181771 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:39.181771 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:39.181771 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:39.181771 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:39.181771 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 10:50:39.182975 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 10:50:39.182975 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:39.182975 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:39.186338 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa98d22-780e-4933-a33b-06917a509616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:39.186475 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 415/856] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:50:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:39.187305 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046949c3-02c7-48b7-bf07-32a4cbb570c5 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:39.187533 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa98d22-780e-4933-a33b-06917a509616 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:39.187960 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa98d22-780e-4933-a33b-06917a509616 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:39.188465 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa98d22-780e-4933-a33b-06917a509616 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:39.196646 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa98d22-780e-4933-a33b-06917a509616 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:39.198345 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa98d22-780e-4933-a33b-06917a509616 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:39.215729 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-efa98d22-780e-4933-a33b-06917a509616 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 10:50:39.215729 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:39.215729 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:39.215729 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:39.215729 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:39.215729 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:39.215729 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:39.215729 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:39.215729 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:39.215729 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:39.215729 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:39.215729 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:39.215729 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 10:50:39.215729 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 10:50:39.215729 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 10:50:39.216634 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 10:50:39.216634 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:39.216634 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:39.216634 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:39.216634 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:39.216634 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:39.216634 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:39.216634 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:39.216634 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:39.216634 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:39.216634 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:39.216634 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:39.216634 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:39.216634 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:39.216634 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:39.216634 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:39.216634 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:39.217505 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 10:50:39.217505 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 10:50:39.217505 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 10:50:39.217505 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 10:50:39.217505 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 10:50:39.217505 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 10:50:39.217505 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 10:50:39.217505 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:39.219707 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 442/857] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 18 10:50:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:39.220706 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa98d22-780e-4933-a33b-06917a509616 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:39.304422 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046949c3-02c7-48b7-bf07-32a4cbb570c5 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:39.338742 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa98d22-780e-4933-a33b-06917a509616 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:39.364928 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fa75e0-c59a-40db-9bad-97c3dc5cae36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:39.365604 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fa75e0-c59a-40db-9bad-97c3dc5cae36 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:39.365863 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fa75e0-c59a-40db-9bad-97c3dc5cae36 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:39.366157 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fa75e0-c59a-40db-9bad-97c3dc5cae36 None admin] PATH_INFO: `/v3/services` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:39.366765 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fa75e0-c59a-40db-9bad-97c3dc5cae36 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:39.367067 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fa75e0-c59a-40db-9bad-97c3dc5cae36 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:39.369304 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fa75e0-c59a-40db-9bad-97c3dc5cae36 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:39.374602 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 416/858] 10.222.0.15 () {56 vars in 1126 bytes} [Thu Aug 18 10:50:39 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:39.375858 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fa75e0-c59a-40db-9bad-97c3dc5cae36 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:39.376916 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c1206b-5bc3-49c6-b32f-beebfe111aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:39.377699 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c1206b-5bc3-49c6-b32f-beebfe111aba None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:39.378225 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c1206b-5bc3-49c6-b32f-beebfe111aba None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:39.378634 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c1206b-5bc3-49c6-b32f-beebfe111aba None admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:39.379393 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c1206b-5bc3-49c6-b32f-beebfe111aba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:39.379924 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c1206b-5bc3-49c6-b32f-beebfe111aba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:39.381551 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c1206b-5bc3-49c6-b32f-beebfe111aba None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:39.395297 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 443/859] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 18 10:50:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:39.396340 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c1206b-5bc3-49c6-b32f-beebfe111aba None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:39.442925 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:39.452705 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:39.497224 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fa75e0-c59a-40db-9bad-97c3dc5cae36 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:39.512268 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c1206b-5bc3-49c6-b32f-beebfe111aba None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:39.534583 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f15822-3842-4df7-98f2-4b647ed203e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:39.535193 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f15822-3842-4df7-98f2-4b647ed203e0 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:39.535616 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f15822-3842-4df7-98f2-4b647ed203e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:39.535897 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f15822-3842-4df7-98f2-4b647ed203e0 None admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:39.536596 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f15822-3842-4df7-98f2-4b647ed203e0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:39.536899 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f15822-3842-4df7-98f2-4b647ed203e0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:39.539029 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f15822-3842-4df7-98f2-4b647ed203e0 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:39.548061 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd19224-9bd4-45d9-8aac-4d30158a00c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:39.548657 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd19224-9bd4-45d9-8aac-4d30158a00c8 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:39.548928 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd19224-9bd4-45d9-8aac-4d30158a00c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:39.549194 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd19224-9bd4-45d9-8aac-4d30158a00c8 None admin] PATH_INFO: `/v3/services` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:39.549843 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd19224-9bd4-45d9-8aac-4d30158a00c8 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:39.550139 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd19224-9bd4-45d9-8aac-4d30158a00c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:39.557277 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 417/860] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Aug 18 10:50:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:39.557448 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd19224-9bd4-45d9-8aac-4d30158a00c8 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:39.557579 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f15822-3842-4df7-98f2-4b647ed203e0 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:39.562190 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 444/861] 10.222.0.15 () {56 vars in 1126 bytes} [Thu Aug 18 10:50:39 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:39.569901 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd19224-9bd4-45d9-8aac-4d30158a00c8 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:39.682482 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f15822-3842-4df7-98f2-4b647ed203e0 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:39.710921 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:39.711399 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd19224-9bd4-45d9-8aac-4d30158a00c8 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:39.713231 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:39.727365 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0689f626-1736-4d05-a74f-8e3a10b3533a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:39.728211 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0689f626-1736-4d05-a74f-8e3a10b3533a None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:39.728558 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0689f626-1736-4d05-a74f-8e3a10b3533a None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:39.728897 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0689f626-1736-4d05-a74f-8e3a10b3533a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:39.739695 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0689f626-1736-4d05-a74f-8e3a10b3533a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:39.742160 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0689f626-1736-4d05-a74f-8e3a10b3533a None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:39.761307 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-0689f626-1736-4d05-a74f-8e3a10b3533a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 10:50:39.761307 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:39.761307 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:39.761307 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:39.761307 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:39.761307 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:39.761307 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:39.761307 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:39.761307 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:39.761307 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:39.761307 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:39.761307 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:39.761307 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 10:50:39.761307 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 10:50:39.761307 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 10:50:39.761307 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 10:50:39.762400 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:39.762400 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:39.762400 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 10:50:39.762400 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 10:50:39.762400 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 10:50:39.762400 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 10:50:39.762400 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:39.762400 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:39.762400 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:39.762400 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:39.762400 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:39.762400 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:39.762400 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:39.762400 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:39.762400 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:39.762400 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:39.762400 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:39.762400 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:39.763331 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:39.763331 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:39.763331 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 10:50:39.763331 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 10:50:39.763331 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 10:50:39.763331 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 10:50:39.763331 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 10:50:39.763331 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 10:50:39.763331 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 10:50:39.763331 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:39.763331 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 418/862] 10.222.0.15 () {56 vars in 1117 bytes} [Thu Aug 18 10:50:39 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:39.770069 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0689f626-1736-4d05-a74f-8e3a10b3533a None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:39.770375 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd46c15-046e-4244-acec-7ddcde2e6563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:39.771100 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd46c15-046e-4244-acec-7ddcde2e6563 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:39.771439 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd46c15-046e-4244-acec-7ddcde2e6563 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:39.771718 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd46c15-046e-4244-acec-7ddcde2e6563 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:39.773367 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd46c15-046e-4244-acec-7ddcde2e6563 None admin] RBAC: Adding query filter params (role.id=127fdc7ef05b4e0b98a940b334e5fcab, scope.project.id=1575e8ebaaab4650995841659b6e631b, user.id=f97e906b1922419d8511ab1c8b9c86e4) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:39.773985 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd46c15-046e-4244-acec-7ddcde2e6563 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:39.776550 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd46c15-046e-4244-acec-7ddcde2e6563 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:39.787001 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 445/863] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Aug 18 10:50:39 2022] GET /identity/v3/role_assignments?user.id=f97e906b1922419d8511ab1c8b9c86e4&scope.project.id=1575e8ebaaab4650995841659b6e631b&role.id=127fdc7ef05b4e0b98a940b334e5fcab => generated 608 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:39.900121 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0689f626-1736-4d05-a74f-8e3a10b3533a None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:39.944640 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03bd119-e277-451a-b563-7af3c5d6b812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:39.945505 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03bd119-e277-451a-b563-7af3c5d6b812 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:39.945843 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03bd119-e277-451a-b563-7af3c5d6b812 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:39.946120 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03bd119-e277-451a-b563-7af3c5d6b812 None admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:39.946939 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03bd119-e277-451a-b563-7af3c5d6b812 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:39.947278 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03bd119-e277-451a-b563-7af3c5d6b812 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:39.948714 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03bd119-e277-451a-b563-7af3c5d6b812 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:39.969701 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 419/864] 10.222.0.15 () {56 vars in 1149 bytes} [Thu Aug 18 10:50:39 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 10:50:39.975811 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd46c15-046e-4244-acec-7ddcde2e6563 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:40.094552 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd46c15-046e-4244-acec-7ddcde2e6563 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:40.135059 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a275933-22b2-4c5c-8d55-2d1a7d7d502c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:40.135926 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a275933-22b2-4c5c-8d55-2d1a7d7d502c None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:40.136464 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a275933-22b2-4c5c-8d55-2d1a7d7d502c None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:40.136885 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a275933-22b2-4c5c-8d55-2d1a7d7d502c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:40.178627 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:40.216868 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a275933-22b2-4c5c-8d55-2d1a7d7d502c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:40.218173 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a275933-22b2-4c5c-8d55-2d1a7d7d502c None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:40.323485 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 446/865] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 18 10:50:39 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 18 10:50:40.329001 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03bd119-e277-451a-b563-7af3c5d6b812 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:40.378500 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:40.445158 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03bd119-e277-451a-b563-7af3c5d6b812 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:40.482513 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eab011b-c7a0-4eba-91b7-3185ac66d67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:40.483532 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eab011b-c7a0-4eba-91b7-3185ac66d67b None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:40.484012 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eab011b-c7a0-4eba-91b7-3185ac66d67b None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:40.484500 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eab011b-c7a0-4eba-91b7-3185ac66d67b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:40.499466 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eab011b-c7a0-4eba-91b7-3185ac66d67b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:40.500926 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eab011b-c7a0-4eba-91b7-3185ac66d67b None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:40.516532 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-8eab011b-c7a0-4eba-91b7-3185ac66d67b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:40.516532 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:40.516532 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:40.516532 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:40.516532 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:40.516532 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:40.516532 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:40.516532 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:40.516532 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:40.516532 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:40.516532 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:40.516532 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:40.516532 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 10:50:40.516532 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 10:50:40.516532 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 10:50:40.516532 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 10:50:40.517501 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:40.517501 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:40.517501 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:40.517501 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:40.517501 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:40.517501 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:40.517501 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:40.517501 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:40.517501 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:40.517501 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:40.517501 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:40.517501 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:40.517501 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:40.517501 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:40.517501 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:40.517501 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:40.517501 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 10:50:40.518441 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 10:50:40.518441 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:40.518441 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:40.518441 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 420/866] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:50:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:40.525751 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a275933-22b2-4c5c-8d55-2d1a7d7d502c None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:40.594447 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:40.630164 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a275933-22b2-4c5c-8d55-2d1a7d7d502c None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:40.667243 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b7f769-d691-43f0-9a08-1955197a2eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:40.667859 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b7f769-d691-43f0-9a08-1955197a2eee None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:40.668139 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b7f769-d691-43f0-9a08-1955197a2eee None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:40.668412 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b7f769-d691-43f0-9a08-1955197a2eee None admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:40.669058 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b7f769-d691-43f0-9a08-1955197a2eee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:40.669360 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b7f769-d691-43f0-9a08-1955197a2eee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:40.670758 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b7f769-d691-43f0-9a08-1955197a2eee None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:40.689388 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 447/867] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 18 10:50:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:40.695764 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eab011b-c7a0-4eba-91b7-3185ac66d67b None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:40.778643 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a8ac46-0047-4041-934c-2549fc0af44c None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:40.778966 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a8ac46-0047-4041-934c-2549fc0af44c None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:40.779194 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a8ac46-0047-4041-934c-2549fc0af44c None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:40.780765 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 448/868] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:50:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 10:50:40.789576 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7579457-6699-45a9-9e86-3e911b7cc948 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:40.789576 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7579457-6699-45a9-9e86-3e911b7cc948 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:40.789576 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7579457-6699-45a9-9e86-3e911b7cc948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:40.805631 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:40.806834 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-b7579457-6699-45a9-9e86-3e911b7cc948 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:50:40.808663 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-b7579457-6699-45a9-9e86-3e911b7cc948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:50:40.815101 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eab011b-c7a0-4eba-91b7-3185ac66d67b None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:40.855266 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4666c5c4-8ae3-49ae-a47f-4ab48ee874fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:40.855880 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666c5c4-8ae3-49ae-a47f-4ab48ee874fe None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:40.856174 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666c5c4-8ae3-49ae-a47f-4ab48ee874fe None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:40.856451 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666c5c4-8ae3-49ae-a47f-4ab48ee874fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:40.864001 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4666c5c4-8ae3-49ae-a47f-4ab48ee874fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:40.865508 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4666c5c4-8ae3-49ae-a47f-4ab48ee874fe None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:40.878133 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-4666c5c4-8ae3-49ae-a47f-4ab48ee874fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 10:50:40.878133 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:40.878133 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:40.878133 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:40.878133 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:40.878133 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:40.878133 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:40.878133 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:40.878133 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:40.878133 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:40.878133 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:40.878133 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:40.878133 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 10:50:40.878133 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 10:50:40.878133 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 10:50:40.879030 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 10:50:40.879030 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:40.879030 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:40.879030 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:40.879030 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:40.879030 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:40.879030 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:40.879030 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:40.879030 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:40.879030 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:40.879030 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:40.879030 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:40.879030 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:40.879030 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:40.879030 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:40.879030 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:40.879030 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:40.879907 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 10:50:40.879907 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 10:50:40.879907 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 10:50:40.879907 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 10:50:40.879907 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 10:50:40.879907 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 10:50:40.879907 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 10:50:40.879907 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:40.879907 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 421/869] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 18 10:50:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:40.885335 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4666c5c4-8ae3-49ae-a47f-4ab48ee874fe None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:40.897966 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 449/870] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:50:40 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 10:50:40.994222 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4666c5c4-8ae3-49ae-a47f-4ab48ee874fe None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:41.029953 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c68ceb4-2f7e-4afb-bc73-b40a931b11fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:41.030562 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c68ceb4-2f7e-4afb-bc73-b40a931b11fe None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:41.030838 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c68ceb4-2f7e-4afb-bc73-b40a931b11fe None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:41.031113 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c68ceb4-2f7e-4afb-bc73-b40a931b11fe None admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:41.031798 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c68ceb4-2f7e-4afb-bc73-b40a931b11fe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:41.032101 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c68ceb4-2f7e-4afb-bc73-b40a931b11fe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:41.033625 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c68ceb4-2f7e-4afb-bc73-b40a931b11fe None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:41.046611 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 422/871] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Aug 18 10:50:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:41.052601 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7579457-6699-45a9-9e86-3e911b7cc948 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:41.112824 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:41.163859 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7579457-6699-45a9-9e86-3e911b7cc948 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:41.188798 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c68ceb4-2f7e-4afb-bc73-b40a931b11fe None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:41.204778 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4223c3ee-1ec6-474b-9590-88b0acbec15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:41.205782 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4223c3ee-1ec6-474b-9590-88b0acbec15f None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:41.205782 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4223c3ee-1ec6-474b-9590-88b0acbec15f None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:41.206095 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4223c3ee-1ec6-474b-9590-88b0acbec15f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:41.206696 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4223c3ee-1ec6-474b-9590-88b0acbec15f None admin] RBAC: Adding query filter params (role.id=13bffd536e214d0893b3007e267f3301, scope.project.id=1575e8ebaaab4650995841659b6e631b, user.id=bcacf809f13043ab90716607160a70db) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:41.207004 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4223c3ee-1ec6-474b-9590-88b0acbec15f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:41.208438 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4223c3ee-1ec6-474b-9590-88b0acbec15f None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:41.210517 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:41.215159 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 450/872] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Aug 18 10:50:41 2022] GET /identity/v3/role_assignments?user.id=bcacf809f13043ab90716607160a70db&scope.project.id=1575e8ebaaab4650995841659b6e631b&role.id=13bffd536e214d0893b3007e267f3301 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:41.317111 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c68ceb4-2f7e-4afb-bc73-b40a931b11fe None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:41.356220 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59843e0c-2ed9-48f3-ae34-42eaf9d5d5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:41.356863 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59843e0c-2ed9-48f3-ae34-42eaf9d5d5ed None admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:41.357116 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59843e0c-2ed9-48f3-ae34-42eaf9d5d5ed None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:41.357389 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59843e0c-2ed9-48f3-ae34-42eaf9d5d5ed None admin] PATH_INFO: `/v3/services` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:41.358087 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59843e0c-2ed9-48f3-ae34-42eaf9d5d5ed None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:41.359471 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59843e0c-2ed9-48f3-ae34-42eaf9d5d5ed None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:41.376866 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 423/873] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Aug 18 10:50:41 2022] POST /identity/v3/services => generated 251 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 10:50:41.767184 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada4a19-12f5-43ca-a891-da42c065c70d None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:41.767721 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada4a19-12f5-43ca-a891-da42c065c70d None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:41.768130 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada4a19-12f5-43ca-a891-da42c065c70d None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:41.770088 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 451/874] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:50:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:50:41.776391 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd7012-7ffb-4cd8-aa7f-a8524ef8149d None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:41.776799 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd7012-7ffb-4cd8-aa7f-a8524ef8149d None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:41.777170 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd7012-7ffb-4cd8-aa7f-a8524ef8149d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:41.796267 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-dfcd7012-7ffb-4cd8-aa7f-a8524ef8149d None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:50:41.797472 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-dfcd7012-7ffb-4cd8-aa7f-a8524ef8149d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:50:41.870223 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:41.882367 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 424/875] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:50:41 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 10:50:41.941016 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe5c9f-46ce-488a-94ca-38afd64b58ed None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:41.941332 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe5c9f-46ce-488a-94ca-38afd64b58ed None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:41.941683 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe5c9f-46ce-488a-94ca-38afd64b58ed None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:41.943355 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 452/876] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:50:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:50:41.951161 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b7a86-8f13-452d-8ec7-e4c6791feaf6 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:41.951450 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b7a86-8f13-452d-8ec7-e4c6791feaf6 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:41.951726 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b7a86-8f13-452d-8ec7-e4c6791feaf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:41.970639 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-ee3b7a86-8f13-452d-8ec7-e4c6791feaf6 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:50:41.971833 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-ee3b7a86-8f13-452d-8ec7-e4c6791feaf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:50:42.045952 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 425/877] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:50:41 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 10:50:42.157887 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fe5c9f-46ce-488a-94ca-38afd64b58ed None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:42.314403 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fe5c9f-46ce-488a-94ca-38afd64b58ed None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:42.333473 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3b7a86-8f13-452d-8ec7-e4c6791feaf6 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:42.351207 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:42.369101 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05366e1d-723a-445e-b8fe-645ac7ac0db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:42.369766 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05366e1d-723a-445e-b8fe-645ac7ac0db4 None admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:42.370045 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05366e1d-723a-445e-b8fe-645ac7ac0db4 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:42.370321 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05366e1d-723a-445e-b8fe-645ac7ac0db4 None admin] PATH_INFO: `/v3/services` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:42.370980 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05366e1d-723a-445e-b8fe-645ac7ac0db4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:42.372819 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05366e1d-723a-445e-b8fe-645ac7ac0db4 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:42.402257 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 453/878] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Aug 18 10:50:42 2022] POST /identity/v3/services => generated 269 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 10:50:42.456886 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3b7a86-8f13-452d-8ec7-e4c6791feaf6 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:42.498456 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:42.515043 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fff53c-3e00-46e2-b317-84d53f5fc14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:42.516183 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fff53c-3e00-46e2-b317-84d53f5fc14b None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:42.516779 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fff53c-3e00-46e2-b317-84d53f5fc14b None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:42.517233 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fff53c-3e00-46e2-b317-84d53f5fc14b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:42.518093 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fff53c-3e00-46e2-b317-84d53f5fc14b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:42.519708 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fff53c-3e00-46e2-b317-84d53f5fc14b None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:42.531164 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-c7fff53c-3e00-46e2-b317-84d53f5fc14b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 10:50:42.531164 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:42.531164 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 10:50:42.531164 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 10:50:42.531164 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 10:50:42.531164 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 10:50:42.531164 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 10:50:42.531164 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 10:50:42.531164 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 10:50:42.531164 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:42.531164 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 10:50:42.531164 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:42.531164 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:42.531164 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:42.531164 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:42.531164 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:42.531164 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:42.532210 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:42.532210 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:42.532210 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:42.532210 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:42.532210 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:42.532210 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:42.532210 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 10:50:42.532210 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 10:50:42.532210 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 10:50:42.532210 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 10:50:42.532210 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:42.532210 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:42.532210 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:42.532210 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:42.532210 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:42.532210 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:42.533035 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:42.533035 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:42.533035 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:42.533035 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:42.533035 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:42.533035 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:42.533035 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:42.533035 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:42.533035 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:42.533035 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:42.533035 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 10:50:42.533035 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 10:50:42.533035 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 10:50:42.533035 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:42.535845 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 426/879] 10.222.0.15 () {56 vars in 1126 bytes} [Thu Aug 18 10:50:42 2022] GET /identity/v3/services/object-store => generated 93 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 10:50:42.542703 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05366e1d-723a-445e-b8fe-645ac7ac0db4 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:42.659641 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05366e1d-723a-445e-b8fe-645ac7ac0db4 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:42.701955 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6828a2d-069f-435d-b430-b84b445a4cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:42.702820 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6828a2d-069f-435d-b430-b84b445a4cee None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:42.703106 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6828a2d-069f-435d-b430-b84b445a4cee None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:42.703372 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6828a2d-069f-435d-b430-b84b445a4cee None admin] PATH_INFO: `/v3/services` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:42.704020 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6828a2d-069f-435d-b430-b84b445a4cee None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:42.704323 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6828a2d-069f-435d-b430-b84b445a4cee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:42.705948 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6828a2d-069f-435d-b430-b84b445a4cee None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:42.713901 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 454/880] 10.222.0.15 () {56 vars in 1122 bytes} [Thu Aug 18 10:50:42 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:42.720741 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fff53c-3e00-46e2-b317-84d53f5fc14b None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:42.836223 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fff53c-3e00-46e2-b317-84d53f5fc14b None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:42.873653 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b543def-d05a-4402-87a0-7a71e49df1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:42.874326 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b543def-d05a-4402-87a0-7a71e49df1ff None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:42.874606 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b543def-d05a-4402-87a0-7a71e49df1ff None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:42.875053 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b543def-d05a-4402-87a0-7a71e49df1ff None admin] PATH_INFO: `/v3/services` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:42.875706 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b543def-d05a-4402-87a0-7a71e49df1ff None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:42.876002 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b543def-d05a-4402-87a0-7a71e49df1ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:42.877475 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b543def-d05a-4402-87a0-7a71e49df1ff None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:42.884400 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 427/881] 10.222.0.15 () {56 vars in 1122 bytes} [Thu Aug 18 10:50:42 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:43.325083 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd0276-b764-4ede-8bac-fda82b219873 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:43.325617 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd0276-b764-4ede-8bac-fda82b219873 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:43.325696 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd0276-b764-4ede-8bac-fda82b219873 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:43.327220 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 455/882] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:50:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:50:43.332655 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065cac2c-0e35-4808-8793-69dede51d8a9 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:43.332936 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065cac2c-0e35-4808-8793-69dede51d8a9 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:43.333209 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065cac2c-0e35-4808-8793-69dede51d8a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:43.353101 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-065cac2c-0e35-4808-8793-69dede51d8a9 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:50:43.354335 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-065cac2c-0e35-4808-8793-69dede51d8a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:50:43.404995 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:43.426396 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 428/883] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:50:43 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 10:50:43.641625 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a4f1cf-589e-4cff-81bd-225ed618eb20 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:43.641914 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a4f1cf-589e-4cff-81bd-225ed618eb20 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:43.642196 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a4f1cf-589e-4cff-81bd-225ed618eb20 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:43.643800 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 456/884] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:50:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:50:43.649958 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb362178-c327-4b34-b692-0108c8da67a6 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:43.650405 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb362178-c327-4b34-b692-0108c8da67a6 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:43.650548 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb362178-c327-4b34-b692-0108c8da67a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:43.669233 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-cb362178-c327-4b34-b692-0108c8da67a6 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:50:43.670488 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-cb362178-c327-4b34-b692-0108c8da67a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:50:43.716654 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a4f1cf-589e-4cff-81bd-225ed618eb20 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:43.748315 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 429/885] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:50:43 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 10:50:43.777947 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:43.828730 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a4f1cf-589e-4cff-81bd-225ed618eb20 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:43.864310 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfc37a6-b628-4f22-acd6-c6172eaa0c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:43.864935 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfc37a6-b628-4f22-acd6-c6172eaa0c48 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:43.865209 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfc37a6-b628-4f22-acd6-c6172eaa0c48 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:43.865479 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfc37a6-b628-4f22-acd6-c6172eaa0c48 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:43.876489 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfc37a6-b628-4f22-acd6-c6172eaa0c48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:50:43.882327 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-0bfc37a6-b628-4f22-acd6-c6172eaa0c48 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 10:50:43.882327 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:43.882327 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:43.882327 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:43.882327 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:43.882327 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:43.882327 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:43.882327 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:43.882327 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:43.882327 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:43.882327 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:43.882327 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:43.882327 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:50:43.882327 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:50:43.882327 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:50:43.882327 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:50:43.883310 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:50:43.883310 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:50:43.883310 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:50:43.883310 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:50:43.883310 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:43.883310 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:43.883310 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:43.883310 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:43.883310 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:43.883310 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:43.883310 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:43.883310 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:43.883310 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:43.883310 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:43.883310 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:43.883310 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:43.884156 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:43.884156 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:43.884156 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:43.884156 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:43.884156 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:50:43.884156 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:50:43.884156 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:50:43.884156 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:50:43.884156 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:50:43.884156 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:50:43.884156 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 10:50:43.884156 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:43.884156 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 457/886] 10.222.0.15 () {56 vars in 1120 bytes} [Thu Aug 18 10:50:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 10:50:43.889716 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb362178-c327-4b34-b692-0108c8da67a6 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:43.994431 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb362178-c327-4b34-b692-0108c8da67a6 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:44.009135 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:44.032239 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c328f951-166d-4135-94dd-3d1b9633ae93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:44.032867 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c328f951-166d-4135-94dd-3d1b9633ae93 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:44.033143 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c328f951-166d-4135-94dd-3d1b9633ae93 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:44.033414 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c328f951-166d-4135-94dd-3d1b9633ae93 None admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:44.034127 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c328f951-166d-4135-94dd-3d1b9633ae93 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:44.034428 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c328f951-166d-4135-94dd-3d1b9633ae93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:44.035924 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c328f951-166d-4135-94dd-3d1b9633ae93 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:44.036840 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfc37a6-b628-4f22-acd6-c6172eaa0c48 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:44.052596 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 430/887] 10.222.0.15 () {56 vars in 1115 bytes} [Thu Aug 18 10:50:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:44.059608 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c328f951-166d-4135-94dd-3d1b9633ae93 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:44.147398 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfc37a6-b628-4f22-acd6-c6172eaa0c48 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:44.151385 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:44.189750 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4921d3-1e6f-414a-a9c1-9eafca009cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:44.190819 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4921d3-1e6f-414a-a9c1-9eafca009cf4 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:44.191306 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4921d3-1e6f-414a-a9c1-9eafca009cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:44.191791 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4921d3-1e6f-414a-a9c1-9eafca009cf4 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:44.192365 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c328f951-166d-4135-94dd-3d1b9633ae93 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:44.192829 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4921d3-1e6f-414a-a9c1-9eafca009cf4 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:44.195619 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4921d3-1e6f-414a-a9c1-9eafca009cf4 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:44.224644 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-3d4921d3-1e6f-414a-a9c1-9eafca009cf4 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 10:50:44.224644 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:44.224644 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 10:50:44.224644 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 10:50:44.224644 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 10:50:44.224644 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 10:50:44.224644 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 10:50:44.224644 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 10:50:44.224644 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 10:50:44.224644 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:44.224644 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 10:50:44.224644 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:44.224644 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:44.224644 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:44.224644 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:44.224644 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:44.224644 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:44.226426 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:44.226426 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:44.226426 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:44.226426 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:44.226426 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:44.226426 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:44.226426 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 10:50:44.226426 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 10:50:44.226426 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 10:50:44.226426 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 10:50:44.226426 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:44.226426 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:44.226426 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:44.226426 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:44.226426 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:44.226426 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:44.227295 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:44.227295 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:44.227295 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:44.227295 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:44.227295 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:44.227295 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:44.227295 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:44.227295 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:44.227295 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:44.227295 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:44.227295 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 10:50:44.227295 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 10:50:44.227295 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 10:50:44.227295 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:44.234868 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 458/888] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Aug 18 10:50:44 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:44.235996 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4921d3-1e6f-414a-a9c1-9eafca009cf4 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:44.240019 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a83155d-df77-4cd1-a8bb-7b29b0189172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:44.241991 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a83155d-df77-4cd1-a8bb-7b29b0189172 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:44.242675 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a83155d-df77-4cd1-a8bb-7b29b0189172 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:44.245787 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a83155d-df77-4cd1-a8bb-7b29b0189172 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:44.266032 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a83155d-df77-4cd1-a8bb-7b29b0189172 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:44.267500 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a83155d-df77-4cd1-a8bb-7b29b0189172 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:44.289308 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-2a83155d-df77-4cd1-a8bb-7b29b0189172 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:44.289308 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:44.289308 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:44.289308 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:44.289308 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:44.289308 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:44.289308 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:44.289308 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:44.289308 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:44.289308 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:44.289308 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:44.289308 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:44.289308 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 10:50:44.289308 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 10:50:44.289308 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 10:50:44.289308 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 10:50:44.290327 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:44.290327 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:44.290327 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:44.290327 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:44.290327 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:44.290327 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:44.290327 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:44.290327 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:44.290327 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:44.290327 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:44.290327 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:44.290327 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:44.290327 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:44.290327 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:44.290327 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:44.290327 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:44.290327 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 10:50:44.291204 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 10:50:44.291204 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:44.291204 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:44.298153 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 431/889] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:50:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 10:50:44.299836 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a83155d-df77-4cd1-a8bb-7b29b0189172 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:44.341229 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:44.364522 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4921d3-1e6f-414a-a9c1-9eafca009cf4 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:44.407270 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29993224-8e5b-4424-8ced-a3cbec70278a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:44.407881 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29993224-8e5b-4424-8ced-a3cbec70278a None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:44.408161 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29993224-8e5b-4424-8ced-a3cbec70278a None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:44.408434 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29993224-8e5b-4424-8ced-a3cbec70278a None admin] PATH_INFO: `/v3/services` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:44.409274 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29993224-8e5b-4424-8ced-a3cbec70278a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:44.409606 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29993224-8e5b-4424-8ced-a3cbec70278a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:44.410984 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29993224-8e5b-4424-8ced-a3cbec70278a None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:44.423739 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 459/890] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Aug 18 10:50:44 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:44.424852 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29993224-8e5b-4424-8ced-a3cbec70278a None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:44.459320 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a83155d-df77-4cd1-a8bb-7b29b0189172 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:44.461864 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:44.502480 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dac922-2af2-4460-a184-dc7aac381410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:44.503295 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dac922-2af2-4460-a184-dc7aac381410 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:44.503573 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dac922-2af2-4460-a184-dc7aac381410 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:44.503840 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dac922-2af2-4460-a184-dc7aac381410 None admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:44.504651 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dac922-2af2-4460-a184-dc7aac381410 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:44.505818 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dac922-2af2-4460-a184-dc7aac381410 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:44.508734 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dac922-2af2-4460-a184-dc7aac381410 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:44.522171 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 432/891] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 18 10:50:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:44.527698 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beda8d8-0943-4bff-8319-7efaca1aa841 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:44.527987 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beda8d8-0943-4bff-8319-7efaca1aa841 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:44.528344 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beda8d8-0943-4bff-8319-7efaca1aa841 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:44.529871 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 433/892] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:50:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:50:44.534288 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beda8d8-0943-4bff-8319-7efaca1aa841 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:44.552065 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29993224-8e5b-4424-8ced-a3cbec70278a None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:44.598081 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff352515-0779-45db-baa0-7693c36d1d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:44.598689 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff352515-0779-45db-baa0-7693c36d1d91 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:44.598972 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff352515-0779-45db-baa0-7693c36d1d91 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:44.599536 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff352515-0779-45db-baa0-7693c36d1d91 None admin] PATH_INFO: `/v3/services` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:44.599878 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff352515-0779-45db-baa0-7693c36d1d91 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:44.600181 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff352515-0779-45db-baa0-7693c36d1d91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:44.602830 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff352515-0779-45db-baa0-7693c36d1d91 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:44.612552 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 460/893] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Aug 18 10:50:44 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 10:50:44.612552 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a67af0-6026-4987-9111-7e957cf169ac None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:44.612552 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a67af0-6026-4987-9111-7e957cf169ac None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:44.612552 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a67af0-6026-4987-9111-7e957cf169ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:44.630155 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-a4a67af0-6026-4987-9111-7e957cf169ac None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:50:44.631365 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-a4a67af0-6026-4987-9111-7e957cf169ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:50:44.644497 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:44.665203 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beda8d8-0943-4bff-8319-7efaca1aa841 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:44.703527 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e9c1c1-289e-4a3c-8a05-eae17154933e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:44.704170 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e9c1c1-289e-4a3c-8a05-eae17154933e None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:44.704448 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e9c1c1-289e-4a3c-8a05-eae17154933e None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:44.704732 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e9c1c1-289e-4a3c-8a05-eae17154933e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:44.711485 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 461/894] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:50:44 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 10:50:44.712584 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a67af0-6026-4987-9111-7e957cf169ac None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:44.714766 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e9c1c1-289e-4a3c-8a05-eae17154933e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:44.716213 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e9c1c1-289e-4a3c-8a05-eae17154933e None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:44.729562 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-f0e9c1c1-289e-4a3c-8a05-eae17154933e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 10:50:44.729562 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:44.729562 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:44.729562 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:44.729562 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:44.729562 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:44.729562 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:44.729562 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:44.729562 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:44.729562 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:44.729562 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:44.729562 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:44.729562 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 10:50:44.729562 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 10:50:44.729562 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 10:50:44.729562 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 10:50:44.730588 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:44.730588 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:44.730588 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 10:50:44.730588 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 10:50:44.730588 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 10:50:44.730588 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 10:50:44.730588 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:44.730588 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:44.730588 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:44.730588 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:44.730588 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:44.730588 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:44.730588 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:44.730588 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:44.730588 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:44.730588 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:44.730588 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:44.730588 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:44.731562 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:44.731562 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:44.731562 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 10:50:44.731562 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 10:50:44.731562 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 10:50:44.731562 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 10:50:44.731562 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 10:50:44.731562 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 10:50:44.731562 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 10:50:44.731562 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:44.735508 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 434/895] 10.222.0.15 () {56 vars in 1117 bytes} [Thu Aug 18 10:50:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:44.736372 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e9c1c1-289e-4a3c-8a05-eae17154933e None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:44.760602 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:44.847790 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a67af0-6026-4987-9111-7e957cf169ac None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:44.883157 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e9c1c1-289e-4a3c-8a05-eae17154933e None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:44.885992 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0327c9-1f69-40ea-9b53-7c90bd788a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:44.887085 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0327c9-1f69-40ea-9b53-7c90bd788a56 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:44.887085 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0327c9-1f69-40ea-9b53-7c90bd788a56 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:44.887300 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0327c9-1f69-40ea-9b53-7c90bd788a56 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:44.888191 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0327c9-1f69-40ea-9b53-7c90bd788a56 None admin] RBAC: Adding query filter params (interface=public, service_id=4a230711f5fc462f9d4045568ddd5be4, region_id=RegionOne) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:44.888626 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0327c9-1f69-40ea-9b53-7c90bd788a56 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:44.890070 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0327c9-1f69-40ea-9b53-7c90bd788a56 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:44.901084 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 462/896] 10.222.0.15 () {56 vars in 1251 bytes} [Thu Aug 18 10:50:44 2022] GET /identity/v3/endpoints?service_id=4a230711f5fc462f9d4045568ddd5be4&interface=public®ion_id=RegionOne => generated 194 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:44.902591 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc69683-78a2-40fa-a888-8b0cbc3e76db None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:44.902740 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc69683-78a2-40fa-a888-8b0cbc3e76db None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:44.903018 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc69683-78a2-40fa-a888-8b0cbc3e76db None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:44.904485 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 463/897] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:50:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:50:44.909237 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be55ea88-e925-498b-b002-1f3b970c74c4 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:44.909669 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be55ea88-e925-498b-b002-1f3b970c74c4 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:44.909951 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be55ea88-e925-498b-b002-1f3b970c74c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:44.924123 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a240d90-bb90-440b-ab25-aa00104a6e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:44.925040 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a240d90-bb90-440b-ab25-aa00104a6e2d None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:44.925387 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a240d90-bb90-440b-ab25-aa00104a6e2d None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:44.925713 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a240d90-bb90-440b-ab25-aa00104a6e2d None admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:44.926448 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a240d90-bb90-440b-ab25-aa00104a6e2d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:44.926755 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a240d90-bb90-440b-ab25-aa00104a6e2d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:44.928165 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a240d90-bb90-440b-ab25-aa00104a6e2d None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:44.931758 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-be55ea88-e925-498b-b002-1f3b970c74c4 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:50:44.932965 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-be55ea88-e925-498b-b002-1f3b970c74c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:50:44.950410 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 435/898] 10.222.0.15 () {56 vars in 1149 bytes} [Thu Aug 18 10:50:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:44.951366 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a240d90-bb90-440b-ab25-aa00104a6e2d None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:44.957126 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:45.012596 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 464/899] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:50:44 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 10:50:45.013356 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be55ea88-e925-498b-b002-1f3b970c74c4 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:45.037067 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:45.065309 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a240d90-bb90-440b-ab25-aa00104a6e2d None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:45.102142 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de207f41-1537-4286-929d-d15c75ce99e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:45.102919 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de207f41-1537-4286-929d-d15c75ce99e9 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:45.103201 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de207f41-1537-4286-929d-d15c75ce99e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:45.103473 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de207f41-1537-4286-929d-d15c75ce99e9 None admin] PATH_INFO: `/v3/services` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:45.104075 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de207f41-1537-4286-929d-d15c75ce99e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:45.105451 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de207f41-1537-4286-929d-d15c75ce99e9 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:45.111319 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 436/900] 10.222.0.15 () {56 vars in 1087 bytes} [Thu Aug 18 10:50:44 2022] GET /identity/v3/services => generated 1268 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 10:50:45.112089 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de207f41-1537-4286-929d-d15c75ce99e9 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:45.135834 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be55ea88-e925-498b-b002-1f3b970c74c4 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:45.189385 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e6c4e9-9235-4166-bbed-9d68d6008b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:45.190358 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6c4e9-9235-4166-bbed-9d68d6008b4f None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:45.191075 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6c4e9-9235-4166-bbed-9d68d6008b4f None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:45.191538 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6c4e9-9235-4166-bbed-9d68d6008b4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:45.220545 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:45.259203 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de207f41-1537-4286-929d-d15c75ce99e9 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:45.283153 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e6c4e9-9235-4166-bbed-9d68d6008b4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:45.284637 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e6c4e9-9235-4166-bbed-9d68d6008b4f None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:45.302168 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104bcd01-ba2c-4bfa-ba35-8213d8f9e3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:45.302812 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104bcd01-ba2c-4bfa-ba35-8213d8f9e3a7 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:45.303090 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104bcd01-ba2c-4bfa-ba35-8213d8f9e3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:45.303419 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104bcd01-ba2c-4bfa-ba35-8213d8f9e3a7 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:45.304867 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104bcd01-ba2c-4bfa-ba35-8213d8f9e3a7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:45.305561 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104bcd01-ba2c-4bfa-ba35-8213d8f9e3a7 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:45.308119 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:45.315801 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-104bcd01-ba2c-4bfa-ba35-8213d8f9e3a7 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 10:50:45.315801 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:45.315801 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 10:50:45.315801 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 10:50:45.315801 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 10:50:45.315801 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 10:50:45.315801 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 10:50:45.315801 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 10:50:45.315801 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 10:50:45.315801 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:45.315801 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 10:50:45.315801 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:45.315801 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:45.315801 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:45.315801 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:45.315801 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:45.316755 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:45.316755 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:45.316755 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:45.316755 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:45.316755 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:45.316755 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:45.316755 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:45.316755 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 10:50:45.316755 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 10:50:45.316755 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 10:50:45.316755 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 10:50:45.316755 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:45.316755 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:45.316755 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:45.316755 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:45.316755 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:45.316755 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:45.318459 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:45.318459 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:45.318459 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:45.318459 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:45.318459 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:45.318459 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:45.318459 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:45.318459 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:45.318459 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:45.318459 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:45.318459 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 10:50:45.318459 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 10:50:45.318459 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 10:50:45.318459 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:45.318459 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 437/901] 10.222.0.15 () {56 vars in 1132 bytes} [Thu Aug 18 10:50:45 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:45.320206 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104bcd01-ba2c-4bfa-ba35-8213d8f9e3a7 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:45.403552 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 465/902] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 18 10:50:45 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 10:50:45.405140 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e6c4e9-9235-4166-bbed-9d68d6008b4f None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:45.433036 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104bcd01-ba2c-4bfa-ba35-8213d8f9e3a7 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:45.464158 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:45.470947 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770cabb7-1201-489b-94c4-703349735fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:45.471896 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770cabb7-1201-489b-94c4-703349735fcd None admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:45.472316 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770cabb7-1201-489b-94c4-703349735fcd None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:45.472715 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770cabb7-1201-489b-94c4-703349735fcd None admin] PATH_INFO: `/v3/services` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:45.473367 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770cabb7-1201-489b-94c4-703349735fcd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:45.475688 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770cabb7-1201-489b-94c4-703349735fcd None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:45.492349 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 438/903] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Aug 18 10:50:45 2022] POST /identity/v3/services => generated 241 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 10:50:45.503560 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770cabb7-1201-489b-94c4-703349735fcd None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:45.524730 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e6c4e9-9235-4166-bbed-9d68d6008b4f None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:45.551369 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:45.586836 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160cf265-d26a-48d5-ad5c-cba357e2f7b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:45.587837 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160cf265-d26a-48d5-ad5c-cba357e2f7b7 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:45.588300 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160cf265-d26a-48d5-ad5c-cba357e2f7b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:45.588753 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160cf265-d26a-48d5-ad5c-cba357e2f7b7 None admin] PATH_INFO: `/v3/services` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:45.589747 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160cf265-d26a-48d5-ad5c-cba357e2f7b7 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:45.590268 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160cf265-d26a-48d5-ad5c-cba357e2f7b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:45.591897 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160cf265-d26a-48d5-ad5c-cba357e2f7b7 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:45.598311 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 466/904] 10.222.0.15 () {56 vars in 1126 bytes} [Thu Aug 18 10:50:45 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:45.603858 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160cf265-d26a-48d5-ad5c-cba357e2f7b7 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:45.657479 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770cabb7-1201-489b-94c4-703349735fcd None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:45.700905 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff28398e-033f-435d-a237-beb4a182c9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:45.701573 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff28398e-033f-435d-a237-beb4a182c9cf None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:45.701857 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff28398e-033f-435d-a237-beb4a182c9cf None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:45.702128 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff28398e-033f-435d-a237-beb4a182c9cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:45.714400 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff28398e-033f-435d-a237-beb4a182c9cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:45.715699 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff28398e-033f-435d-a237-beb4a182c9cf None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:45.728626 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160cf265-d26a-48d5-ad5c-cba357e2f7b7 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:45.733370 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-ff28398e-033f-435d-a237-beb4a182c9cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:45.733370 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:45.733370 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:45.733370 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:45.733370 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:45.733370 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:45.733370 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:45.733370 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:45.733370 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:45.733370 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:45.733370 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:45.733370 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:45.733370 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 10:50:45.733370 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 10:50:45.733370 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 10:50:45.733370 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 10:50:45.734344 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:45.734344 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:45.734344 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:45.734344 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:45.734344 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:45.734344 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:45.734344 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:45.734344 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:45.734344 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:45.734344 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:45.734344 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:45.734344 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:45.734344 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:45.734344 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:45.734344 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:45.734344 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:45.734344 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 10:50:45.735256 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 10:50:45.735256 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:45.735256 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:45.735256 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 439/905] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:50:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:45.742572 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff28398e-033f-435d-a237-beb4a182c9cf None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:45.767681 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a05d07-167c-4d8e-95df-008b76d07da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:45.768409 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a05d07-167c-4d8e-95df-008b76d07da6 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:45.768689 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a05d07-167c-4d8e-95df-008b76d07da6 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:45.768965 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a05d07-167c-4d8e-95df-008b76d07da6 None admin] PATH_INFO: `/v3/services` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:45.769629 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a05d07-167c-4d8e-95df-008b76d07da6 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:45.769937 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a05d07-167c-4d8e-95df-008b76d07da6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:45.771447 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a05d07-167c-4d8e-95df-008b76d07da6 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:45.777923 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 467/906] 10.222.0.15 () {56 vars in 1126 bytes} [Thu Aug 18 10:50:45 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:45.784370 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a05d07-167c-4d8e-95df-008b76d07da6 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:45.803159 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:45.839020 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:45.864907 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff28398e-033f-435d-a237-beb4a182c9cf None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:45.895534 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a05d07-167c-4d8e-95df-008b76d07da6 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:45.904914 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b0d2c5-0b9f-4d71-939b-b2a09c39f831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:45.905609 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b0d2c5-0b9f-4d71-939b-b2a09c39f831 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:45.905893 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b0d2c5-0b9f-4d71-939b-b2a09c39f831 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:45.906551 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b0d2c5-0b9f-4d71-939b-b2a09c39f831 None admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:45.906853 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b0d2c5-0b9f-4d71-939b-b2a09c39f831 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:45.907153 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b0d2c5-0b9f-4d71-939b-b2a09c39f831 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:45.908636 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b0d2c5-0b9f-4d71-939b-b2a09c39f831 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:45.922697 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 440/907] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 18 10:50:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 10:50:45.930622 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b0d2c5-0b9f-4d71-939b-b2a09c39f831 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:45.940706 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d82e870-c345-4e7c-8b6d-4b231ddfde6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:45.941321 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d82e870-c345-4e7c-8b6d-4b231ddfde6d None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:45.941663 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d82e870-c345-4e7c-8b6d-4b231ddfde6d None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:45.941942 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d82e870-c345-4e7c-8b6d-4b231ddfde6d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:45.942690 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d82e870-c345-4e7c-8b6d-4b231ddfde6d None admin] RBAC: Adding query filter params (interface=public, service_id=c1876555e54d452f95c89d96de3b677d, region_id=RegionOne) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:45.943001 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d82e870-c345-4e7c-8b6d-4b231ddfde6d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:45.944902 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d82e870-c345-4e7c-8b6d-4b231ddfde6d None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:45.955468 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 468/908] 10.222.0.15 () {56 vars in 1251 bytes} [Thu Aug 18 10:50:45 2022] GET /identity/v3/endpoints?service_id=c1876555e54d452f95c89d96de3b677d&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:45.956579 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d82e870-c345-4e7c-8b6d-4b231ddfde6d None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:46.070843 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d82e870-c345-4e7c-8b6d-4b231ddfde6d None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:46.074232 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b0d2c5-0b9f-4d71-939b-b2a09c39f831 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:46.077835 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:46.080659 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:46.118679 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece7c3f3-942d-4b05-a35d-14a25cf90c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:46.119127 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5dab15-c7af-40da-afaf-6803b99aa0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:46.119314 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7c3f3-942d-4b05-a35d-14a25cf90c53 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:46.119648 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7c3f3-942d-4b05-a35d-14a25cf90c53 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:46.119926 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7c3f3-942d-4b05-a35d-14a25cf90c53 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:46.120346 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5dab15-c7af-40da-afaf-6803b99aa0c9 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:46.120926 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5dab15-c7af-40da-afaf-6803b99aa0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:46.121344 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5dab15-c7af-40da-afaf-6803b99aa0c9 None admin] PATH_INFO: `/v3/services` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:46.122424 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5dab15-c7af-40da-afaf-6803b99aa0c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:46.124397 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5dab15-c7af-40da-afaf-6803b99aa0c9 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:46.128547 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece7c3f3-942d-4b05-a35d-14a25cf90c53 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:46.130157 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece7c3f3-942d-4b05-a35d-14a25cf90c53 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:46.137556 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 469/909] 10.222.0.15 () {56 vars in 1087 bytes} [Thu Aug 18 10:50:45 2022] GET /identity/v3/services => generated 1497 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 10:50:46.147949 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-ece7c3f3-942d-4b05-a35d-14a25cf90c53 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 10:50:46.147949 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:46.147949 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:46.147949 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:46.147949 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:46.147949 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:46.147949 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:46.147949 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:46.147949 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:46.147949 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:46.147949 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:46.147949 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:46.147949 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 10:50:46.147949 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 10:50:46.147949 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 10:50:46.149189 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 10:50:46.149189 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:46.149189 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:46.149189 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:46.149189 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:46.149189 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:46.149189 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:46.149189 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:46.149189 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:46.149189 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:46.149189 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:46.149189 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:46.149189 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:46.149189 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:46.149189 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:46.149189 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:46.149189 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:46.150115 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 10:50:46.150115 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 10:50:46.150115 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 10:50:46.150115 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 10:50:46.150115 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 10:50:46.150115 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 10:50:46.150115 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 10:50:46.150115 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:46.150115 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 441/910] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 18 10:50:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:46.158726 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5dab15-c7af-40da-afaf-6803b99aa0c9 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:46.284592 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5dab15-c7af-40da-afaf-6803b99aa0c9 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:46.328294 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4de031-4e7a-4585-96f6-0c3799e866ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:46.328824 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4de031-4e7a-4585-96f6-0c3799e866ec None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:46.329097 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4de031-4e7a-4585-96f6-0c3799e866ec None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:46.329413 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4de031-4e7a-4585-96f6-0c3799e866ec None admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:46.330136 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4de031-4e7a-4585-96f6-0c3799e866ec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:46.330436 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4de031-4e7a-4585-96f6-0c3799e866ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:46.331846 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4de031-4e7a-4585-96f6-0c3799e866ec None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:46.344672 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 470/911] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Aug 18 10:50:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:46.351116 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece7c3f3-942d-4b05-a35d-14a25cf90c53 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:46.460874 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece7c3f3-942d-4b05-a35d-14a25cf90c53 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:46.498000 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032c0092-c319-4c61-a442-9404939fc71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:46.498603 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c0092-c319-4c61-a442-9404939fc71d None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:46.498888 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c0092-c319-4c61-a442-9404939fc71d None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:46.499253 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c0092-c319-4c61-a442-9404939fc71d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:46.499998 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032c0092-c319-4c61-a442-9404939fc71d None admin] RBAC: Adding query filter params (role.id=3e108171f00d4bff8db5c27b4446c417, scope.project.id=1575e8ebaaab4650995841659b6e631b, user.id=bcacf809f13043ab90716607160a70db) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:46.500304 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032c0092-c319-4c61-a442-9404939fc71d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:46.501760 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032c0092-c319-4c61-a442-9404939fc71d None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:46.507958 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 442/912] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Aug 18 10:50:46 2022] GET /identity/v3/role_assignments?user.id=bcacf809f13043ab90716607160a70db&scope.project.id=1575e8ebaaab4650995841659b6e631b&role.id=3e108171f00d4bff8db5c27b4446c417 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:47.113968 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f9434-d92c-43d3-94f2-3b72e053d735 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:47.114547 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f9434-d92c-43d3-94f2-3b72e053d735 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:47.114547 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f9434-d92c-43d3-94f2-3b72e053d735 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:47.116251 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 471/913] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:50:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:50:47.121899 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a19a3-1ee0-4d60-96d0-e1516612e376 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:47.122368 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a19a3-1ee0-4d60-96d0-e1516612e376 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:47.122460 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a19a3-1ee0-4d60-96d0-e1516612e376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:47.140922 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-3f7a19a3-1ee0-4d60-96d0-e1516612e376 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:50:47.142142 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-3f7a19a3-1ee0-4d60-96d0-e1516612e376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:50:47.168094 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:47.215994 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 443/914] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:50:47 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 10:50:47.482835 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f9434-d92c-43d3-94f2-3b72e053d735 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:47.520531 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:47.542879 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3847a0-3056-4f36-9063-3fc1b62d0857 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:47.543238 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3847a0-3056-4f36-9063-3fc1b62d0857 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:47.543428 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3847a0-3056-4f36-9063-3fc1b62d0857 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:47.545045 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 444/915] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:50:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:50:47.550292 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d0fb4-adb3-4c35-a202-e8702d57f923 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:47.550576 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d0fb4-adb3-4c35-a202-e8702d57f923 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:47.550851 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d0fb4-adb3-4c35-a202-e8702d57f923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:47.569626 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-bc0d0fb4-adb3-4c35-a202-e8702d57f923 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:50:47.570909 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-bc0d0fb4-adb3-4c35-a202-e8702d57f923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:50:47.614286 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f9434-d92c-43d3-94f2-3b72e053d735 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:47.655735 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135338f9-24d6-402c-93b4-bea6e4855cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:47.656378 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135338f9-24d6-402c-93b4-bea6e4855cdf None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:47.656660 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135338f9-24d6-402c-93b4-bea6e4855cdf None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:47.656940 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135338f9-24d6-402c-93b4-bea6e4855cdf None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:47.657555 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135338f9-24d6-402c-93b4-bea6e4855cdf None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:47.658933 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135338f9-24d6-402c-93b4-bea6e4855cdf None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:47.661641 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 445/916] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:50:47 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 10:50:47.669129 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-135338f9-24d6-402c-93b4-bea6e4855cdf None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 10:50:47.669129 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:47.669129 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 10:50:47.669129 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 10:50:47.669129 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 10:50:47.669129 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 10:50:47.669129 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 10:50:47.669129 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 10:50:47.669129 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 10:50:47.669129 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:47.669129 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 10:50:47.669129 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:47.669129 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:47.669129 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:47.669129 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:47.669129 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:47.669129 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:47.670226 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:47.670226 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:47.670226 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:47.670226 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:47.670226 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:47.670226 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:47.670226 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 10:50:47.670226 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 10:50:47.670226 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 10:50:47.670226 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 10:50:47.670226 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:47.670226 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:47.670226 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:47.670226 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:47.670226 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:47.670226 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:47.671118 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:47.671118 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:47.671118 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:47.671118 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:47.671118 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:47.671118 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:47.671118 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:47.671118 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:47.671118 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:47.671118 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:47.671118 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 10:50:47.671118 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 10:50:47.671118 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 10:50:47.671118 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:47.671118 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 472/917] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Aug 18 10:50:47 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:47.677939 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0d0fb4-adb3-4c35-a202-e8702d57f923 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:47.771360 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:47.787059 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0d0fb4-adb3-4c35-a202-e8702d57f923 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:47.827163 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15ef832-4108-4c46-be44-0e6349645e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:47.827780 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ef832-4108-4c46-be44-0e6349645e99 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:47.828064 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ef832-4108-4c46-be44-0e6349645e99 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:47.828339 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ef832-4108-4c46-be44-0e6349645e99 None admin] PATH_INFO: `/v3/services` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:47.828979 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15ef832-4108-4c46-be44-0e6349645e99 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:47.829282 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15ef832-4108-4c46-be44-0e6349645e99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:47.830687 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15ef832-4108-4c46-be44-0e6349645e99 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:47.837042 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 446/918] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Aug 18 10:50:47 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:47.843034 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135338f9-24d6-402c-93b4-bea6e4855cdf None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:47.933476 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15ef832-4108-4c46-be44-0e6349645e99 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:47.968028 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:47.978303 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135338f9-24d6-402c-93b4-bea6e4855cdf None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:48.028146 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c55c2b-4483-4067-8689-2ccc9f7593f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:48.028683 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c55c2b-4483-4067-8689-2ccc9f7593f6 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:48.028967 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c55c2b-4483-4067-8689-2ccc9f7593f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:48.029246 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c55c2b-4483-4067-8689-2ccc9f7593f6 None admin] PATH_INFO: `/v3/services` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:48.029920 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c55c2b-4483-4067-8689-2ccc9f7593f6 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:48.030227 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c55c2b-4483-4067-8689-2ccc9f7593f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:48.032169 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c55c2b-4483-4067-8689-2ccc9f7593f6 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:48.042034 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 473/919] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Aug 18 10:50:47 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:48.046259 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15ef832-4108-4c46-be44-0e6349645e99 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:48.050487 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c55c2b-4483-4067-8689-2ccc9f7593f6 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:48.086831 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6be61b5-3939-4759-9ab8-30c2b43d89e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:48.087858 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be61b5-3939-4759-9ab8-30c2b43d89e4 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:48.088357 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be61b5-3939-4759-9ab8-30c2b43d89e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:48.088835 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be61b5-3939-4759-9ab8-30c2b43d89e4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:48.089644 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6be61b5-3939-4759-9ab8-30c2b43d89e4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:48.091232 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6be61b5-3939-4759-9ab8-30c2b43d89e4 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:48.101259 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-e6be61b5-3939-4759-9ab8-30c2b43d89e4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 10:50:48.101259 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:48.101259 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 10:50:48.101259 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 10:50:48.101259 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 10:50:48.101259 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 10:50:48.101259 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 10:50:48.101259 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 10:50:48.101259 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 10:50:48.101259 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:48.101259 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 10:50:48.101259 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:48.101259 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:48.101259 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:48.101259 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:48.101259 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:48.101259 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:48.102334 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:48.102334 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:48.102334 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:48.102334 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:48.102334 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:48.102334 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:48.102334 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 10:50:48.102334 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 10:50:48.102334 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 10:50:48.102334 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 10:50:48.102334 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:48.102334 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:48.102334 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:48.102334 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:48.102334 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:48.102334 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:48.103276 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:48.103276 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:48.103276 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:48.103276 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:48.103276 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:48.103276 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:48.103276 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:48.103276 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:48.103276 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:48.103276 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:48.103276 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 10:50:48.103276 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 10:50:48.103276 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 10:50:48.103276 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:48.106034 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 447/920] 10.222.0.15 () {56 vars in 1126 bytes} [Thu Aug 18 10:50:47 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:48.112138 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6be61b5-3939-4759-9ab8-30c2b43d89e4 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:48.138439 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:48.182843 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c55c2b-4483-4067-8689-2ccc9f7593f6 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:48.226237 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca100d17-3776-4ad2-8ab1-dbf3d17d239e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:48.226942 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca100d17-3776-4ad2-8ab1-dbf3d17d239e None admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:48.227220 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca100d17-3776-4ad2-8ab1-dbf3d17d239e None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:48.227495 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca100d17-3776-4ad2-8ab1-dbf3d17d239e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:48.228172 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca100d17-3776-4ad2-8ab1-dbf3d17d239e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:48.229568 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca100d17-3776-4ad2-8ab1-dbf3d17d239e None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:48.244150 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6be61b5-3939-4759-9ab8-30c2b43d89e4 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:48.257313 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 474/921] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 10:50:48 2022] POST /identity/v3/endpoints => generated 346 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 10:50:48.257313 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688378fd-2baa-4ed2-8b62-e8ef1ab4c143 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:48.257313 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688378fd-2baa-4ed2-8b62-e8ef1ab4c143 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:48.257313 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688378fd-2baa-4ed2-8b62-e8ef1ab4c143 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:48.257313 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 475/922] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:50:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:50:48.263044 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc2d1f-1ac8-49ff-8bd2-20d4ecfd0c48 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:48.263318 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc2d1f-1ac8-49ff-8bd2-20d4ecfd0c48 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:48.263655 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc2d1f-1ac8-49ff-8bd2-20d4ecfd0c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:48.284980 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-bcdc2d1f-1ac8-49ff-8bd2-20d4ecfd0c48 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:50:48.286245 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-bcdc2d1f-1ac8-49ff-8bd2-20d4ecfd0c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:50:48.303637 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:48.320155 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb45cf-4fdf-4abe-855e-ed960a5d801b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:48.321262 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb45cf-4fdf-4abe-855e-ed960a5d801b None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:48.321841 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb45cf-4fdf-4abe-855e-ed960a5d801b None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:48.322298 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb45cf-4fdf-4abe-855e-ed960a5d801b None admin] PATH_INFO: `/v3/services` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:48.324163 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cb45cf-4fdf-4abe-855e-ed960a5d801b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:48.324745 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cb45cf-4fdf-4abe-855e-ed960a5d801b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:48.327163 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cb45cf-4fdf-4abe-855e-ed960a5d801b None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:48.335812 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 448/923] 10.222.0.15 () {56 vars in 1122 bytes} [Thu Aug 18 10:50:48 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:48.342013 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb45cf-4fdf-4abe-855e-ed960a5d801b None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:48.395512 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 476/924] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:50:48 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 10:50:48.452615 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:48.482038 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb45cf-4fdf-4abe-855e-ed960a5d801b None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:48.519702 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f232b-bba3-4707-bbaf-cc5bf84834fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:48.520323 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f232b-bba3-4707-bbaf-cc5bf84834fe None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:48.520601 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f232b-bba3-4707-bbaf-cc5bf84834fe None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:48.520876 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f232b-bba3-4707-bbaf-cc5bf84834fe None admin] PATH_INFO: `/v3/services` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:48.521557 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2f232b-bba3-4707-bbaf-cc5bf84834fe None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:48.521854 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2f232b-bba3-4707-bbaf-cc5bf84834fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:48.523644 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2f232b-bba3-4707-bbaf-cc5bf84834fe None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:48.529428 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 449/925] 10.222.0.15 () {56 vars in 1122 bytes} [Thu Aug 18 10:50:48 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 10:50:48.535670 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdc2d1f-1ac8-49ff-8bd2-20d4ecfd0c48 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:48.603839 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93fc303-064c-4e95-a6f4-ebcd20a68b18 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:48.604209 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93fc303-064c-4e95-a6f4-ebcd20a68b18 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:48.604392 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93fc303-064c-4e95-a6f4-ebcd20a68b18 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:48.606030 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 450/926] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:50:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:50:48.611173 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c02e8f-f47f-4a14-bfd2-6702b48640e9 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:48.611460 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c02e8f-f47f-4a14-bfd2-6702b48640e9 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:48.611740 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c02e8f-f47f-4a14-bfd2-6702b48640e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:48.632158 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-47c02e8f-f47f-4a14-bfd2-6702b48640e9 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:50:48.633802 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-47c02e8f-f47f-4a14-bfd2-6702b48640e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:50:48.646709 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdc2d1f-1ac8-49ff-8bd2-20d4ecfd0c48 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:48.689809 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4f7c3d-97cb-4a53-8fe0-7c833b3f637e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:48.690954 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f7c3d-97cb-4a53-8fe0-7c833b3f637e None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:48.691461 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f7c3d-97cb-4a53-8fe0-7c833b3f637e None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:48.691971 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f7c3d-97cb-4a53-8fe0-7c833b3f637e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:48.693313 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4f7c3d-97cb-4a53-8fe0-7c833b3f637e None admin] RBAC: Adding query filter params (interface=public, service_id=2d6b8436a78742a9a0a22763967900fa, region_id=RegionOne) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:48.694569 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4f7c3d-97cb-4a53-8fe0-7c833b3f637e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:48.697078 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4f7c3d-97cb-4a53-8fe0-7c833b3f637e None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:48.702928 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 477/927] 10.222.0.15 () {56 vars in 1251 bytes} [Thu Aug 18 10:50:48 2022] GET /identity/v3/endpoints?service_id=2d6b8436a78742a9a0a22763967900fa&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:48.703742 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4f7c3d-97cb-4a53-8fe0-7c833b3f637e None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:48.717987 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 451/928] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:50:48 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 10:50:48.718175 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:48.719362 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c02e8f-f47f-4a14-bfd2-6702b48640e9 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:48.811331 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:48.833793 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4f7c3d-97cb-4a53-8fe0-7c833b3f637e None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:48.853795 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c02e8f-f47f-4a14-bfd2-6702b48640e9 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:48.882107 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542a2390-b808-4bc2-848f-1c57c56995a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:48.882772 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542a2390-b808-4bc2-848f-1c57c56995a3 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:48.883053 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542a2390-b808-4bc2-848f-1c57c56995a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:48.883327 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542a2390-b808-4bc2-848f-1c57c56995a3 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:48.883921 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542a2390-b808-4bc2-848f-1c57c56995a3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:48.886059 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542a2390-b808-4bc2-848f-1c57c56995a3 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:48.895725 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0b111b-a0f5-419c-a847-0db2c1d11055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:48.897655 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b111b-a0f5-419c-a847-0db2c1d11055 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:48.897843 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-542a2390-b808-4bc2-848f-1c57c56995a3 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 10:50:48.897843 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:48.897843 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 10:50:48.897843 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 10:50:48.897843 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 10:50:48.897843 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 10:50:48.897843 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 10:50:48.897843 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 10:50:48.897843 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 10:50:48.897843 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:48.897843 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 10:50:48.897843 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:48.897843 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:48.897843 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:48.897843 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:48.897843 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:48.899629 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:48.899629 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:48.899629 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:48.899629 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:48.899629 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:48.899629 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:48.899629 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:48.899629 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 10:50:48.899629 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 10:50:48.899629 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 10:50:48.899629 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 10:50:48.899629 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:48.899629 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:48.899629 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:48.899629 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:48.899629 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:48.899629 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:48.901114 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:48.901114 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:48.901114 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:48.901114 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:48.901114 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:48.901114 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:48.901114 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:48.901114 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:48.901114 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:48.901114 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:48.901114 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 10:50:48.901114 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 10:50:48.901114 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 10:50:48.901114 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:48.904062 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b111b-a0f5-419c-a847-0db2c1d11055 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:48.904387 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 478/929] 10.222.0.15 () {56 vars in 1132 bytes} [Thu Aug 18 10:50:48 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:48.905153 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b111b-a0f5-419c-a847-0db2c1d11055 None admin] PATH_INFO: `/v3/services` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:48.905352 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542a2390-b808-4bc2-848f-1c57c56995a3 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:48.906286 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0b111b-a0f5-419c-a847-0db2c1d11055 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:48.907885 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0b111b-a0f5-419c-a847-0db2c1d11055 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:48.921967 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 452/930] 10.222.0.15 () {56 vars in 1087 bytes} [Thu Aug 18 10:50:48 2022] GET /identity/v3/services => generated 1497 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 10:50:49.004254 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:49.016857 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0b111b-a0f5-419c-a847-0db2c1d11055 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:49.039782 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542a2390-b808-4bc2-848f-1c57c56995a3 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:49.079206 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608559ee-7450-4f54-976c-57f25758129b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:49.079739 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608559ee-7450-4f54-976c-57f25758129b None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:49.080017 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608559ee-7450-4f54-976c-57f25758129b None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:49.080288 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608559ee-7450-4f54-976c-57f25758129b None admin] PATH_INFO: `/v3/services` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:49.080966 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608559ee-7450-4f54-976c-57f25758129b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:49.081230 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608559ee-7450-4f54-976c-57f25758129b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:49.082689 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608559ee-7450-4f54-976c-57f25758129b None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:49.089457 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 479/931] 10.222.0.15 () {56 vars in 1126 bytes} [Thu Aug 18 10:50:48 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:49.095791 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608559ee-7450-4f54-976c-57f25758129b None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:49.175474 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0b111b-a0f5-419c-a847-0db2c1d11055 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:49.212411 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608559ee-7450-4f54-976c-57f25758129b None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:49.238458 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd60ffe-2a5f-4659-8359-6fcc4d3b40ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:49.240525 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd60ffe-2a5f-4659-8359-6fcc4d3b40ab None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:49.241868 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd60ffe-2a5f-4659-8359-6fcc4d3b40ab None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:49.242959 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd60ffe-2a5f-4659-8359-6fcc4d3b40ab None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:49.248000 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:49.252815 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1451ae4b-1611-4cf9-8a66-068a8d8b63dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:49.253424 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1451ae4b-1611-4cf9-8a66-068a8d8b63dd None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:49.253749 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1451ae4b-1611-4cf9-8a66-068a8d8b63dd None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:49.254023 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1451ae4b-1611-4cf9-8a66-068a8d8b63dd None admin] PATH_INFO: `/v3/services` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:49.254662 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1451ae4b-1611-4cf9-8a66-068a8d8b63dd None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:49.254964 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1451ae4b-1611-4cf9-8a66-068a8d8b63dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:49.257028 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1451ae4b-1611-4cf9-8a66-068a8d8b63dd None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:49.264461 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd60ffe-2a5f-4659-8359-6fcc4d3b40ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:50:49.267875 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 480/932] 10.222.0.15 () {56 vars in 1126 bytes} [Thu Aug 18 10:50:49 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:49.269217 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1451ae4b-1611-4cf9-8a66-068a8d8b63dd None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:49.270459 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-dcd60ffe-2a5f-4659-8359-6fcc4d3b40ab None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 10:50:49.270459 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:49.270459 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:49.270459 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:49.270459 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:49.270459 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:49.270459 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:49.270459 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:49.270459 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:49.270459 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:49.270459 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:49.270459 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:49.270459 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:50:49.270459 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:50:49.270459 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:50:49.270459 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:50:49.271417 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:50:49.271417 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:50:49.271417 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:50:49.271417 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:50:49.271417 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:49.271417 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:49.271417 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:49.271417 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:49.271417 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:49.271417 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:49.271417 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:49.271417 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:49.271417 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:49.271417 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:49.271417 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:49.271417 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:49.272846 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:49.272846 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:49.272846 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:49.272846 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:49.272846 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:50:49.272846 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:50:49.272846 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:50:49.272846 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:50:49.272846 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:50:49.272846 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:50:49.272846 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 10:50:49.272846 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:49.273839 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:49.275098 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 453/933] 10.222.0.15 () {56 vars in 1120 bytes} [Thu Aug 18 10:50:49 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 10:50:49.287944 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd60ffe-2a5f-4659-8359-6fcc4d3b40ab None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:49.394875 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1451ae4b-1611-4cf9-8a66-068a8d8b63dd None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:49.405051 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd60ffe-2a5f-4659-8359-6fcc4d3b40ab None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:49.436439 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fa1ff5-832c-4cfb-8660-fea7b0e60785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:49.437080 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa1ff5-832c-4cfb-8660-fea7b0e60785 None admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:49.437452 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa1ff5-832c-4cfb-8660-fea7b0e60785 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:49.437868 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa1ff5-832c-4cfb-8660-fea7b0e60785 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:49.438574 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fa1ff5-832c-4cfb-8660-fea7b0e60785 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:49.440157 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fa1ff5-832c-4cfb-8660-fea7b0e60785 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:49.446374 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff4c5d8-5732-4182-b85b-0a25df9dcb64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:49.446998 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff4c5d8-5732-4182-b85b-0a25df9dcb64 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:49.447303 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff4c5d8-5732-4182-b85b-0a25df9dcb64 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:49.447582 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff4c5d8-5732-4182-b85b-0a25df9dcb64 None admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:49.448277 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff4c5d8-5732-4182-b85b-0a25df9dcb64 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:49.448594 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff4c5d8-5732-4182-b85b-0a25df9dcb64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:49.450087 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff4c5d8-5732-4182-b85b-0a25df9dcb64 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:49.466756 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 454/935] 10.222.0.15 () {56 vars in 1115 bytes} [Thu Aug 18 10:50:49 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:49.469737 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 481/935] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 10:50:49 2022] POST /identity/v3/endpoints => generated 347 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 10:50:49.471122 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff4c5d8-5732-4182-b85b-0a25df9dcb64 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:49.551146 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:49.609471 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff4c5d8-5732-4182-b85b-0a25df9dcb64 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:49.654911 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eab88f-2ee6-43b7-be5e-377cf97acbad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:49.655476 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eab88f-2ee6-43b7-be5e-377cf97acbad None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:49.655766 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eab88f-2ee6-43b7-be5e-377cf97acbad None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:49.656037 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eab88f-2ee6-43b7-be5e-377cf97acbad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:49.668394 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eab88f-2ee6-43b7-be5e-377cf97acbad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:49.669910 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eab88f-2ee6-43b7-be5e-377cf97acbad None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:49.685698 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-79eab88f-2ee6-43b7-be5e-377cf97acbad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:49.685698 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:49.685698 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:49.685698 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:49.685698 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:49.685698 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:49.685698 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:49.685698 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:49.685698 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:49.685698 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:49.685698 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:49.685698 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:49.685698 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 10:50:49.685698 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 10:50:49.685698 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 10:50:49.685698 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 10:50:49.686780 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:49.686780 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:49.686780 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:49.686780 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:49.686780 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:49.686780 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:49.686780 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:49.686780 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:49.686780 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:49.686780 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:49.686780 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:49.686780 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:49.686780 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:49.686780 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:49.686780 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:49.686780 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:49.686780 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 10:50:49.687680 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 10:50:49.687680 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:49.687680 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:49.687680 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 455/936] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:50:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:49.695266 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fa1ff5-832c-4cfb-8660-fea7b0e60785 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:49.759385 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:49.806449 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fa1ff5-832c-4cfb-8660-fea7b0e60785 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:49.842563 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f4c62e-d1f5-4d45-b642-f3d2ed808984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:49.843179 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f4c62e-d1f5-4d45-b642-f3d2ed808984 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:49.843456 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f4c62e-d1f5-4d45-b642-f3d2ed808984 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:49.843729 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f4c62e-d1f5-4d45-b642-f3d2ed808984 None admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:49.844387 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f4c62e-d1f5-4d45-b642-f3d2ed808984 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:49.844711 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f4c62e-d1f5-4d45-b642-f3d2ed808984 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:49.846106 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f4c62e-d1f5-4d45-b642-f3d2ed808984 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:49.859431 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 482/937] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 18 10:50:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:49.864742 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eab88f-2ee6-43b7-be5e-377cf97acbad None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:49.978894 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eab88f-2ee6-43b7-be5e-377cf97acbad None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:49.981293 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:50.016171 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc150413-6f72-4570-afa1-e72bd85fe032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:50.016814 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc150413-6f72-4570-afa1-e72bd85fe032 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:50.017092 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc150413-6f72-4570-afa1-e72bd85fe032 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:50.017364 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc150413-6f72-4570-afa1-e72bd85fe032 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:50.026697 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc150413-6f72-4570-afa1-e72bd85fe032 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:50.028157 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc150413-6f72-4570-afa1-e72bd85fe032 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:50.040872 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-bc150413-6f72-4570-afa1-e72bd85fe032 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 10:50:50.040872 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:50.040872 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:50.040872 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:50.040872 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:50.040872 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:50.040872 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:50.040872 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:50.040872 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:50.040872 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:50.040872 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:50.040872 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:50.040872 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 10:50:50.040872 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 10:50:50.040872 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 10:50:50.040872 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 10:50:50.041943 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:50.041943 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:50.041943 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 10:50:50.041943 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 10:50:50.041943 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 10:50:50.041943 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 10:50:50.041943 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:50.041943 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:50.041943 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:50.041943 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:50.041943 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:50.041943 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:50.041943 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:50.041943 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:50.041943 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:50.041943 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:50.041943 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:50.041943 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:50.042925 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:50.042925 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:50.042925 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 10:50:50.042925 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 10:50:50.042925 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 10:50:50.042925 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 10:50:50.042925 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 10:50:50.042925 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 10:50:50.042925 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 10:50:50.042925 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:50.042925 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 456/938] 10.222.0.15 () {56 vars in 1117 bytes} [Thu Aug 18 10:50:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:50.050204 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f4c62e-d1f5-4d45-b642-f3d2ed808984 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:50.164210 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f4c62e-d1f5-4d45-b642-f3d2ed808984 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:50.185264 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:50.206239 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe45bd03-c70c-4384-b95f-f56fd983897d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:50.206918 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45bd03-c70c-4384-b95f-f56fd983897d None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:50.207204 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45bd03-c70c-4384-b95f-f56fd983897d None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:50.207547 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45bd03-c70c-4384-b95f-f56fd983897d None admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:50.208298 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe45bd03-c70c-4384-b95f-f56fd983897d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:50.208607 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe45bd03-c70c-4384-b95f-f56fd983897d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:50.211123 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe45bd03-c70c-4384-b95f-f56fd983897d None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:50.231212 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 483/939] 10.222.0.15 () {56 vars in 1149 bytes} [Thu Aug 18 10:50:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:50.236455 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc150413-6f72-4570-afa1-e72bd85fe032 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:50.360014 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c190dfa8-7a16-4174-822f-c66364d5581e None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:50.360241 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc150413-6f72-4570-afa1-e72bd85fe032 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:50.360507 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c190dfa8-7a16-4174-822f-c66364d5581e None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:50.360828 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c190dfa8-7a16-4174-822f-c66364d5581e None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:50.363875 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 484/940] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:50:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:50:50.370198 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec551d9-d156-47c9-8c9e-808b8c8d804e None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:50.370632 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec551d9-d156-47c9-8c9e-808b8c8d804e None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:50.371460 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec551d9-d156-47c9-8c9e-808b8c8d804e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:50.395938 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-1ec551d9-d156-47c9-8c9e-808b8c8d804e None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:50:50.397304 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-1ec551d9-d156-47c9-8c9e-808b8c8d804e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:50:50.399965 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3d7dd0-9e68-4598-8e3e-5431791002ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:50.400610 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3d7dd0-9e68-4598-8e3e-5431791002ba None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:50.400888 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3d7dd0-9e68-4598-8e3e-5431791002ba None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:50.401161 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3d7dd0-9e68-4598-8e3e-5431791002ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:50.413620 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3d7dd0-9e68-4598-8e3e-5431791002ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:50.415101 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3d7dd0-9e68-4598-8e3e-5431791002ba None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:50.431430 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-1d3d7dd0-9e68-4598-8e3e-5431791002ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:50.431430 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:50.431430 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:50.431430 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:50.431430 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:50.431430 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:50.431430 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:50.431430 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:50.431430 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:50.431430 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:50.431430 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:50.431430 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:50.431430 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 10:50:50.431430 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 10:50:50.431430 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 10:50:50.431430 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 10:50:50.432645 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:50.432645 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:50.432645 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:50.432645 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:50.432645 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:50.432645 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:50.432645 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:50.432645 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:50.432645 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:50.432645 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:50.432645 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:50.432645 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:50.432645 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:50.432645 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:50.432645 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:50.432645 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:50.432645 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 10:50:50.433895 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 10:50:50.433895 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:50.433895 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:50.433895 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 457/941] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:50:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:50.439707 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3d7dd0-9e68-4598-8e3e-5431791002ba None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:50.460914 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:50.493605 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 485/942] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:50:50 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 10:50:50.564866 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3d7dd0-9e68-4598-8e3e-5431791002ba None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:50.606158 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c3aa9c-535a-40a3-9914-389fd68715e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:50.607166 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c3aa9c-535a-40a3-9914-389fd68715e7 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:50.607646 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c3aa9c-535a-40a3-9914-389fd68715e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:50.608138 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c3aa9c-535a-40a3-9914-389fd68715e7 None admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:50.609086 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c3aa9c-535a-40a3-9914-389fd68715e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:50.609624 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c3aa9c-535a-40a3-9914-389fd68715e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:50.611339 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c3aa9c-535a-40a3-9914-389fd68715e7 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:50.625736 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 458/943] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 18 10:50:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 10:50:50.632033 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec551d9-d156-47c9-8c9e-808b8c8d804e None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:50.736657 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec551d9-d156-47c9-8c9e-808b8c8d804e None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:50.744849 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:50.777256 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d71f12-3500-40db-9117-d645b56b20c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:50.777938 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d71f12-3500-40db-9117-d645b56b20c6 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:50.778216 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d71f12-3500-40db-9117-d645b56b20c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:50.778489 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d71f12-3500-40db-9117-d645b56b20c6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:50.785983 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d71f12-3500-40db-9117-d645b56b20c6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:50.787420 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d71f12-3500-40db-9117-d645b56b20c6 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:50.798967 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-46d71f12-3500-40db-9117-d645b56b20c6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 10:50:50.798967 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:50.798967 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:50.798967 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:50.798967 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:50.798967 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:50.798967 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:50.798967 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:50.798967 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:50.798967 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:50.798967 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:50.798967 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:50.798967 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 10:50:50.798967 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 10:50:50.798967 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 10:50:50.799866 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 10:50:50.799866 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:50.799866 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:50.799866 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:50.799866 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:50.799866 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:50.799866 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:50.799866 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:50.799866 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:50.799866 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:50.799866 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:50.799866 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:50.799866 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:50.799866 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:50.799866 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:50.799866 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:50.799866 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:50.800758 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 10:50:50.800758 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 10:50:50.800758 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 10:50:50.800758 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 10:50:50.800758 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 10:50:50.800758 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 10:50:50.800758 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 10:50:50.800758 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:50.800758 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 486/944] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 18 10:50:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:50.808099 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c3aa9c-535a-40a3-9914-389fd68715e7 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:50.827524 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d71f12-3500-40db-9117-d645b56b20c6 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:50.920063 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:50.947531 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d71f12-3500-40db-9117-d645b56b20c6 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:50.949845 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c3aa9c-535a-40a3-9914-389fd68715e7 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:50.985469 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f60ce1-3f70-4009-a9e9-aaad7a1f7f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:50.986504 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f60ce1-3f70-4009-a9e9-aaad7a1f7f2c None admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:50.987208 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f60ce1-3f70-4009-a9e9-aaad7a1f7f2c None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:50.987693 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f60ce1-3f70-4009-a9e9-aaad7a1f7f2c None admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:50.988701 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f60ce1-3f70-4009-a9e9-aaad7a1f7f2c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:50.990562 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f60ce1-3f70-4009-a9e9-aaad7a1f7f2c None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:50.993914 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: WARNING keystone.server.flask.common [None req-73f60ce1-3f70-4009-a9e9-aaad7a1f7f2c None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 18 10:50:50.995097 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c50a3d-5098-4c6a-a3aa-cb60f2d67aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:50.995868 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c50a3d-5098-4c6a-a3aa-cb60f2d67aa9 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:50.996300 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c50a3d-5098-4c6a-a3aa-cb60f2d67aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:50.996714 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c50a3d-5098-4c6a-a3aa-cb60f2d67aa9 None admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:50.997815 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c50a3d-5098-4c6a-a3aa-cb60f2d67aa9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:50.998113 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c50a3d-5098-4c6a-a3aa-cb60f2d67aa9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:50.999573 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c50a3d-5098-4c6a-a3aa-cb60f2d67aa9 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:51.017555 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.sql.core [None req-73f60ce1-3f70-4009-a9e9-aaad7a1f7f2c None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 18 10:50:51.017555 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 18 10:50:51.017555 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [parameters: {'id': '7c3fb2c4c5f54725bc869d19ee17acf3', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 18 10:50:51.017555 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81433) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 18 10:50:51.020627 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 459/945] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Aug 18 10:50:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:51.025571 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-73f60ce1-3f70-4009-a9e9-aaad7a1f7f2c None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7c3fb2c4c5f54725bc869d19ee17acf3.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7c3fb2c4c5f54725bc869d19ee17acf3. Aug 18 10:50:51.025571 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:51.025571 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 18 10:50:51.025571 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 18 10:50:51.025571 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 18 10:50:51.025571 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 18 10:50:51.025571 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 18 10:50:51.025571 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application result = self._query(query) Aug 18 10:50:51.025571 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 18 10:50:51.025571 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application conn.query(q) Aug 18 10:50:51.025571 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 18 10:50:51.025571 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 18 10:50:51.025571 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 18 10:50:51.026415 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application result.read() Aug 18 10:50:51.026415 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 18 10:50:51.026415 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 18 10:50:51.026415 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 18 10:50:51.026415 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 18 10:50:51.026415 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 18 10:50:51.026415 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 18 10:50:51.026415 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 18 10:50:51.026415 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 18 10:50:51.026415 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 18 10:50:51.026415 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:51.026415 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 18 10:50:51.026415 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:51.026415 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:51.026415 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 18 10:50:51.026415 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 18 10:50:51.026415 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 18 10:50:51.026415 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 18 10:50:51.030227 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 18 10:50:51.030227 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application next(self.gen) Aug 18 10:50:51.030227 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 18 10:50:51.030227 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application yield resource Aug 18 10:50:51.030227 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 18 10:50:51.030227 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application next(self.gen) Aug 18 10:50:51.030227 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 18 10:50:51.030227 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application self.session.rollback() Aug 18 10:50:51.030227 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 18 10:50:51.030227 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application self.force_reraise() Aug 18 10:50:51.030227 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 18 10:50:51.030227 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise self.value Aug 18 10:50:51.030227 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 18 10:50:51.030227 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 18 10:50:51.030227 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 18 10:50:51.030227 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application session.commit() Aug 18 10:50:51.030227 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 18 10:50:51.031179 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 18 10:50:51.031179 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 18 10:50:51.031179 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application self._prepare_impl() Aug 18 10:50:51.031179 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 18 10:50:51.031179 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application self.session.flush() Aug 18 10:50:51.031179 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 18 10:50:51.031179 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application self._flush(objects) Aug 18 10:50:51.031179 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 18 10:50:51.031179 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 18 10:50:51.031179 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 18 10:50:51.031179 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application compat.raise_( Aug 18 10:50:51.031179 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 18 10:50:51.031179 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception Aug 18 10:50:51.031179 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 18 10:50:51.031179 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application flush_context.execute() Aug 18 10:50:51.031179 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 18 10:50:51.031179 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rec.execute(self) Aug 18 10:50:51.032069 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 18 10:50:51.032069 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 18 10:50:51.032069 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 18 10:50:51.032069 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 18 10:50:51.032069 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 18 10:50:51.032069 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 18 10:50:51.032069 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 18 10:50:51.032069 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 18 10:50:51.032069 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 18 10:50:51.032069 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 18 10:50:51.032069 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 18 10:50:51.032069 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 18 10:50:51.032069 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 18 10:50:51.032069 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 18 10:50:51.032069 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 18 10:50:51.032848 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 18 10:50:51.032848 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 18 10:50:51.032848 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception Aug 18 10:50:51.032848 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 18 10:50:51.032848 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 18 10:50:51.032848 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 18 10:50:51.032848 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 18 10:50:51.032848 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 18 10:50:51.032848 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application result = self._query(query) Aug 18 10:50:51.032848 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 18 10:50:51.032848 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application conn.query(q) Aug 18 10:50:51.032848 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 18 10:50:51.032848 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 18 10:50:51.032848 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 18 10:50:51.032848 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application result.read() Aug 18 10:50:51.032848 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 18 10:50:51.032848 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 18 10:50:51.033752 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 18 10:50:51.033752 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 18 10:50:51.033752 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 18 10:50:51.033752 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 18 10:50:51.033752 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 18 10:50:51.033752 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 18 10:50:51.033752 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 18 10:50:51.033752 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 18 10:50:51.033752 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [parameters: {'id': '7c3fb2c4c5f54725bc869d19ee17acf3', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 18 10:50:51.033752 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 18 10:50:51.033752 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:51.033752 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 10:50:51.033752 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:51.033752 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:51.033752 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 18 10:50:51.034537 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 18 10:50:51.034537 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 18 10:50:51.034537 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 18 10:50:51.034537 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 18 10:50:51.034537 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:51.034537 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 10:50:51.034537 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:51.034537 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:51.034537 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:51.034537 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:51.034537 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:51.034537 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:51.034537 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:51.034537 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:51.034537 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:51.034537 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:51.034537 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:51.036332 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:51.036332 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 18 10:50:51.036332 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 18 10:50:51.036332 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:51.036332 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:51.036332 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 18 10:50:51.036332 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 18 10:50:51.036332 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7c3fb2c4c5f54725bc869d19ee17acf3. Aug 18 10:50:51.036332 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:51.038871 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c50a3d-5098-4c6a-a3aa-cb60f2d67aa9 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:51.039021 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 487/946] 10.222.0.15 () {60 vars in 1140 bytes} [Thu Aug 18 10:50:50 2022] POST /identity/v3/projects => generated 262 bytes in 204 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 18 10:50:51.039021 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f60ce1-3f70-4009-a9e9-aaad7a1f7f2c None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:51.090183 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:51.144197 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c50a3d-5098-4c6a-a3aa-cb60f2d67aa9 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:51.156268 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f60ce1-3f70-4009-a9e9-aaad7a1f7f2c None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:51.185319 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db34891-13ff-40db-8e93-c9aae188ce46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:51.186016 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db34891-13ff-40db-8e93-c9aae188ce46 None admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:51.186299 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db34891-13ff-40db-8e93-c9aae188ce46 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:51.186586 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db34891-13ff-40db-8e93-c9aae188ce46 None admin] PATH_INFO: `/v3/projects/1575e8ebaaab4650995841659b6e631b/users/bcacf809f13043ab90716607160a70db/roles/3e108171f00d4bff8db5c27b4446c417` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:51.189315 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db34891-13ff-40db-8e93-c9aae188ce46 None admin] RBAC: Authorizing `identity:create_grant(project_id=1575e8ebaaab4650995841659b6e631b, user_id=bcacf809f13043ab90716607160a70db, role_id=3e108171f00d4bff8db5c27b4446c417)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:51.190679 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db34891-13ff-40db-8e93-c9aae188ce46 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:51.192850 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0f878d-2483-4d9f-a3f5-9ad671a3bba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:51.193475 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0f878d-2483-4d9f-a3f5-9ad671a3bba2 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:51.193802 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0f878d-2483-4d9f-a3f5-9ad671a3bba2 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:51.194526 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0f878d-2483-4d9f-a3f5-9ad671a3bba2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:51.195454 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:51.202324 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0f878d-2483-4d9f-a3f5-9ad671a3bba2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:51.203997 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0f878d-2483-4d9f-a3f5-9ad671a3bba2 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:51.214137 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 460/947] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Aug 18 10:50:51 2022] PUT /identity/v3/projects/1575e8ebaaab4650995841659b6e631b/users/bcacf809f13043ab90716607160a70db/roles/3e108171f00d4bff8db5c27b4446c417 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 10:50:51.218015 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d3c6b0-b2ad-42a9-be4a-837e1bb48e35 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:51.218015 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d3c6b0-b2ad-42a9-be4a-837e1bb48e35 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:51.218015 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d3c6b0-b2ad-42a9-be4a-837e1bb48e35 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:51.222265 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 461/948] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:50:51 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:50:51.230733 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-9b0f878d-2483-4d9f-a3f5-9ad671a3bba2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 10:50:51.230733 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:51.230733 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:51.230733 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:51.230733 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:51.230733 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:51.230733 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:51.230733 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:51.230733 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:51.230733 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:51.230733 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:51.230733 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:51.230733 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 10:50:51.230733 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 10:50:51.230733 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 10:50:51.233219 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 10:50:51.233219 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:51.233219 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:51.233219 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:51.233219 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:51.233219 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:51.233219 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:51.233219 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:51.233219 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:51.233219 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:51.233219 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:51.233219 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:51.233219 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:51.233219 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:51.233219 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:51.233219 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:51.233219 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:51.234514 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 10:50:51.234514 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 10:50:51.234514 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 10:50:51.234514 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 10:50:51.234514 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 10:50:51.234514 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 10:50:51.234514 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 10:50:51.234514 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:51.235155 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05ee90f-8f6d-4b11-b67b-9e4d006de35b None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:51.235155 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05ee90f-8f6d-4b11-b67b-9e4d006de35b None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:51.235155 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05ee90f-8f6d-4b11-b67b-9e4d006de35b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:51.242678 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 488/949] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 18 10:50:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:51.244286 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0f878d-2483-4d9f-a3f5-9ad671a3bba2 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:51.262099 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-b05ee90f-8f6d-4b11-b67b-9e4d006de35b None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:50:51.263146 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-b05ee90f-8f6d-4b11-b67b-9e4d006de35b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:50:51.350086 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:51.368443 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 462/950] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:50:51 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 10:50:51.374961 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0f878d-2483-4d9f-a3f5-9ad671a3bba2 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:51.412119 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a68b5ff-b015-4da3-b610-db0ccfaabebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:51.413451 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a68b5ff-b015-4da3-b610-db0ccfaabebf None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:51.414126 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a68b5ff-b015-4da3-b610-db0ccfaabebf None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:51.414296 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a68b5ff-b015-4da3-b610-db0ccfaabebf None admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:51.415026 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a68b5ff-b015-4da3-b610-db0ccfaabebf None admin] RBAC: Adding query filter params (name=service) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:51.415387 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a68b5ff-b015-4da3-b610-db0ccfaabebf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:51.416897 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a68b5ff-b015-4da3-b610-db0ccfaabebf None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:51.439807 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 489/951] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Aug 18 10:50:51 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:51.649140 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05ee90f-8f6d-4b11-b67b-9e4d006de35b None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:51.673185 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf66b251-3100-49b4-89d6-cb382a4f2b06 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:51.673563 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf66b251-3100-49b4-89d6-cb382a4f2b06 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:51.673789 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf66b251-3100-49b4-89d6-cb382a4f2b06 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:51.675289 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 490/952] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:50:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:50:51.681176 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b0a1b4-4943-410f-9772-359b13a9122e None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:51.681464 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b0a1b4-4943-410f-9772-359b13a9122e None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:51.681843 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b0a1b4-4943-410f-9772-359b13a9122e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:51.701469 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-62b0a1b4-4943-410f-9772-359b13a9122e None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:50:51.703089 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-62b0a1b4-4943-410f-9772-359b13a9122e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:50:51.769042 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05ee90f-8f6d-4b11-b67b-9e4d006de35b None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:51.784273 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 491/953] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:50:51 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 10:50:51.797372 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:51.806577 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2384c8d5-eafe-4ff6-a3d5-6dc4d60221c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:51.807216 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384c8d5-eafe-4ff6-a3d5-6dc4d60221c5 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:51.807495 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384c8d5-eafe-4ff6-a3d5-6dc4d60221c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:51.807769 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384c8d5-eafe-4ff6-a3d5-6dc4d60221c5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:51.808353 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2384c8d5-eafe-4ff6-a3d5-6dc4d60221c5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:51.809744 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2384c8d5-eafe-4ff6-a3d5-6dc4d60221c5 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:51.818710 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-2384c8d5-eafe-4ff6-a3d5-6dc4d60221c5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 10:50:51.818710 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:51.818710 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 10:50:51.818710 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 10:50:51.818710 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 10:50:51.818710 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 10:50:51.818710 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 10:50:51.818710 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 10:50:51.818710 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 10:50:51.818710 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:51.818710 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 10:50:51.818710 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:51.818710 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:51.818710 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:51.818710 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:51.818710 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:51.818710 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:51.820534 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:51.820534 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:51.820534 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:51.820534 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:51.820534 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:51.820534 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:51.820534 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 10:50:51.820534 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 10:50:51.820534 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 10:50:51.820534 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 10:50:51.820534 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:51.820534 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:51.820534 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:51.820534 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:51.820534 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:51.820534 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:51.821794 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:51.821794 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:51.821794 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:51.821794 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:51.821794 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:51.821794 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:51.821794 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:51.821794 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:51.821794 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:51.821794 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:51.821794 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 10:50:51.821794 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 10:50:51.821794 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 10:50:51.821794 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:51.824781 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 463/954] 10.222.0.15 () {56 vars in 1126 bytes} [Thu Aug 18 10:50:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:51.826646 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b0a1b4-4943-410f-9772-359b13a9122e None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:51.905755 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:51.937983 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b0a1b4-4943-410f-9772-359b13a9122e None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:51.976475 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6465b5-71ef-4088-a55a-45778f59f1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:51.977092 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6465b5-71ef-4088-a55a-45778f59f1a0 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:51.977367 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6465b5-71ef-4088-a55a-45778f59f1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:51.977675 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6465b5-71ef-4088-a55a-45778f59f1a0 None admin] PATH_INFO: `/v3/services` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:51.978309 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6465b5-71ef-4088-a55a-45778f59f1a0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:51.978607 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6465b5-71ef-4088-a55a-45778f59f1a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:51.979973 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6465b5-71ef-4088-a55a-45778f59f1a0 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:51.989628 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 492/955] 10.222.0.15 () {56 vars in 1122 bytes} [Thu Aug 18 10:50:51 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:51.991260 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2384c8d5-eafe-4ff6-a3d5-6dc4d60221c5 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:52.065989 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6465b5-71ef-4088-a55a-45778f59f1a0 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:52.103100 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2384c8d5-eafe-4ff6-a3d5-6dc4d60221c5 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:52.140486 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e69ed2a-0d78-4ec6-a982-c8a40685eafb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:52.141098 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e69ed2a-0d78-4ec6-a982-c8a40685eafb None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:52.141367 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e69ed2a-0d78-4ec6-a982-c8a40685eafb None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:52.141682 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e69ed2a-0d78-4ec6-a982-c8a40685eafb None admin] PATH_INFO: `/v3/services` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:52.142314 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e69ed2a-0d78-4ec6-a982-c8a40685eafb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:52.142611 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e69ed2a-0d78-4ec6-a982-c8a40685eafb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:52.143967 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e69ed2a-0d78-4ec6-a982-c8a40685eafb None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:52.150569 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 464/956] 10.222.0.15 () {56 vars in 1122 bytes} [Thu Aug 18 10:50:51 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:52.156910 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e69ed2a-0d78-4ec6-a982-c8a40685eafb None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:52.184089 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6465b5-71ef-4088-a55a-45778f59f1a0 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:52.225793 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1023f5-5b1e-4c1e-895a-792113b87e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:52.225793 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1023f5-5b1e-4c1e-895a-792113b87e67 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:52.225793 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1023f5-5b1e-4c1e-895a-792113b87e67 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:52.225793 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1023f5-5b1e-4c1e-895a-792113b87e67 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:52.226503 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1023f5-5b1e-4c1e-895a-792113b87e67 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:52.226503 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1023f5-5b1e-4c1e-895a-792113b87e67 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:52.228832 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:52.229832 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:52.238784 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-4e1023f5-5b1e-4c1e-895a-792113b87e67 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 10:50:52.238784 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:52.238784 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 10:50:52.238784 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 10:50:52.238784 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 10:50:52.238784 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 10:50:52.238784 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 10:50:52.238784 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 10:50:52.238784 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 10:50:52.238784 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:52.238784 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 10:50:52.238784 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:52.238784 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:52.238784 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:52.238784 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:52.238784 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:52.238784 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:52.240490 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:52.240490 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:52.240490 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:52.240490 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:52.240490 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:52.240490 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:52.240490 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 10:50:52.240490 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 10:50:52.240490 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 10:50:52.240490 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 10:50:52.240490 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:52.240490 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:52.240490 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:52.240490 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:52.240490 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:52.240490 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:52.241603 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:52.241603 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:52.241603 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:52.241603 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:52.241603 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:52.241603 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:52.241603 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:52.241603 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:52.241603 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:52.241603 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:52.241603 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 10:50:52.241603 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 10:50:52.241603 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 10:50:52.241603 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:52.248952 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 493/957] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 18 10:50:52 2022] GET /identity/v3/services/compute => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 10:50:52.250061 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1023f5-5b1e-4c1e-895a-792113b87e67 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:52.284050 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e69ed2a-0d78-4ec6-a982-c8a40685eafb None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:52.329034 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87eaac7-b689-4441-9360-5af627a7780f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:52.329679 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87eaac7-b689-4441-9360-5af627a7780f None admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:52.329961 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87eaac7-b689-4441-9360-5af627a7780f None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:52.330236 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87eaac7-b689-4441-9360-5af627a7780f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:52.330902 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87eaac7-b689-4441-9360-5af627a7780f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:52.332275 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87eaac7-b689-4441-9360-5af627a7780f None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:52.360772 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1023f5-5b1e-4c1e-895a-792113b87e67 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:52.365618 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 465/958] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 10:50:52 2022] POST /identity/v3/endpoints => generated 349 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 10:50:52.416778 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b84a95-68bf-443b-a56a-d1675413c5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:52.417137 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b84a95-68bf-443b-a56a-d1675413c5a1 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:52.417419 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b84a95-68bf-443b-a56a-d1675413c5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:52.417772 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b84a95-68bf-443b-a56a-d1675413c5a1 None admin] PATH_INFO: `/v3/services` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:52.418472 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b84a95-68bf-443b-a56a-d1675413c5a1 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:52.418787 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b84a95-68bf-443b-a56a-d1675413c5a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:52.420352 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b84a95-68bf-443b-a56a-d1675413c5a1 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:52.426471 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 494/959] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Aug 18 10:50:52 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:52.433804 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87eaac7-b689-4441-9360-5af627a7780f None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:52.559985 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87eaac7-b689-4441-9360-5af627a7780f None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:52.571765 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:52.598865 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af56f40-f650-408d-802e-a4b9afe44e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:52.599477 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af56f40-f650-408d-802e-a4b9afe44e70 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:52.599751 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af56f40-f650-408d-802e-a4b9afe44e70 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:52.600539 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af56f40-f650-408d-802e-a4b9afe44e70 None admin] PATH_INFO: `/v3/services` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:52.601298 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af56f40-f650-408d-802e-a4b9afe44e70 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:52.601753 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af56f40-f650-408d-802e-a4b9afe44e70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:52.603241 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af56f40-f650-408d-802e-a4b9afe44e70 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:52.609027 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 466/960] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Aug 18 10:50:52 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:53.316891 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab962ee-3f92-40d4-b6d4-84ad2f1ff491 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:53.317399 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab962ee-3f92-40d4-b6d4-84ad2f1ff491 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:53.317511 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab962ee-3f92-40d4-b6d4-84ad2f1ff491 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:53.319601 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 495/961] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:50:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:50:53.324966 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd29bc1-8c6e-4cb7-bacd-834cf8b3689c None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:53.325385 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd29bc1-8c6e-4cb7-bacd-834cf8b3689c None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:53.325622 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd29bc1-8c6e-4cb7-bacd-834cf8b3689c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:53.344702 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-0cd29bc1-8c6e-4cb7-bacd-834cf8b3689c None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:50:53.345926 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-0cd29bc1-8c6e-4cb7-bacd-834cf8b3689c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:50:53.418390 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 467/962] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:50:53 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 10:50:53.537010 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca4633-3f62-48a6-a6a8-8462e702f055 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:53.537386 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca4633-3f62-48a6-a6a8-8462e702f055 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:53.538332 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca4633-3f62-48a6-a6a8-8462e702f055 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:53.540525 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 496/963] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:50:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:50:53.545909 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e554f583-7d79-4d4b-9b54-83938504137e None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:53.546198 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e554f583-7d79-4d4b-9b54-83938504137e None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:53.546480 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e554f583-7d79-4d4b-9b54-83938504137e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:53.566773 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-e554f583-7d79-4d4b-9b54-83938504137e None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:50:53.567976 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-e554f583-7d79-4d4b-9b54-83938504137e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:50:53.640842 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 468/964] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:50:53 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 10:50:53.701000 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ca4633-3f62-48a6-a6a8-8462e702f055 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:53.764769 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:53.812571 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ca4633-3f62-48a6-a6a8-8462e702f055 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:53.846974 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c573e5-173e-49a0-a1f2-29862d6956e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:53.847607 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c573e5-173e-49a0-a1f2-29862d6956e3 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:53.847888 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c573e5-173e-49a0-a1f2-29862d6956e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:53.848161 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c573e5-173e-49a0-a1f2-29862d6956e3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:53.859882 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c573e5-173e-49a0-a1f2-29862d6956e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:50:53.864585 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-74c573e5-173e-49a0-a1f2-29862d6956e3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 10:50:53.864585 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:53.864585 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:53.864585 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:53.864585 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:53.864585 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:53.864585 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:53.864585 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:53.864585 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:53.864585 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:53.864585 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:53.864585 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:53.864585 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:50:53.864585 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:50:53.864585 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:50:53.864585 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:50:53.865490 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:50:53.865490 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:50:53.865490 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:50:53.865490 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:50:53.865490 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:53.865490 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:53.865490 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:53.865490 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:53.865490 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:53.865490 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:53.865490 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:53.865490 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:53.865490 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:53.865490 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:53.865490 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:53.865490 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:53.867028 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:53.867028 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:53.867028 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:53.867028 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:53.867028 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:50:53.867028 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:50:53.867028 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:50:53.867028 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:50:53.867028 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:50:53.867028 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:50:53.867028 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 10:50:53.867028 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:53.867680 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 497/965] 10.222.0.15 () {56 vars in 1120 bytes} [Thu Aug 18 10:50:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:53.873412 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e554f583-7d79-4d4b-9b54-83938504137e None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:53.909483 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:53.929007 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c573e5-173e-49a0-a1f2-29862d6956e3 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:53.987157 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e554f583-7d79-4d4b-9b54-83938504137e None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:54.028977 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4e0b52-7696-46f6-a433-ae8fce47def8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:54.029776 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4e0b52-7696-46f6-a433-ae8fce47def8 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:54.030168 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4e0b52-7696-46f6-a433-ae8fce47def8 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:54.030638 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4e0b52-7696-46f6-a433-ae8fce47def8 None admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:54.031416 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4e0b52-7696-46f6-a433-ae8fce47def8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:54.031820 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4e0b52-7696-46f6-a433-ae8fce47def8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:54.033430 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4e0b52-7696-46f6-a433-ae8fce47def8 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:54.043556 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 469/966] 10.222.0.15 () {56 vars in 1115 bytes} [Thu Aug 18 10:50:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:54.049302 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4e0b52-7696-46f6-a433-ae8fce47def8 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:54.064471 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c573e5-173e-49a0-a1f2-29862d6956e3 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:54.087519 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:54.104403 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e161ea81-f045-4c57-bf88-1795b3fdd022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:54.105189 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e161ea81-f045-4c57-bf88-1795b3fdd022 None admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:54.105783 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e161ea81-f045-4c57-bf88-1795b3fdd022 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:54.106080 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e161ea81-f045-4c57-bf88-1795b3fdd022 None admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:54.106943 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e161ea81-f045-4c57-bf88-1795b3fdd022 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:54.108568 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e161ea81-f045-4c57-bf88-1795b3fdd022 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:54.126188 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.sql.core [None req-e161ea81-f045-4c57-bf88-1795b3fdd022 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 18 10:50:54.126188 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 18 10:50:54.126188 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [parameters: {'user_id': 'b9e2c85d1a75471aaa54bc273bd985dd', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 18 10:50:54.126188 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81433) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 18 10:50:54.134655 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-e161ea81-f045-4c57-bf88-1795b3fdd022 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 18 10:50:54.134655 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:54.134655 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 18 10:50:54.134655 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 18 10:50:54.134655 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 18 10:50:54.134655 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 18 10:50:54.134655 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 18 10:50:54.134655 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application result = self._query(query) Aug 18 10:50:54.134655 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 18 10:50:54.134655 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application conn.query(q) Aug 18 10:50:54.134655 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 18 10:50:54.134655 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 18 10:50:54.134655 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 18 10:50:54.134655 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application result.read() Aug 18 10:50:54.134655 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 18 10:50:54.135557 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 18 10:50:54.135557 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 18 10:50:54.135557 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 18 10:50:54.135557 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 18 10:50:54.135557 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 18 10:50:54.135557 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 18 10:50:54.135557 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 18 10:50:54.135557 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 18 10:50:54.135557 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:54.135557 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 18 10:50:54.135557 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:54.135557 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:54.135557 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 18 10:50:54.135557 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 18 10:50:54.135557 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 18 10:50:54.135557 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 18 10:50:54.135557 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 18 10:50:54.135557 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application next(self.gen) Aug 18 10:50:54.136496 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 18 10:50:54.136496 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application yield resource Aug 18 10:50:54.136496 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 18 10:50:54.136496 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application next(self.gen) Aug 18 10:50:54.136496 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 18 10:50:54.136496 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application self.session.rollback() Aug 18 10:50:54.136496 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 18 10:50:54.136496 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application self.force_reraise() Aug 18 10:50:54.136496 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 18 10:50:54.136496 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise self.value Aug 18 10:50:54.136496 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 18 10:50:54.136496 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 18 10:50:54.136496 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 18 10:50:54.136496 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application session.commit() Aug 18 10:50:54.136496 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 18 10:50:54.136496 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 18 10:50:54.136496 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 18 10:50:54.137391 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application self._prepare_impl() Aug 18 10:50:54.137391 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 18 10:50:54.137391 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application self.session.flush() Aug 18 10:50:54.137391 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 18 10:50:54.137391 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application self._flush(objects) Aug 18 10:50:54.137391 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 18 10:50:54.137391 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 18 10:50:54.137391 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 18 10:50:54.137391 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application compat.raise_( Aug 18 10:50:54.137391 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 18 10:50:54.137391 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception Aug 18 10:50:54.137391 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 18 10:50:54.137391 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application flush_context.execute() Aug 18 10:50:54.137391 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 18 10:50:54.137391 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rec.execute(self) Aug 18 10:50:54.137391 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 18 10:50:54.137391 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 18 10:50:54.138340 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 18 10:50:54.138340 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 18 10:50:54.138340 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 18 10:50:54.138340 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 18 10:50:54.138340 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 18 10:50:54.138340 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 18 10:50:54.138340 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 18 10:50:54.138340 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 18 10:50:54.138340 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 18 10:50:54.138340 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 18 10:50:54.138340 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 18 10:50:54.138340 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 18 10:50:54.138340 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 18 10:50:54.138340 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 18 10:50:54.138340 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 18 10:50:54.138340 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception Aug 18 10:50:54.139197 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 18 10:50:54.139197 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 18 10:50:54.139197 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 18 10:50:54.139197 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 18 10:50:54.139197 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 18 10:50:54.139197 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application result = self._query(query) Aug 18 10:50:54.139197 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 18 10:50:54.139197 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application conn.query(q) Aug 18 10:50:54.139197 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 18 10:50:54.139197 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 18 10:50:54.139197 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 18 10:50:54.139197 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application result.read() Aug 18 10:50:54.139197 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 18 10:50:54.139197 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 18 10:50:54.139197 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 18 10:50:54.139197 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 18 10:50:54.140045 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 18 10:50:54.140045 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 18 10:50:54.140045 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 18 10:50:54.140045 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 18 10:50:54.140045 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 18 10:50:54.140045 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 18 10:50:54.140045 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [parameters: {'user_id': 'b9e2c85d1a75471aaa54bc273bd985dd', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 18 10:50:54.140045 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 18 10:50:54.140045 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:54.140045 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 10:50:54.140045 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:54.140045 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:54.140045 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:54.140045 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:54.140045 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:54.145199 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:54.145199 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:54.145199 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:54.145199 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:54.145199 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:54.145199 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:54.145199 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:54.145199 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 18 10:50:54.145199 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 18 10:50:54.145199 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:54.145199 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:54.145199 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 10:50:54.145199 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 10:50:54.145199 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 10:50:54.145199 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 10:50:54.145199 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 18 10:50:54.145199 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 18 10:50:54.146730 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 18 10:50:54.146730 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 18 10:50:54.146730 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 18 10:50:54.146730 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 18 10:50:54.146730 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 18 10:50:54.146730 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:54.146730 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 498/967] 10.222.0.15 () {60 vars in 1131 bytes} [Thu Aug 18 10:50:53 2022] POST /identity/v3/users => generated 160 bytes in 208 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 18 10:50:54.146730 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e161ea81-f045-4c57-bf88-1795b3fdd022 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:54.183199 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:54.191217 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4e0b52-7696-46f6-a433-ae8fce47def8 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:54.244933 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6330eb-6fec-4c29-8b6e-89b700235597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:54.245655 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6330eb-6fec-4c29-8b6e-89b700235597 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:54.245934 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6330eb-6fec-4c29-8b6e-89b700235597 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:54.246205 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6330eb-6fec-4c29-8b6e-89b700235597 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:54.259824 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6330eb-6fec-4c29-8b6e-89b700235597 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:54.261928 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6330eb-6fec-4c29-8b6e-89b700235597 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:54.279153 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-bd6330eb-6fec-4c29-8b6e-89b700235597 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:54.279153 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:54.279153 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:54.279153 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:54.279153 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:54.279153 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:54.279153 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:54.279153 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:54.279153 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:54.279153 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:54.279153 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:54.279153 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:54.279153 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 10:50:54.279153 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 10:50:54.279153 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 10:50:54.279153 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 10:50:54.280178 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:54.280178 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:54.280178 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:54.280178 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:54.280178 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:54.280178 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:54.280178 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:54.280178 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:54.280178 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:54.280178 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:54.280178 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:54.280178 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:54.280178 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:54.280178 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:54.280178 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:54.280178 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:54.280178 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 10:50:54.281085 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 10:50:54.281085 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:54.281085 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:54.282623 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e161ea81-f045-4c57-bf88-1795b3fdd022 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:54.284593 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 470/968] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:50:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 10:50:54.291664 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6330eb-6fec-4c29-8b6e-89b700235597 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:54.324842 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e706a43d-d41c-4cda-86ee-40c4a5c39771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:54.326690 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e706a43d-d41c-4cda-86ee-40c4a5c39771 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:54.327461 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e706a43d-d41c-4cda-86ee-40c4a5c39771 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:54.327947 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e706a43d-d41c-4cda-86ee-40c4a5c39771 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:54.339282 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e706a43d-d41c-4cda-86ee-40c4a5c39771 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:54.341240 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e706a43d-d41c-4cda-86ee-40c4a5c39771 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:54.356421 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-e706a43d-d41c-4cda-86ee-40c4a5c39771 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 10:50:54.356421 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:54.356421 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:54.356421 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:54.356421 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:54.356421 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:54.356421 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:54.356421 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:54.356421 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:54.356421 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:54.356421 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:54.356421 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:54.356421 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 10:50:54.356421 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 10:50:54.356421 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 10:50:54.356421 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 10:50:54.357428 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:54.357428 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:54.357428 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 10:50:54.357428 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 10:50:54.357428 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 10:50:54.357428 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 10:50:54.357428 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:54.357428 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:54.357428 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:54.357428 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:54.357428 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:54.357428 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:54.357428 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:54.357428 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:54.357428 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:54.357428 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:54.357428 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:54.357428 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:54.358394 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:54.358394 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:54.358394 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 10:50:54.358394 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 10:50:54.358394 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 10:50:54.358394 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 10:50:54.358394 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 10:50:54.358394 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 10:50:54.358394 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 10:50:54.358394 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:54.362771 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 499/969] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 18 10:50:54 2022] GET /identity/v3/users/cinder => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:54.374775 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e706a43d-d41c-4cda-86ee-40c4a5c39771 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:54.418883 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6330eb-6fec-4c29-8b6e-89b700235597 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:54.454038 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:54.456699 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048d2771-3aba-42a6-8ee4-2fc278115766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:54.457320 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d2771-3aba-42a6-8ee4-2fc278115766 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:54.457628 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d2771-3aba-42a6-8ee4-2fc278115766 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:54.457903 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d2771-3aba-42a6-8ee4-2fc278115766 None admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:54.458555 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048d2771-3aba-42a6-8ee4-2fc278115766 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:54.458860 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048d2771-3aba-42a6-8ee4-2fc278115766 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:54.461645 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048d2771-3aba-42a6-8ee4-2fc278115766 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:54.477071 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 471/970] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 18 10:50:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 10:50:54.478469 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3613cf81-d6e5-44f8-a03c-fcf5f0dbbd4a None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:54.478755 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3613cf81-d6e5-44f8-a03c-fcf5f0dbbd4a None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:54.479026 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3613cf81-d6e5-44f8-a03c-fcf5f0dbbd4a None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:54.481653 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 472/971] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:50:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:50:54.482617 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3613cf81-d6e5-44f8-a03c-fcf5f0dbbd4a None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:54.493575 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:54.512552 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e706a43d-d41c-4cda-86ee-40c4a5c39771 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:54.551421 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18750e40-cac2-41ec-814d-637915a9cc1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:54.552039 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18750e40-cac2-41ec-814d-637915a9cc1f None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:54.552319 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18750e40-cac2-41ec-814d-637915a9cc1f None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:54.552594 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18750e40-cac2-41ec-814d-637915a9cc1f None admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:54.553975 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18750e40-cac2-41ec-814d-637915a9cc1f None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:54.554284 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18750e40-cac2-41ec-814d-637915a9cc1f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:54.555733 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18750e40-cac2-41ec-814d-637915a9cc1f None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:54.595594 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 500/972] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Aug 18 10:50:54 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:54.596913 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e717407d-75b5-4453-ada0-8b7eb751a16c None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:54.597204 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e717407d-75b5-4453-ada0-8b7eb751a16c None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:54.597481 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e717407d-75b5-4453-ada0-8b7eb751a16c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:54.618981 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3613cf81-d6e5-44f8-a03c-fcf5f0dbbd4a None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:54.630453 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-e717407d-75b5-4453-ada0-8b7eb751a16c None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:50:54.633168 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-e717407d-75b5-4453-ada0-8b7eb751a16c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:50:54.665244 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387e4df3-7c8e-416b-9583-fa184d03f5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:54.666023 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e4df3-7c8e-416b-9583-fa184d03f5ac None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:54.666305 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e4df3-7c8e-416b-9583-fa184d03f5ac None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:54.666578 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e4df3-7c8e-416b-9583-fa184d03f5ac None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:54.676814 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387e4df3-7c8e-416b-9583-fa184d03f5ac None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:54.679133 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387e4df3-7c8e-416b-9583-fa184d03f5ac None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:54.693204 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-387e4df3-7c8e-416b-9583-fa184d03f5ac None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 10:50:54.693204 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:54.693204 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:54.693204 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:54.693204 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:54.693204 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:54.693204 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:54.693204 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:54.693204 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:54.693204 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:54.693204 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:54.693204 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:54.693204 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 10:50:54.693204 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 10:50:54.693204 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 10:50:54.693204 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 10:50:54.694456 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:54.694456 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:54.694456 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 10:50:54.694456 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 10:50:54.694456 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 10:50:54.694456 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 10:50:54.694456 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:54.694456 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:54.694456 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:54.694456 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:54.694456 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:54.694456 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:54.694456 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:54.694456 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:54.694456 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:54.694456 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:54.694456 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:54.694456 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:54.695531 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:54.695531 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:54.695531 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 10:50:54.695531 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 10:50:54.695531 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 10:50:54.695531 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 10:50:54.695531 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 10:50:54.695531 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 10:50:54.695531 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 10:50:54.695531 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:54.695531 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 473/973] 10.222.0.15 () {56 vars in 1117 bytes} [Thu Aug 18 10:50:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 10:50:54.702731 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387e4df3-7c8e-416b-9583-fa184d03f5ac None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:54.736218 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 501/974] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:50:54 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 10:50:54.738117 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ef9c9-fa78-4896-9057-d5fe519efeb8 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:54.738117 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ef9c9-fa78-4896-9057-d5fe519efeb8 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:54.738335 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ef9c9-fa78-4896-9057-d5fe519efeb8 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:54.739938 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 502/975] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:50:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:50:54.747065 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db579ae-1898-4a1b-a3d9-a0cd582d8ab0 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:54.747709 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db579ae-1898-4a1b-a3d9-a0cd582d8ab0 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:54.747709 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db579ae-1898-4a1b-a3d9-a0cd582d8ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:54.767335 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-2db579ae-1898-4a1b-a3d9-a0cd582d8ab0 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:50:54.768704 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-2db579ae-1898-4a1b-a3d9-a0cd582d8ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:50:54.797903 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:54.800924 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:54.845344 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387e4df3-7c8e-416b-9583-fa184d03f5ac None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:54.861032 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 503/976] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:50:54 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 10:50:54.888487 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98800f07-0eb4-49b2-be99-df55c3c7778b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:54.889167 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98800f07-0eb4-49b2-be99-df55c3c7778b None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:54.889583 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98800f07-0eb4-49b2-be99-df55c3c7778b None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:54.889811 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98800f07-0eb4-49b2-be99-df55c3c7778b None admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:54.890556 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98800f07-0eb4-49b2-be99-df55c3c7778b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:54.890890 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98800f07-0eb4-49b2-be99-df55c3c7778b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:54.892378 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98800f07-0eb4-49b2-be99-df55c3c7778b None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:54.913268 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 474/977] 10.222.0.15 () {56 vars in 1149 bytes} [Thu Aug 18 10:50:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 10:50:54.918900 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db579ae-1898-4a1b-a3d9-a0cd582d8ab0 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:55.016429 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98800f07-0eb4-49b2-be99-df55c3c7778b None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:55.039173 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db579ae-1898-4a1b-a3d9-a0cd582d8ab0 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:55.077795 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dff8f1-bc38-4a0d-b967-db27af4500ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:55.078709 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dff8f1-bc38-4a0d-b967-db27af4500ba None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:55.079150 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dff8f1-bc38-4a0d-b967-db27af4500ba None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:55.079602 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dff8f1-bc38-4a0d-b967-db27af4500ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:55.115472 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:55.129759 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98800f07-0eb4-49b2-be99-df55c3c7778b None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:55.157551 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:55.158950 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dff8f1-bc38-4a0d-b967-db27af4500ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:55.160398 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dff8f1-bc38-4a0d-b967-db27af4500ba None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:55.166707 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec456dd-2721-40d9-b069-78a530941c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:55.167345 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec456dd-2721-40d9-b069-78a530941c5d None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:55.167624 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec456dd-2721-40d9-b069-78a530941c5d None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:55.167897 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec456dd-2721-40d9-b069-78a530941c5d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:55.168482 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec456dd-2721-40d9-b069-78a530941c5d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:55.169872 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec456dd-2721-40d9-b069-78a530941c5d None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:55.180428 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-fec456dd-2721-40d9-b069-78a530941c5d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 10:50:55.180428 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:55.180428 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 10:50:55.180428 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 10:50:55.180428 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 10:50:55.180428 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 10:50:55.180428 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 10:50:55.180428 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 10:50:55.180428 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 10:50:55.180428 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:55.180428 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 10:50:55.180428 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:55.180428 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:55.180428 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:55.180428 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:55.180428 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:55.180428 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:55.181656 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:55.181656 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:55.181656 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:55.181656 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:55.181656 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:55.181656 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:55.181656 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 10:50:55.181656 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 10:50:55.181656 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 10:50:55.181656 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 10:50:55.181656 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:55.181656 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:55.181656 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:55.181656 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:55.181656 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:55.181656 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:55.182702 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:55.182702 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:55.182702 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:55.182702 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:55.182702 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:55.182702 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:55.182702 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:55.182702 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:55.182702 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:55.182702 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:55.182702 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 10:50:55.182702 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 10:50:55.182702 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 10:50:55.182702 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:55.182702 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 475/978] 10.222.0.15 () {56 vars in 1126 bytes} [Thu Aug 18 10:50:55 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:55.183524 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec456dd-2721-40d9-b069-78a530941c5d None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:55.261615 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 504/979] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 18 10:50:54 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 10:50:55.262470 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dff8f1-bc38-4a0d-b967-db27af4500ba None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:55.292414 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec456dd-2721-40d9-b069-78a530941c5d None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:55.337986 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fabd88-c91f-4ef9-93d2-2f8f0fa81420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:55.338598 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fabd88-c91f-4ef9-93d2-2f8f0fa81420 None admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:55.338880 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fabd88-c91f-4ef9-93d2-2f8f0fa81420 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:55.339156 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fabd88-c91f-4ef9-93d2-2f8f0fa81420 None admin] PATH_INFO: `/v3/services` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:55.339807 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fabd88-c91f-4ef9-93d2-2f8f0fa81420 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:55.340972 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:55.341418 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fabd88-c91f-4ef9-93d2-2f8f0fa81420 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:55.360457 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 476/980] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Aug 18 10:50:55 2022] POST /identity/v3/services => generated 242 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 10:50:55.361917 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fabd88-c91f-4ef9-93d2-2f8f0fa81420 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:55.392570 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dff8f1-bc38-4a0d-b967-db27af4500ba None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:55.424866 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:55.444513 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c0bbfa-b9eb-4b00-9b19-0bf7f94e65a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:55.445263 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c0bbfa-b9eb-4b00-9b19-0bf7f94e65a7 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:55.445628 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c0bbfa-b9eb-4b00-9b19-0bf7f94e65a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:55.445910 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c0bbfa-b9eb-4b00-9b19-0bf7f94e65a7 None admin] PATH_INFO: `/v3/services` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:55.446557 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c0bbfa-b9eb-4b00-9b19-0bf7f94e65a7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:55.446858 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c0bbfa-b9eb-4b00-9b19-0bf7f94e65a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:55.448245 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c0bbfa-b9eb-4b00-9b19-0bf7f94e65a7 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:55.453882 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 505/981] 10.222.0.15 () {56 vars in 1122 bytes} [Thu Aug 18 10:50:55 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:55.459919 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c0bbfa-b9eb-4b00-9b19-0bf7f94e65a7 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:55.491875 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fabd88-c91f-4ef9-93d2-2f8f0fa81420 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:55.535529 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f758aad2-c071-4753-bb9f-3418f6009175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:55.536183 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f758aad2-c071-4753-bb9f-3418f6009175 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:55.536617 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f758aad2-c071-4753-bb9f-3418f6009175 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:55.536895 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f758aad2-c071-4753-bb9f-3418f6009175 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:55.549141 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f758aad2-c071-4753-bb9f-3418f6009175 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:55.550645 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f758aad2-c071-4753-bb9f-3418f6009175 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:55.569470 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-f758aad2-c071-4753-bb9f-3418f6009175 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:55.569470 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:55.569470 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:55.569470 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:55.569470 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:55.569470 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:55.569470 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:55.569470 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:55.569470 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:55.569470 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:55.569470 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:55.569470 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:55.569470 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 10:50:55.569470 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 10:50:55.569470 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 10:50:55.569470 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 10:50:55.570493 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:55.570493 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:55.570493 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:55.570493 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:55.570493 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:55.570493 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:55.570493 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:55.570493 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:55.570493 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:55.570493 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:55.570493 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:55.570493 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:55.570493 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:55.570493 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:55.570493 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:55.570493 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:55.570493 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 10:50:55.571386 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 10:50:55.571386 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:50:55.571386 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:55.571386 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 477/982] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:50:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:55.576260 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f758aad2-c071-4753-bb9f-3418f6009175 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:55.577290 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c0bbfa-b9eb-4b00-9b19-0bf7f94e65a7 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:55.606461 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:55.624486 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd333e8-ce62-4f11-abcc-dff823c89c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:55.625099 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd333e8-ce62-4f11-abcc-dff823c89c98 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:55.625375 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd333e8-ce62-4f11-abcc-dff823c89c98 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:55.625680 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd333e8-ce62-4f11-abcc-dff823c89c98 None admin] PATH_INFO: `/v3/services` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:55.626322 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd333e8-ce62-4f11-abcc-dff823c89c98 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:55.626605 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd333e8-ce62-4f11-abcc-dff823c89c98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:55.627978 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd333e8-ce62-4f11-abcc-dff823c89c98 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:55.633140 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 506/983] 10.222.0.15 () {56 vars in 1122 bytes} [Thu Aug 18 10:50:55 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 10:50:55.638909 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd333e8-ce62-4f11-abcc-dff823c89c98 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:55.708404 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f758aad2-c071-4753-bb9f-3418f6009175 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:55.711904 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:55.751817 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd333e8-ce62-4f11-abcc-dff823c89c98 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:55.752019 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375b6881-1b8a-499e-b9c4-ef2f9b763d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:55.752631 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b6881-1b8a-499e-b9c4-ef2f9b763d91 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:55.752894 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b6881-1b8a-499e-b9c4-ef2f9b763d91 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:55.753321 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b6881-1b8a-499e-b9c4-ef2f9b763d91 None admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:55.753934 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375b6881-1b8a-499e-b9c4-ef2f9b763d91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:55.754234 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375b6881-1b8a-499e-b9c4-ef2f9b763d91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:55.755707 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375b6881-1b8a-499e-b9c4-ef2f9b763d91 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:55.769015 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 478/984] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 18 10:50:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 10:50:55.775502 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375b6881-1b8a-499e-b9c4-ef2f9b763d91 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:55.796711 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9c758f-8973-444f-b632-1ebbbd71af95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:55.797321 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9c758f-8973-444f-b632-1ebbbd71af95 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:55.797624 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9c758f-8973-444f-b632-1ebbbd71af95 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:55.797901 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9c758f-8973-444f-b632-1ebbbd71af95 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:55.798615 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9c758f-8973-444f-b632-1ebbbd71af95 None admin] RBAC: Adding query filter params (interface=admin, service_id=2d6b8436a78742a9a0a22763967900fa, region_id=RegionOne) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:55.798922 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9c758f-8973-444f-b632-1ebbbd71af95 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:55.800289 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9c758f-8973-444f-b632-1ebbbd71af95 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:55.805971 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 507/985] 10.222.0.15 () {56 vars in 1249 bytes} [Thu Aug 18 10:50:55 2022] GET /identity/v3/endpoints?service_id=2d6b8436a78742a9a0a22763967900fa&interface=admin®ion_id=RegionOne => generated 193 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 10:50:55.811384 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9c758f-8973-444f-b632-1ebbbd71af95 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:55.865210 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:55.889479 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375b6881-1b8a-499e-b9c4-ef2f9b763d91 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:55.928980 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d095045-0309-491c-9137-57394ba990de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:55.929227 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9c758f-8973-444f-b632-1ebbbd71af95 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:55.929644 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d095045-0309-491c-9137-57394ba990de None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:55.929925 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d095045-0309-491c-9137-57394ba990de None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:55.930192 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d095045-0309-491c-9137-57394ba990de None admin] PATH_INFO: `/v3/projects/service` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:55.937330 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d095045-0309-491c-9137-57394ba990de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:55.939109 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d095045-0309-491c-9137-57394ba990de None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:55.951337 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-1d095045-0309-491c-9137-57394ba990de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 10:50:55.951337 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:55.951337 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:55.951337 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:55.951337 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:55.951337 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:55.951337 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:55.951337 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:55.951337 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:55.951337 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:55.951337 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:55.951337 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:55.951337 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 10:50:55.951337 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 10:50:55.951337 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 10:50:55.952248 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 10:50:55.952248 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:55.952248 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:55.952248 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:55.952248 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:55.952248 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:55.952248 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:55.952248 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:55.952248 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:55.952248 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:55.952248 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:55.952248 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:55.952248 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:55.952248 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:55.952248 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:55.952248 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:55.952248 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:55.953231 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 10:50:55.953231 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 10:50:55.953231 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 10:50:55.953231 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 10:50:55.953231 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 10:50:55.953231 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 10:50:55.953231 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 10:50:55.953231 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:55.953231 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 479/986] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 18 10:50:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 10:50:55.958080 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d095045-0309-491c-9137-57394ba990de None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:55.967785 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21466c14-0b19-4aac-94ff-a8f0e486d029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:55.968323 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21466c14-0b19-4aac-94ff-a8f0e486d029 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:55.968594 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21466c14-0b19-4aac-94ff-a8f0e486d029 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:55.968861 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21466c14-0b19-4aac-94ff-a8f0e486d029 None admin] PATH_INFO: `/v3/services` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:55.969459 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21466c14-0b19-4aac-94ff-a8f0e486d029 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:55.971013 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21466c14-0b19-4aac-94ff-a8f0e486d029 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:55.978376 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 508/987] 10.222.0.15 () {56 vars in 1087 bytes} [Thu Aug 18 10:50:55 2022] GET /identity/v3/services => generated 1727 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 10:50:55.989480 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:56.086848 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d095045-0309-491c-9137-57394ba990de None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:56.125902 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32796461-45c1-4183-bf11-86133a5f710b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:56.127001 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32796461-45c1-4183-bf11-86133a5f710b None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:56.127001 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32796461-45c1-4183-bf11-86133a5f710b None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:56.127001 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32796461-45c1-4183-bf11-86133a5f710b None admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:56.127717 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32796461-45c1-4183-bf11-86133a5f710b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:56.128671 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32796461-45c1-4183-bf11-86133a5f710b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:56.129659 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32796461-45c1-4183-bf11-86133a5f710b None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:56.142916 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 480/988] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Aug 18 10:50:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 10:50:56.149341 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21466c14-0b19-4aac-94ff-a8f0e486d029 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:56.265555 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21466c14-0b19-4aac-94ff-a8f0e486d029 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:56.281348 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:56.306742 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77565bd-6183-40b1-8c4d-7f42b5e3354d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:56.307611 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77565bd-6183-40b1-8c4d-7f42b5e3354d None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:56.308045 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77565bd-6183-40b1-8c4d-7f42b5e3354d None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:56.308485 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77565bd-6183-40b1-8c4d-7f42b5e3354d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:56.309370 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77565bd-6183-40b1-8c4d-7f42b5e3354d None admin] RBAC: Adding query filter params (role.id=3e108171f00d4bff8db5c27b4446c417, scope.project.id=1575e8ebaaab4650995841659b6e631b, user.id=bcacf809f13043ab90716607160a70db) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:56.309854 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77565bd-6183-40b1-8c4d-7f42b5e3354d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:56.311428 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77565bd-6183-40b1-8c4d-7f42b5e3354d None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:56.318157 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 509/989] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Aug 18 10:50:56 2022] GET /identity/v3/role_assignments?user.id=bcacf809f13043ab90716607160a70db&scope.project.id=1575e8ebaaab4650995841659b6e631b&role.id=3e108171f00d4bff8db5c27b4446c417 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:57.315361 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2902e4b5-8e37-42dc-b5bc-68f76d4c69d1 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:57.315901 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2902e4b5-8e37-42dc-b5bc-68f76d4c69d1 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:57.315901 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2902e4b5-8e37-42dc-b5bc-68f76d4c69d1 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:57.317227 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 481/990] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:50:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:50:57.323482 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba106d-1c1e-4e00-b69c-0215618f4f6b None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:57.323906 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba106d-1c1e-4e00-b69c-0215618f4f6b None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:57.324049 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba106d-1c1e-4e00-b69c-0215618f4f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:57.342967 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-7bba106d-1c1e-4e00-b69c-0215618f4f6b None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:50:57.344144 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-7bba106d-1c1e-4e00-b69c-0215618f4f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:50:57.413490 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 510/991] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:50:57 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 10:50:57.681177 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2902e4b5-8e37-42dc-b5bc-68f76d4c69d1 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:57.772969 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:57.794678 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2902e4b5-8e37-42dc-b5bc-68f76d4c69d1 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:57.838571 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cdb823-d3ff-475b-bc58-e976b91f268b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:57.839213 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cdb823-d3ff-475b-bc58-e976b91f268b None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:57.839492 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cdb823-d3ff-475b-bc58-e976b91f268b None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:57.839764 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cdb823-d3ff-475b-bc58-e976b91f268b None admin] PATH_INFO: `/v3/services/compute` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:57.840358 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cdb823-d3ff-475b-bc58-e976b91f268b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:57.841751 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cdb823-d3ff-475b-bc58-e976b91f268b None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:57.850770 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-67cdb823-d3ff-475b-bc58-e976b91f268b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 10:50:57.850770 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:57.850770 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 10:50:57.850770 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 10:50:57.850770 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 10:50:57.850770 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 10:50:57.850770 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 10:50:57.850770 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 10:50:57.850770 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 10:50:57.850770 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:57.850770 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 10:50:57.850770 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:57.850770 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:57.850770 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:57.850770 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:57.850770 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:57.850770 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:57.851796 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:57.851796 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:57.851796 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:57.851796 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:57.851796 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:57.851796 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:57.851796 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 10:50:57.851796 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 10:50:57.851796 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 10:50:57.851796 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 10:50:57.851796 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:57.851796 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:57.851796 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:57.851796 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:57.851796 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:57.851796 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:57.852682 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:57.852682 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:57.852682 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:57.852682 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:57.852682 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:57.852682 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:57.852682 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:57.852682 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:57.852682 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:57.852682 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:57.852682 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 10:50:57.852682 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 10:50:57.852682 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 10:50:57.852682 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:50:57.852682 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 482/992] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 18 10:50:57 2022] GET /identity/v3/services/compute => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:57.857944 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bba106d-1c1e-4e00-b69c-0215618f4f6b None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:57.923421 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2906d0ba-bcce-4dab-8458-1330d2d43418 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:57.923741 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2906d0ba-bcce-4dab-8458-1330d2d43418 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:57.923944 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2906d0ba-bcce-4dab-8458-1330d2d43418 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:57.925421 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 483/993] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:50:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:50:57.931596 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640822ec-3a01-494d-883c-bc9db6d04e69 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:57.931837 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640822ec-3a01-494d-883c-bc9db6d04e69 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:57.932930 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640822ec-3a01-494d-883c-bc9db6d04e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:57.953192 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-640822ec-3a01-494d-883c-bc9db6d04e69 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:50:57.954481 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-640822ec-3a01-494d-883c-bc9db6d04e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:50:57.966607 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bba106d-1c1e-4e00-b69c-0215618f4f6b None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:57.974571 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:58.003789 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c16f7ae-dc0f-4df2-974c-372f35be240a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:58.004405 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c16f7ae-dc0f-4df2-974c-372f35be240a None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:58.004672 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c16f7ae-dc0f-4df2-974c-372f35be240a None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:58.004951 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c16f7ae-dc0f-4df2-974c-372f35be240a None admin] PATH_INFO: `/v3/services` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:58.005597 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c16f7ae-dc0f-4df2-974c-372f35be240a None admin] RBAC: Adding query filter params (name=compute) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:58.005894 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c16f7ae-dc0f-4df2-974c-372f35be240a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:58.007881 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c16f7ae-dc0f-4df2-974c-372f35be240a None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:58.012626 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 511/994] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Aug 18 10:50:57 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:58.018401 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c16f7ae-dc0f-4df2-974c-372f35be240a None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:58.037852 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 484/995] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:50:57 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 10:50:58.117448 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c16f7ae-dc0f-4df2-974c-372f35be240a None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:58.153798 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c50ecd-cf1a-4cce-a918-ec0d19b3d9d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:58.154401 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c50ecd-cf1a-4cce-a918-ec0d19b3d9d8 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:58.154677 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c50ecd-cf1a-4cce-a918-ec0d19b3d9d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:58.154951 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c50ecd-cf1a-4cce-a918-ec0d19b3d9d8 None admin] PATH_INFO: `/v3/services` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:58.155574 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c50ecd-cf1a-4cce-a918-ec0d19b3d9d8 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:58.155872 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c50ecd-cf1a-4cce-a918-ec0d19b3d9d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:58.157223 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c50ecd-cf1a-4cce-a918-ec0d19b3d9d8 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:58.162026 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 512/996] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Aug 18 10:50:58 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 10:50:58.168885 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640822ec-3a01-494d-883c-bc9db6d04e69 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:58.258305 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:58.283274 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640822ec-3a01-494d-883c-bc9db6d04e69 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:58.293986 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8054cc-ada0-41e6-b39d-83df3d84ec62 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:58.294828 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8054cc-ada0-41e6-b39d-83df3d84ec62 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:58.294828 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8054cc-ada0-41e6-b39d-83df3d84ec62 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:58.296960 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 513/997] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:50:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:50:58.301602 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8054cc-ada0-41e6-b39d-83df3d84ec62 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:58.326248 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7362e93-65c4-4b73-b94a-8bb94a58929a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:58.326856 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7362e93-65c4-4b73-b94a-8bb94a58929a None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:58.327134 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7362e93-65c4-4b73-b94a-8bb94a58929a None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:58.327400 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7362e93-65c4-4b73-b94a-8bb94a58929a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:58.328094 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7362e93-65c4-4b73-b94a-8bb94a58929a None admin] RBAC: Adding query filter params (interface=public, service_id=a36c271d7e534b73bcdf3303f6c89eae, region_id=RegionOne) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:58.328405 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7362e93-65c4-4b73-b94a-8bb94a58929a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:58.329799 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7362e93-65c4-4b73-b94a-8bb94a58929a None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:58.335670 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 485/998] 10.222.0.15 () {56 vars in 1251 bytes} [Thu Aug 18 10:50:58 2022] GET /identity/v3/endpoints?service_id=a36c271d7e534b73bcdf3303f6c89eae&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:58.336908 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f9d3d7-7c87-4f63-a498-7a5f6a4a43d9 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:58.337194 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f9d3d7-7c87-4f63-a498-7a5f6a4a43d9 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:58.337464 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f9d3d7-7c87-4f63-a498-7a5f6a4a43d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:58.340561 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:58.355611 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-38f9d3d7-7c87-4f63-a498-7a5f6a4a43d9 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:50:58.356808 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-38f9d3d7-7c87-4f63-a498-7a5f6a4a43d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:50:58.407519 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8054cc-ada0-41e6-b39d-83df3d84ec62 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:58.427337 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 486/999] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:50:58 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 10:50:58.429089 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f9d3d7-7c87-4f63-a498-7a5f6a4a43d9 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:58.442970 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf32ad9-435e-439d-b1ee-6dee5d5d1157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:58.444159 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf32ad9-435e-439d-b1ee-6dee5d5d1157 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:58.444561 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf32ad9-435e-439d-b1ee-6dee5d5d1157 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:58.445075 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf32ad9-435e-439d-b1ee-6dee5d5d1157 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:58.445736 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf32ad9-435e-439d-b1ee-6dee5d5d1157 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:58.447108 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf32ad9-435e-439d-b1ee-6dee5d5d1157 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:58.456171 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-ecf32ad9-435e-439d-b1ee-6dee5d5d1157 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 10:50:58.456171 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:58.456171 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 10:50:58.456171 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 10:50:58.456171 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 10:50:58.456171 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 10:50:58.456171 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 10:50:58.456171 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 10:50:58.456171 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 10:50:58.456171 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:58.456171 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 10:50:58.456171 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:58.456171 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:58.456171 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:58.456171 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:58.456171 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:58.456171 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:58.463014 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:58.463014 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:58.463014 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:58.463014 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:58.463014 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:58.463014 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:58.463014 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 10:50:58.463014 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 10:50:58.463014 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 10:50:58.463014 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 10:50:58.463014 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:58.463014 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:58.463014 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:58.463014 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:58.463014 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:58.463014 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:58.463881 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:58.463881 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:58.463881 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:58.463881 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:58.463881 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:58.463881 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:58.463881 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:58.463881 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:58.463881 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:58.463881 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:58.463881 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 10:50:58.463881 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 10:50:58.463881 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 10:50:58.463881 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:58.463881 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 514/1000] 10.222.0.15 () {56 vars in 1126 bytes} [Thu Aug 18 10:50:58 2022] GET /identity/v3/services/object-store => generated 93 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:50:58.464684 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf32ad9-435e-439d-b1ee-6dee5d5d1157 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:58.510339 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:58.545470 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f9d3d7-7c87-4f63-a498-7a5f6a4a43d9 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:58.577030 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:58.580901 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf32ad9-435e-439d-b1ee-6dee5d5d1157 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:58.586572 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0c902d-c9d9-4c6b-a62f-ff7b011178a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:58.587390 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0c902d-c9d9-4c6b-a62f-ff7b011178a7 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:58.587676 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0c902d-c9d9-4c6b-a62f-ff7b011178a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:58.587947 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0c902d-c9d9-4c6b-a62f-ff7b011178a7 None admin] PATH_INFO: `/v3/services` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:58.588564 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0c902d-c9d9-4c6b-a62f-ff7b011178a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:58.589966 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0c902d-c9d9-4c6b-a62f-ff7b011178a7 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:58.601945 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 487/1001] 10.222.0.15 () {56 vars in 1087 bytes} [Thu Aug 18 10:50:58 2022] GET /identity/v3/services => generated 1727 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 10:50:58.620382 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79925437-ebab-48a7-88d8-012b435dd50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:58.620759 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79925437-ebab-48a7-88d8-012b435dd50e None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:58.620997 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79925437-ebab-48a7-88d8-012b435dd50e None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:58.621266 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79925437-ebab-48a7-88d8-012b435dd50e None admin] PATH_INFO: `/v3/services` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:58.621938 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79925437-ebab-48a7-88d8-012b435dd50e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:58.622239 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79925437-ebab-48a7-88d8-012b435dd50e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:58.623635 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79925437-ebab-48a7-88d8-012b435dd50e None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:58.629671 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 515/1002] 10.222.0.15 () {56 vars in 1122 bytes} [Thu Aug 18 10:50:58 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 10:50:58.636191 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0c902d-c9d9-4c6b-a62f-ff7b011178a7 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:58.693596 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79925437-ebab-48a7-88d8-012b435dd50e None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:58.762653 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0c902d-c9d9-4c6b-a62f-ff7b011178a7 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:58.800508 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e23f729-f4bd-4919-86ba-4c7dbe872a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:58.801217 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e23f729-f4bd-4919-86ba-4c7dbe872a51 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:58.801498 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e23f729-f4bd-4919-86ba-4c7dbe872a51 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:58.801803 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e23f729-f4bd-4919-86ba-4c7dbe872a51 None admin] PATH_INFO: `/v3/services` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:58.802441 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e23f729-f4bd-4919-86ba-4c7dbe872a51 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:58.802856 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e23f729-f4bd-4919-86ba-4c7dbe872a51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:58.804969 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e23f729-f4bd-4919-86ba-4c7dbe872a51 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:58.806346 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:58.810378 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79925437-ebab-48a7-88d8-012b435dd50e None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:58.811373 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 488/1003] 10.222.0.15 () {56 vars in 1122 bytes} [Thu Aug 18 10:50:58 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:50:58.816687 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e23f729-f4bd-4919-86ba-4c7dbe872a51 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:58.847302 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18403649-c8b9-4641-8006-de6a6bcb6e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:58.847938 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18403649-c8b9-4641-8006-de6a6bcb6e16 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:58.848198 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18403649-c8b9-4641-8006-de6a6bcb6e16 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:58.848460 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18403649-c8b9-4641-8006-de6a6bcb6e16 None admin] PATH_INFO: `/v3/services/image` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:58.849043 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18403649-c8b9-4641-8006-de6a6bcb6e16 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:58.850497 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18403649-c8b9-4641-8006-de6a6bcb6e16 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:58.859571 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-18403649-c8b9-4641-8006-de6a6bcb6e16 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 10:50:58.859571 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:58.859571 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 10:50:58.859571 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 10:50:58.859571 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 10:50:58.859571 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 10:50:58.859571 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 10:50:58.859571 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 10:50:58.859571 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 10:50:58.859571 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:58.859571 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 10:50:58.859571 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:58.859571 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:50:58.859571 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:50:58.859571 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:50:58.859571 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:50:58.859571 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:50:58.860647 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:50:58.860647 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:50:58.860647 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:50:58.860647 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:50:58.860647 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:50:58.860647 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:50:58.860647 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 10:50:58.860647 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 10:50:58.860647 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 10:50:58.860647 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 10:50:58.860647 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:50:58.860647 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:50:58.860647 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:50:58.860647 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:50:58.860647 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:50:58.860647 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:50:58.862624 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:50:58.862624 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:50:58.862624 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:50:58.862624 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:50:58.862624 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:50:58.862624 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:50:58.862624 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:50:58.862624 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:50:58.862624 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:50:58.862624 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:50:58.862624 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 10:50:58.862624 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 10:50:58.862624 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 10:50:58.862624 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:50:58.862624 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 516/1004] 10.222.0.15 () {56 vars in 1105 bytes} [Thu Aug 18 10:50:58 2022] GET /identity/v3/services/image => generated 86 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 10:50:58.867353 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18403649-c8b9-4641-8006-de6a6bcb6e16 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:58.897634 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:58.935501 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e23f729-f4bd-4919-86ba-4c7dbe872a51 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:58.977676 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18403649-c8b9-4641-8006-de6a6bcb6e16 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:58.984501 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f356e087-f095-4b26-9a72-abc8cc099466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:58.985385 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f356e087-f095-4b26-9a72-abc8cc099466 None admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:58.985988 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f356e087-f095-4b26-9a72-abc8cc099466 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:58.986192 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f356e087-f095-4b26-9a72-abc8cc099466 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:58.986873 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f356e087-f095-4b26-9a72-abc8cc099466 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:58.988252 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f356e087-f095-4b26-9a72-abc8cc099466 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:59.017632 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 489/1005] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 10:50:58 2022] POST /identity/v3/endpoints => generated 325 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 10:50:59.025293 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10746b0b-a748-4fdc-a33d-2dbfd63d65bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:59.026013 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10746b0b-a748-4fdc-a33d-2dbfd63d65bb None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:59.026296 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10746b0b-a748-4fdc-a33d-2dbfd63d65bb None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:59.026620 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10746b0b-a748-4fdc-a33d-2dbfd63d65bb None admin] PATH_INFO: `/v3/services` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:59.027315 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10746b0b-a748-4fdc-a33d-2dbfd63d65bb None admin] RBAC: Adding query filter params (name=image) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:59.027656 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10746b0b-a748-4fdc-a33d-2dbfd63d65bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:59.029168 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10746b0b-a748-4fdc-a33d-2dbfd63d65bb None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:59.035626 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 517/1006] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:50:58 2022] GET /identity/v3/services?name=image => generated 122 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 10:50:59.041671 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f356e087-f095-4b26-9a72-abc8cc099466 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:50:59.111835 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:50:59.163794 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f356e087-f095-4b26-9a72-abc8cc099466 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:50:59.201276 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a11a2b2-c007-4e8c-aab8-e2b6a6d6957b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:50:59.202353 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a11a2b2-c007-4e8c-aab8-e2b6a6d6957b None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:50:59.202854 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a11a2b2-c007-4e8c-aab8-e2b6a6d6957b None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:50:59.203134 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a11a2b2-c007-4e8c-aab8-e2b6a6d6957b None admin] PATH_INFO: `/v3/services` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:50:59.203780 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a11a2b2-c007-4e8c-aab8-e2b6a6d6957b None admin] RBAC: Adding query filter params (type=image) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:50:59.204085 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a11a2b2-c007-4e8c-aab8-e2b6a6d6957b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:50:59.205458 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a11a2b2-c007-4e8c-aab8-e2b6a6d6957b None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:50:59.210598 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 490/1007] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:50:59 2022] GET /identity/v3/services?type=image => generated 122 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:51:00.522851 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f0004-4099-45aa-b938-a48ec6e4ebb5 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:00.523649 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f0004-4099-45aa-b938-a48ec6e4ebb5 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:00.523649 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f0004-4099-45aa-b938-a48ec6e4ebb5 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:00.525128 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 518/1008] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:51:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:51:00.530195 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f7240-4228-4172-94f7-56f97c19b8db None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:00.530576 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f7240-4228-4172-94f7-56f97c19b8db None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:00.530753 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f7240-4228-4172-94f7-56f97c19b8db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:00.549507 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-b93f7240-4228-4172-94f7-56f97c19b8db None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:51:00.550710 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-b93f7240-4228-4172-94f7-56f97c19b8db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:51:00.622044 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 491/1009] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:51:00 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 10:51:00.888544 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7f0004-4099-45aa-b938-a48ec6e4ebb5 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:00.977283 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:00.994552 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e53b9a-8c2c-4cfb-bf02-83f9499df5ce None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:00.994992 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7f0004-4099-45aa-b938-a48ec6e4ebb5 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:00.995414 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e53b9a-8c2c-4cfb-bf02-83f9499df5ce None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:00.995898 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e53b9a-8c2c-4cfb-bf02-83f9499df5ce None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:00.997698 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 492/1010] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:51:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:51:01.002741 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5bb543-e185-4370-b480-5e135021b216 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:01.003271 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5bb543-e185-4370-b480-5e135021b216 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:01.003765 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5bb543-e185-4370-b480-5e135021b216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:01.030314 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-7a5bb543-e185-4370-b480-5e135021b216 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:51:01.031913 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-7a5bb543-e185-4370-b480-5e135021b216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:51:01.034140 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89972ef0-8f4f-42c0-a96d-a40e15752073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:01.034786 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89972ef0-8f4f-42c0-a96d-a40e15752073 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:01.035066 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89972ef0-8f4f-42c0-a96d-a40e15752073 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:01.035410 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89972ef0-8f4f-42c0-a96d-a40e15752073 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:01.035999 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89972ef0-8f4f-42c0-a96d-a40e15752073 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:01.037397 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89972ef0-8f4f-42c0-a96d-a40e15752073 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:01.046361 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-89972ef0-8f4f-42c0-a96d-a40e15752073 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 10:51:01.046361 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:51:01.046361 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 10:51:01.046361 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 10:51:01.046361 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 10:51:01.046361 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 10:51:01.046361 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 10:51:01.046361 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 10:51:01.046361 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 10:51:01.046361 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:51:01.046361 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 10:51:01.046361 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:51:01.046361 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:51:01.046361 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:51:01.046361 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:51:01.046361 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:51:01.046361 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:51:01.047371 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:51:01.047371 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:51:01.047371 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:51:01.047371 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:51:01.047371 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:51:01.047371 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:51:01.047371 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 10:51:01.047371 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 10:51:01.047371 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 10:51:01.047371 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 10:51:01.047371 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:51:01.047371 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:51:01.047371 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:51:01.047371 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:51:01.047371 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:51:01.047371 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:51:01.048196 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:51:01.048196 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:51:01.048196 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:51:01.048196 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:51:01.048196 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:51:01.048196 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:51:01.048196 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:51:01.048196 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:51:01.048196 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:51:01.048196 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:51:01.048196 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 10:51:01.048196 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 10:51:01.048196 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 10:51:01.048196 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:51:01.048196 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 519/1011] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 18 10:51:00 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:51:01.054064 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89972ef0-8f4f-42c0-a96d-a40e15752073 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:01.087537 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:01.113963 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 493/1012] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:51:01 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 10:51:01.162760 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89972ef0-8f4f-42c0-a96d-a40e15752073 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:01.199370 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5fad36-da45-4d4d-8897-cac1916022da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:01.201635 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5fad36-da45-4d4d-8897-cac1916022da None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:01.201635 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5fad36-da45-4d4d-8897-cac1916022da None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:01.201635 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5fad36-da45-4d4d-8897-cac1916022da None admin] PATH_INFO: `/v3/services` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:01.201635 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5fad36-da45-4d4d-8897-cac1916022da None admin] RBAC: Adding query filter params (name=compute) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:51:01.201912 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5fad36-da45-4d4d-8897-cac1916022da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:01.203698 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5fad36-da45-4d4d-8897-cac1916022da None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:01.213618 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 520/1013] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Aug 18 10:51:01 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 10:51:01.218650 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5bb543-e185-4370-b480-5e135021b216 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:01.270803 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902a418-ea74-45de-b965-27aa92296efd None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:01.271142 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902a418-ea74-45de-b965-27aa92296efd None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:01.271367 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902a418-ea74-45de-b965-27aa92296efd None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:01.274007 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 521/1014] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:51:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 10:51:01.278930 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701749d4-776f-47ff-9367-57ac6fb8b0d0 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:01.279217 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701749d4-776f-47ff-9367-57ac6fb8b0d0 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:01.279492 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701749d4-776f-47ff-9367-57ac6fb8b0d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:01.298510 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-701749d4-776f-47ff-9367-57ac6fb8b0d0 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:51:01.300279 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-701749d4-776f-47ff-9367-57ac6fb8b0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:51:01.310993 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:01.333117 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5bb543-e185-4370-b480-5e135021b216 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:01.373805 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c99b39-d77a-4161-bd66-c2c6a040461a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:01.374426 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c99b39-d77a-4161-bd66-c2c6a040461a None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:01.374812 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 522/1015] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:51:01 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 10:51:01.377817 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c99b39-d77a-4161-bd66-c2c6a040461a None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:01.378128 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c99b39-d77a-4161-bd66-c2c6a040461a None admin] PATH_INFO: `/v3/services` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:01.378772 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c99b39-d77a-4161-bd66-c2c6a040461a None admin] RBAC: Adding query filter params (type=compute) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:51:01.379076 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c99b39-d77a-4161-bd66-c2c6a040461a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:01.380441 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c99b39-d77a-4161-bd66-c2c6a040461a None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:01.387409 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 494/1016] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Aug 18 10:51:01 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:51:01.388284 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701749d4-776f-47ff-9367-57ac6fb8b0d0 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:01.391568 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c99b39-d77a-4161-bd66-c2c6a040461a None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:01.445857 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:01.496207 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701749d4-776f-47ff-9367-57ac6fb8b0d0 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:01.501000 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c99b39-d77a-4161-bd66-c2c6a040461a None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:01.532701 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5735d49c-7a0b-403a-a622-8017c8685ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:01.533939 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5735d49c-7a0b-403a-a622-8017c8685ee0 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:01.534389 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5735d49c-7a0b-403a-a622-8017c8685ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:01.534804 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5735d49c-7a0b-403a-a622-8017c8685ee0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:01.536045 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5735d49c-7a0b-403a-a622-8017c8685ee0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:01.536658 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f50ad3f-c89c-4f55-bef3-a7c8dd51218b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:01.537273 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f50ad3f-c89c-4f55-bef3-a7c8dd51218b None admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:01.538151 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f50ad3f-c89c-4f55-bef3-a7c8dd51218b None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:01.538653 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f50ad3f-c89c-4f55-bef3-a7c8dd51218b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:01.539096 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5735d49c-7a0b-403a-a622-8017c8685ee0 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:01.539391 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f50ad3f-c89c-4f55-bef3-a7c8dd51218b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:01.540755 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f50ad3f-c89c-4f55-bef3-a7c8dd51218b None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:01.541205 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 523/1017] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:51:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 10:51:01.546987 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5735d49c-7a0b-403a-a622-8017c8685ee0 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:01.562049 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 495/1018] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 10:51:01 2022] POST /identity/v3/endpoints => generated 334 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 10:51:01.574336 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:01.656963 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f50ad3f-c89c-4f55-bef3-a7c8dd51218b None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:01.677207 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5735d49c-7a0b-403a-a622-8017c8685ee0 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:01.727410 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdeffb2-ddf4-424c-bbf8-606c587c33df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:01.728393 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdeffb2-ddf4-424c-bbf8-606c587c33df None admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:01.728671 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdeffb2-ddf4-424c-bbf8-606c587c33df None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:01.728949 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdeffb2-ddf4-424c-bbf8-606c587c33df None admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:01.729698 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdeffb2-ddf4-424c-bbf8-606c587c33df None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:01.731126 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdeffb2-ddf4-424c-bbf8-606c587c33df None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:01.763276 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 524/1019] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Aug 18 10:51:01 2022] POST /identity/v3/projects => generated 311 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 10:51:01.793744 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f50ad3f-c89c-4f55-bef3-a7c8dd51218b None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:01.795521 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:01.838090 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3799f5e-bcd0-4eee-b3db-b3f222b6148f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:01.838716 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3799f5e-bcd0-4eee-b3db-b3f222b6148f None admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:01.838986 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3799f5e-bcd0-4eee-b3db-b3f222b6148f None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:01.839253 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3799f5e-bcd0-4eee-b3db-b3f222b6148f None admin] PATH_INFO: `/v3/services` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:01.839910 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3799f5e-bcd0-4eee-b3db-b3f222b6148f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:01.841303 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3799f5e-bcd0-4eee-b3db-b3f222b6148f None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:01.860725 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 496/1020] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Aug 18 10:51:01 2022] POST /identity/v3/services => generated 242 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 10:51:03.623566 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf7b01-e7c6-4686-8263-95dba1a77b7e None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:03.624083 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf7b01-e7c6-4686-8263-95dba1a77b7e None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:03.624197 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf7b01-e7c6-4686-8263-95dba1a77b7e None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:03.625617 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 525/1021] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:51:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:51:03.630555 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b78282-a0bc-4a76-acd9-de1fc1d61f0e None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:03.630935 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b78282-a0bc-4a76-acd9-de1fc1d61f0e None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:03.631219 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b78282-a0bc-4a76-acd9-de1fc1d61f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:03.649818 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-86b78282-a0bc-4a76-acd9-de1fc1d61f0e None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:51:03.651015 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-86b78282-a0bc-4a76-acd9-de1fc1d61f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:51:03.729828 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 497/1022] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:51:03 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 10:51:03.758159 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e1714-fd4d-4b82-990f-d0606d18601c None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:03.758471 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e1714-fd4d-4b82-990f-d0606d18601c None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:03.758717 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e1714-fd4d-4b82-990f-d0606d18601c None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:03.760210 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 526/1023] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:51:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:51:03.765424 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be27f9e1-11d6-423e-adf8-c98033fe61fc None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:03.765753 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be27f9e1-11d6-423e-adf8-c98033fe61fc None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:03.766038 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be27f9e1-11d6-423e-adf8-c98033fe61fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:03.784587 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-be27f9e1-11d6-423e-adf8-c98033fe61fc None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:51:03.785809 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-be27f9e1-11d6-423e-adf8-c98033fe61fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:51:03.790266 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a1166-efcc-436a-9951-ce336fd3198f None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:03.790549 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a1166-efcc-436a-9951-ce336fd3198f None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:03.790827 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a1166-efcc-436a-9951-ce336fd3198f None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:03.792300 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 527/1024] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:51:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 10:51:03.797302 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118d7a7-3ef2-46db-b414-72b89d9d2e79 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:03.797621 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118d7a7-3ef2-46db-b414-72b89d9d2e79 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:03.797911 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118d7a7-3ef2-46db-b414-72b89d9d2e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:03.816518 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-e118d7a7-3ef2-46db-b414-72b89d9d2e79 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:51:03.817741 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-e118d7a7-3ef2-46db-b414-72b89d9d2e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:51:03.860144 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 498/1025] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:51:03 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 10:51:03.879304 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:03.901272 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 528/1026] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:51:03 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 10:51:03.994901 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be27f9e1-11d6-423e-adf8-c98033fe61fc None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:04.013989 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:04.097663 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be27f9e1-11d6-423e-adf8-c98033fe61fc None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:04.131815 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e118d7a7-3ef2-46db-b414-72b89d9d2e79 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:04.135964 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0945d9b0-4641-49a7-bca5-285c89da86b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:04.136603 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945d9b0-4641-49a7-bca5-285c89da86b6 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:04.136883 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945d9b0-4641-49a7-bca5-285c89da86b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:04.137160 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945d9b0-4641-49a7-bca5-285c89da86b6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:04.149054 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0945d9b0-4641-49a7-bca5-285c89da86b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:51:04.153733 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-0945d9b0-4641-49a7-bca5-285c89da86b6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 10:51:04.153733 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:51:04.153733 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:51:04.153733 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:51:04.153733 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:51:04.153733 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:51:04.153733 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:51:04.153733 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:51:04.153733 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:51:04.153733 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:51:04.153733 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:51:04.153733 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:51:04.153733 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:51:04.153733 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:51:04.153733 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:51:04.153733 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:51:04.154698 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:51:04.154698 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:51:04.154698 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:51:04.154698 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:51:04.154698 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:51:04.154698 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:51:04.154698 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:51:04.154698 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:51:04.154698 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:51:04.154698 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:51:04.154698 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:51:04.154698 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:51:04.154698 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:51:04.154698 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:51:04.154698 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:51:04.154698 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:51:04.155578 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:51:04.155578 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:51:04.155578 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:51:04.155578 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:51:04.155578 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:51:04.155578 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:51:04.155578 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:51:04.155578 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:51:04.155578 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:51:04.155578 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:51:04.155578 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 10:51:04.155578 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:51:04.155578 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 499/1027] 10.222.0.15 () {56 vars in 1120 bytes} [Thu Aug 18 10:51:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:51:04.160593 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0945d9b0-4641-49a7-bca5-285c89da86b6 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:04.236878 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e118d7a7-3ef2-46db-b414-72b89d9d2e79 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:04.243377 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:04.265399 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0945d9b0-4641-49a7-bca5-285c89da86b6 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:04.270617 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d2d14d-b521-4536-87d1-bcf2ac956e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:04.271251 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d2d14d-b521-4536-87d1-bcf2ac956e1a None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:04.271533 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d2d14d-b521-4536-87d1-bcf2ac956e1a None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:04.272441 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d2d14d-b521-4536-87d1-bcf2ac956e1a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:04.274071 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d2d14d-b521-4536-87d1-bcf2ac956e1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:04.275510 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d2d14d-b521-4536-87d1-bcf2ac956e1a None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:04.277100 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 529/1028] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:51:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 10:51:04.277893 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d2d14d-b521-4536-87d1-bcf2ac956e1a None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:04.301267 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428d4347-f135-4c29-ad58-9acf30234555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:04.301900 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d4347-f135-4c29-ad58-9acf30234555 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:04.302177 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d4347-f135-4c29-ad58-9acf30234555 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:04.302446 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d4347-f135-4c29-ad58-9acf30234555 None admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:04.303191 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428d4347-f135-4c29-ad58-9acf30234555 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:51:04.303495 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428d4347-f135-4c29-ad58-9acf30234555 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:04.304855 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428d4347-f135-4c29-ad58-9acf30234555 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:04.313198 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 500/1029] 10.222.0.15 () {56 vars in 1115 bytes} [Thu Aug 18 10:51:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 10:51:04.313918 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428d4347-f135-4c29-ad58-9acf30234555 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:04.345049 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:04.387874 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d2d14d-b521-4536-87d1-bcf2ac956e1a None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:04.416844 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428d4347-f135-4c29-ad58-9acf30234555 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:04.421874 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7f6c2a-2a1e-4600-9a52-82e349d238b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:04.422510 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f6c2a-2a1e-4600-9a52-82e349d238b9 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:04.422791 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f6c2a-2a1e-4600-9a52-82e349d238b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:04.423065 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f6c2a-2a1e-4600-9a52-82e349d238b9 None admin] PATH_INFO: `/v3/services/image` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:04.423648 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7f6c2a-2a1e-4600-9a52-82e349d238b9 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:04.425007 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7f6c2a-2a1e-4600-9a52-82e349d238b9 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:04.433898 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-4e7f6c2a-2a1e-4600-9a52-82e349d238b9 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 10:51:04.433898 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:51:04.433898 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 10:51:04.433898 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 10:51:04.433898 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 10:51:04.433898 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 10:51:04.433898 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 10:51:04.433898 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 10:51:04.433898 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 10:51:04.433898 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:51:04.433898 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 10:51:04.433898 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:51:04.433898 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:51:04.433898 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:51:04.433898 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:51:04.433898 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:51:04.433898 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:51:04.434920 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:51:04.434920 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:51:04.434920 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:51:04.434920 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:51:04.434920 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:51:04.434920 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:51:04.434920 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 10:51:04.434920 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 10:51:04.434920 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 10:51:04.434920 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 10:51:04.434920 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:51:04.434920 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:51:04.434920 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:51:04.434920 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:51:04.434920 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:51:04.434920 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:51:04.435784 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:51:04.435784 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:51:04.435784 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:51:04.435784 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:51:04.435784 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:51:04.435784 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:51:04.435784 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:51:04.435784 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:51:04.435784 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:51:04.435784 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:51:04.435784 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 10:51:04.435784 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 10:51:04.435784 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 10:51:04.435784 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:51:04.435784 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 530/1030] 10.222.0.15 () {56 vars in 1105 bytes} [Thu Aug 18 10:51:04 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:51:04.437065 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7f6c2a-2a1e-4600-9a52-82e349d238b9 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:04.455311 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c523c09-0869-4772-bfae-b096d56ae1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:04.455922 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c523c09-0869-4772-bfae-b096d56ae1f7 None admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:04.456204 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c523c09-0869-4772-bfae-b096d56ae1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:04.456478 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c523c09-0869-4772-bfae-b096d56ae1f7 None admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:04.457126 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c523c09-0869-4772-bfae-b096d56ae1f7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:04.458595 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c523c09-0869-4772-bfae-b096d56ae1f7 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:04.471217 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:04.481640 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 501/1031] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Aug 18 10:51:04 2022] POST /identity/v3/users => generated 285 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 10:51:04.482448 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c523c09-0869-4772-bfae-b096d56ae1f7 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:04.549361 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7f6c2a-2a1e-4600-9a52-82e349d238b9 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:04.576246 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:04.597773 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1a77a6-c5d4-4661-b038-1b79ecdc59dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:04.598429 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1a77a6-c5d4-4661-b038-1b79ecdc59dd None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:04.598708 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1a77a6-c5d4-4661-b038-1b79ecdc59dd None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:04.598982 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1a77a6-c5d4-4661-b038-1b79ecdc59dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:04.612090 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1a77a6-c5d4-4661-b038-1b79ecdc59dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:04.613578 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1a77a6-c5d4-4661-b038-1b79ecdc59dd None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:04.625848 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c523c09-0869-4772-bfae-b096d56ae1f7 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:04.634305 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-2c1a77a6-c5d4-4661-b038-1b79ecdc59dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:51:04.634305 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:51:04.634305 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:51:04.634305 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:51:04.634305 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:51:04.634305 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:51:04.634305 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:51:04.634305 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:51:04.634305 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:51:04.634305 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:51:04.634305 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:51:04.634305 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:51:04.634305 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 10:51:04.634305 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 10:51:04.634305 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 10:51:04.634305 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 10:51:04.635768 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:51:04.635768 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:51:04.635768 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:51:04.635768 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:51:04.635768 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:51:04.635768 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:51:04.635768 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:51:04.635768 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:51:04.635768 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:51:04.635768 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:51:04.635768 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:51:04.635768 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:51:04.635768 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:51:04.635768 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:51:04.635768 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:51:04.635768 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:51:04.635768 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 10:51:04.637770 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 10:51:04.637770 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:51:04.637770 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:51:04.637770 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 531/1032] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:51:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:51:04.642386 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1a77a6-c5d4-4661-b038-1b79ecdc59dd None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:04.679203 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e98d5e-14ca-4b1f-aca8-ff10eb7baf21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:04.679973 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e98d5e-14ca-4b1f-aca8-ff10eb7baf21 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:04.680060 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e98d5e-14ca-4b1f-aca8-ff10eb7baf21 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:04.680460 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e98d5e-14ca-4b1f-aca8-ff10eb7baf21 None admin] PATH_INFO: `/v3/services` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:04.680962 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e98d5e-14ca-4b1f-aca8-ff10eb7baf21 None admin] RBAC: Adding query filter params (name=image) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:51:04.681265 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e98d5e-14ca-4b1f-aca8-ff10eb7baf21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:04.682727 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e98d5e-14ca-4b1f-aca8-ff10eb7baf21 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:04.687920 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 502/1033] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:51:04 2022] GET /identity/v3/services?name=image => generated 122 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:51:04.694632 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e98d5e-14ca-4b1f-aca8-ff10eb7baf21 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:04.770440 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:04.776299 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1a77a6-c5d4-4661-b038-1b79ecdc59dd None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:04.814002 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cfcb4e-7f81-4a63-8d31-460835fcedc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:04.814610 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cfcb4e-7f81-4a63-8d31-460835fcedc4 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:04.814975 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cfcb4e-7f81-4a63-8d31-460835fcedc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:04.815161 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cfcb4e-7f81-4a63-8d31-460835fcedc4 None admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:04.815781 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cfcb4e-7f81-4a63-8d31-460835fcedc4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:51:04.815886 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e98d5e-14ca-4b1f-aca8-ff10eb7baf21 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:04.816102 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cfcb4e-7f81-4a63-8d31-460835fcedc4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:04.817436 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cfcb4e-7f81-4a63-8d31-460835fcedc4 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:04.832086 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 532/1034] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 18 10:51:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 10:51:04.837505 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cfcb4e-7f81-4a63-8d31-460835fcedc4 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:04.854555 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c70a35f-fdbe-4fbb-979f-eaba5c43c04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:04.855174 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c70a35f-fdbe-4fbb-979f-eaba5c43c04c None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:04.855452 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c70a35f-fdbe-4fbb-979f-eaba5c43c04c None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:04.855726 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c70a35f-fdbe-4fbb-979f-eaba5c43c04c None admin] PATH_INFO: `/v3/services` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:04.856460 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c70a35f-fdbe-4fbb-979f-eaba5c43c04c None admin] RBAC: Adding query filter params (type=image) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:51:04.856795 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c70a35f-fdbe-4fbb-979f-eaba5c43c04c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:04.858191 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c70a35f-fdbe-4fbb-979f-eaba5c43c04c None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:04.870179 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 503/1035] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:51:04 2022] GET /identity/v3/services?type=image => generated 350 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 10:51:04.871992 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c70a35f-fdbe-4fbb-979f-eaba5c43c04c None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:04.874317 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:04.976311 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cfcb4e-7f81-4a63-8d31-460835fcedc4 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:04.995029 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c70a35f-fdbe-4fbb-979f-eaba5c43c04c None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:05.020987 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:05.022408 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d96b05-6f9f-4afa-9991-3690ce71a72c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:05.023600 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d96b05-6f9f-4afa-9991-3690ce71a72c None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:05.024153 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d96b05-6f9f-4afa-9991-3690ce71a72c None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:05.024438 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d96b05-6f9f-4afa-9991-3690ce71a72c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:05.032831 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d96b05-6f9f-4afa-9991-3690ce71a72c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:05.034314 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d96b05-6f9f-4afa-9991-3690ce71a72c None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:05.035896 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd87d82-588e-4061-8d79-b187dc0e9daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:05.036530 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd87d82-588e-4061-8d79-b187dc0e9daf None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:05.036812 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd87d82-588e-4061-8d79-b187dc0e9daf None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:05.037359 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd87d82-588e-4061-8d79-b187dc0e9daf None admin] PATH_INFO: `/v3/endpoints` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:05.039098 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd87d82-588e-4061-8d79-b187dc0e9daf None admin] RBAC: Adding query filter params (interface=public, service_id=a52a13e3cc74426595fff8d20134f14e, region_id=RegionOne) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:51:05.039572 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd87d82-588e-4061-8d79-b187dc0e9daf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:05.041272 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd87d82-588e-4061-8d79-b187dc0e9daf None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:05.048110 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-23d96b05-6f9f-4afa-9991-3690ce71a72c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 10:51:05.048110 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:51:05.048110 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:51:05.048110 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:51:05.048110 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:51:05.048110 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:51:05.048110 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:51:05.048110 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:51:05.048110 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:51:05.048110 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:51:05.048110 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:51:05.048110 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:51:05.048110 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 10:51:05.048110 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 10:51:05.048110 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 10:51:05.048110 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 10:51:05.055085 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:51:05.055085 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:51:05.055085 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 10:51:05.055085 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 10:51:05.055085 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 10:51:05.055085 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 10:51:05.055085 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:51:05.055085 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:51:05.055085 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:51:05.055085 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:51:05.055085 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:51:05.055085 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:51:05.055085 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:51:05.055085 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:51:05.055085 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:51:05.055085 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:51:05.055085 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:51:05.055085 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:51:05.056042 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:51:05.056042 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:51:05.056042 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 10:51:05.056042 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 10:51:05.056042 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 10:51:05.056042 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 10:51:05.056042 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 10:51:05.056042 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 10:51:05.056042 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 10:51:05.056042 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:51:05.056594 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 504/1036] 10.222.0.15 () {56 vars in 1251 bytes} [Thu Aug 18 10:51:04 2022] GET /identity/v3/endpoints?service_id=a52a13e3cc74426595fff8d20134f14e&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:51:05.056679 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 533/1037] 10.222.0.15 () {56 vars in 1093 bytes} [Thu Aug 18 10:51:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 10:51:05.056765 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd87d82-588e-4061-8d79-b187dc0e9daf None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:05.057639 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d96b05-6f9f-4afa-9991-3690ce71a72c None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:05.165679 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:05.173954 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d96b05-6f9f-4afa-9991-3690ce71a72c None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:05.187198 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd87d82-588e-4061-8d79-b187dc0e9daf None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:05.219643 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0973ced-b127-4a60-85bc-2072b9313ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:05.220422 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0973ced-b127-4a60-85bc-2072b9313ead None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:05.220713 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0973ced-b127-4a60-85bc-2072b9313ead None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:05.220999 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0973ced-b127-4a60-85bc-2072b9313ead None admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:05.222155 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0973ced-b127-4a60-85bc-2072b9313ead None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:51:05.222405 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0973ced-b127-4a60-85bc-2072b9313ead None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:05.223839 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0973ced-b127-4a60-85bc-2072b9313ead None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:05.230099 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a6291b-2553-4245-bfc7-4de3754d3bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:05.230647 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a6291b-2553-4245-bfc7-4de3754d3bbf None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:05.230922 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a6291b-2553-4245-bfc7-4de3754d3bbf None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:05.231190 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a6291b-2553-4245-bfc7-4de3754d3bbf None admin] PATH_INFO: `/v3/services` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:05.231792 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a6291b-2553-4245-bfc7-4de3754d3bbf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:05.233165 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a6291b-2553-4245-bfc7-4de3754d3bbf None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:05.240295 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 505/1038] 10.222.0.15 () {56 vars in 1087 bytes} [Thu Aug 18 10:51:05 2022] GET /identity/v3/services => generated 1957 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 10:51:05.249505 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 534/1039] 10.222.0.15 () {56 vars in 1133 bytes} [Thu Aug 18 10:51:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:51:05.250897 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a6291b-2553-4245-bfc7-4de3754d3bbf None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:05.315753 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:05.370258 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a6291b-2553-4245-bfc7-4de3754d3bbf None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:05.410503 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373102a1-75cf-4e72-9fc4-e59dd03639f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:05.411122 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373102a1-75cf-4e72-9fc4-e59dd03639f4 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:05.412079 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373102a1-75cf-4e72-9fc4-e59dd03639f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:05.412079 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373102a1-75cf-4e72-9fc4-e59dd03639f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:05.490537 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373102a1-75cf-4e72-9fc4-e59dd03639f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:05.492100 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373102a1-75cf-4e72-9fc4-e59dd03639f4 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:05.546419 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:05.604230 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 506/1040] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 18 10:51:05 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 10:51:05.610189 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0973ced-b127-4a60-85bc-2072b9313ead None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:05.720123 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0973ced-b127-4a60-85bc-2072b9313ead None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:05.759769 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ab3106-f298-40bb-9a15-7a2f8aea9db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:05.760320 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ab3106-f298-40bb-9a15-7a2f8aea9db7 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:05.760602 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ab3106-f298-40bb-9a15-7a2f8aea9db7 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:05.760877 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ab3106-f298-40bb-9a15-7a2f8aea9db7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:05.771126 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ab3106-f298-40bb-9a15-7a2f8aea9db7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:05.774191 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ab3106-f298-40bb-9a15-7a2f8aea9db7 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:05.790512 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-d7ab3106-f298-40bb-9a15-7a2f8aea9db7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:51:05.790512 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:51:05.790512 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:51:05.790512 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:51:05.790512 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:51:05.790512 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:51:05.790512 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:51:05.790512 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:51:05.790512 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:51:05.790512 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:51:05.790512 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:51:05.790512 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:51:05.790512 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 10:51:05.790512 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 10:51:05.790512 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 10:51:05.790512 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 10:51:05.791525 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:51:05.791525 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:51:05.791525 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:51:05.791525 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:51:05.791525 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:51:05.791525 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:51:05.791525 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:51:05.791525 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:51:05.791525 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:51:05.791525 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:51:05.791525 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:51:05.791525 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:51:05.791525 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:51:05.791525 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:51:05.791525 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:51:05.791525 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:51:05.791525 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 10:51:05.792440 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 10:51:05.792440 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:51:05.792440 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:51:05.793602 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 535/1041] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:51:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:51:05.797373 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373102a1-75cf-4e72-9fc4-e59dd03639f4 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:05.904962 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373102a1-75cf-4e72-9fc4-e59dd03639f4 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:05.941800 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b57170-ed9c-40f8-af12-bbcaa35a6011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:05.942405 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b57170-ed9c-40f8-af12-bbcaa35a6011 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:05.942685 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b57170-ed9c-40f8-af12-bbcaa35a6011 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:05.942959 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b57170-ed9c-40f8-af12-bbcaa35a6011 None admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:05.943793 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b57170-ed9c-40f8-af12-bbcaa35a6011 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:51:05.944410 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b57170-ed9c-40f8-af12-bbcaa35a6011 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:05.945804 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b57170-ed9c-40f8-af12-bbcaa35a6011 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:05.961542 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 507/1042] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 18 10:51:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:51:05.963410 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ab3106-f298-40bb-9a15-7a2f8aea9db7 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:05.968232 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:06.071056 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ab3106-f298-40bb-9a15-7a2f8aea9db7 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:06.104946 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f75ad9-f01c-4fab-8b01-2446e23c317c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:06.105594 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f75ad9-f01c-4fab-8b01-2446e23c317c None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:06.105877 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f75ad9-f01c-4fab-8b01-2446e23c317c None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:06.106145 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f75ad9-f01c-4fab-8b01-2446e23c317c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:06.113079 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f75ad9-f01c-4fab-8b01-2446e23c317c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:06.114540 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f75ad9-f01c-4fab-8b01-2446e23c317c None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:06.126459 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-21f75ad9-f01c-4fab-8b01-2446e23c317c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 10:51:06.126459 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:51:06.126459 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:51:06.126459 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:51:06.126459 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:51:06.126459 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:51:06.126459 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:51:06.126459 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:51:06.126459 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:51:06.126459 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:51:06.126459 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:51:06.126459 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:51:06.126459 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 10:51:06.126459 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 10:51:06.126459 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 10:51:06.127527 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 10:51:06.127527 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:51:06.127527 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:51:06.127527 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:51:06.127527 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:51:06.127527 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:51:06.127527 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:51:06.127527 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:51:06.127527 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:51:06.127527 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:51:06.127527 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:51:06.127527 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:51:06.127527 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:51:06.127527 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:51:06.127527 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:51:06.127527 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:51:06.127527 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:51:06.128410 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 10:51:06.128410 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 10:51:06.128410 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 10:51:06.128410 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 10:51:06.128410 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 10:51:06.128410 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 10:51:06.128410 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 10:51:06.128410 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:51:06.129683 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 536/1043] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 18 10:51:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:51:06.133618 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b57170-ed9c-40f8-af12-bbcaa35a6011 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:06.150581 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:06.254524 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b57170-ed9c-40f8-af12-bbcaa35a6011 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:06.291415 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b8e113-c5ee-4451-88d0-599ad0ac5a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:06.292030 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b8e113-c5ee-4451-88d0-599ad0ac5a33 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:06.292309 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b8e113-c5ee-4451-88d0-599ad0ac5a33 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:06.292581 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b8e113-c5ee-4451-88d0-599ad0ac5a33 None admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:06.293269 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b8e113-c5ee-4451-88d0-599ad0ac5a33 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:51:06.293597 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b8e113-c5ee-4451-88d0-599ad0ac5a33 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:06.295033 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b8e113-c5ee-4451-88d0-599ad0ac5a33 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:06.312716 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 508/1044] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Aug 18 10:51:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:51:06.313945 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f75ad9-f01c-4fab-8b01-2446e23c317c None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:06.379430 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:06.421756 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f75ad9-f01c-4fab-8b01-2446e23c317c None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:06.455448 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2d0bae-e5d4-4894-9b1f-f02600814d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:06.456060 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2d0bae-e5d4-4894-9b1f-f02600814d03 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:06.456337 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2d0bae-e5d4-4894-9b1f-f02600814d03 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:06.456607 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2d0bae-e5d4-4894-9b1f-f02600814d03 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:06.457323 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2d0bae-e5d4-4894-9b1f-f02600814d03 None admin] RBAC: Adding query filter params (role.id=3e108171f00d4bff8db5c27b4446c417, scope.project.id=1575e8ebaaab4650995841659b6e631b, user.id=a005d8f0c46d44c7b6f2201a54717b12) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:51:06.457659 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2d0bae-e5d4-4894-9b1f-f02600814d03 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:06.459698 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2d0bae-e5d4-4894-9b1f-f02600814d03 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:06.469605 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 537/1045] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Aug 18 10:51:06 2022] GET /identity/v3/role_assignments?user.id=a005d8f0c46d44c7b6f2201a54717b12&scope.project.id=1575e8ebaaab4650995841659b6e631b&role.id=3e108171f00d4bff8db5c27b4446c417 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 10:51:06.558514 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae6aff-959d-4b10-8591-e95c3f29f27e None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:06.558837 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae6aff-959d-4b10-8591-e95c3f29f27e None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:06.559065 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae6aff-959d-4b10-8591-e95c3f29f27e None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:06.560572 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 509/1046] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:51:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:51:06.566152 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb0e25-84cf-48f3-aa1c-729df4e03ae9 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:06.566428 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb0e25-84cf-48f3-aa1c-729df4e03ae9 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:06.566706 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb0e25-84cf-48f3-aa1c-729df4e03ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:06.585506 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-9ccb0e25-84cf-48f3-aa1c-729df4e03ae9 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:51:06.586762 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-9ccb0e25-84cf-48f3-aa1c-729df4e03ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:51:06.666067 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 538/1047] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:51:06 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 10:51:06.940251 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ae6aff-959d-4b10-8591-e95c3f29f27e None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:07.014844 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:07.049411 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ae6aff-959d-4b10-8591-e95c3f29f27e None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:07.086883 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32938591-89f8-49fd-8c7d-8ee8d0eb59ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:07.087516 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32938591-89f8-49fd-8c7d-8ee8d0eb59ff None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:07.087790 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32938591-89f8-49fd-8c7d-8ee8d0eb59ff None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:07.088059 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32938591-89f8-49fd-8c7d-8ee8d0eb59ff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:07.098851 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32938591-89f8-49fd-8c7d-8ee8d0eb59ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:51:07.104128 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-32938591-89f8-49fd-8c7d-8ee8d0eb59ff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 10:51:07.104128 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:51:07.104128 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:51:07.104128 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:51:07.104128 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:51:07.104128 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:51:07.104128 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:51:07.104128 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:51:07.104128 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:51:07.104128 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:51:07.104128 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:51:07.104128 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:51:07.104128 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:51:07.104128 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:51:07.104128 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:51:07.104128 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:51:07.105073 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:51:07.105073 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:51:07.105073 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:51:07.105073 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:51:07.105073 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:51:07.105073 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:51:07.105073 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:51:07.105073 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:51:07.105073 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:51:07.105073 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:51:07.105073 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:51:07.105073 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:51:07.105073 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:51:07.105073 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:51:07.105073 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:51:07.105073 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:51:07.105940 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:51:07.105940 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:51:07.105940 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:51:07.105940 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:51:07.105940 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:51:07.105940 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:51:07.105940 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:51:07.105940 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:51:07.105940 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:51:07.105940 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:51:07.105940 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 10:51:07.105940 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:51:07.109868 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 510/1048] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Aug 18 10:51:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:51:07.111384 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccb0e25-84cf-48f3-aa1c-729df4e03ae9 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:07.172294 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:07.206494 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abfe073-cd74-4da9-a16c-072d0a391f5f None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:07.206779 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abfe073-cd74-4da9-a16c-072d0a391f5f None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:07.207054 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abfe073-cd74-4da9-a16c-072d0a391f5f None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:07.209718 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 511/1049] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:51:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:51:07.215120 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec0285-ffa6-4c7e-8e68-3c20854949ad None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:07.215120 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec0285-ffa6-4c7e-8e68-3c20854949ad None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:07.215120 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec0285-ffa6-4c7e-8e68-3c20854949ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:07.232112 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccb0e25-84cf-48f3-aa1c-729df4e03ae9 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:07.234810 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-f9ec0285-ffa6-4c7e-8e68-3c20854949ad None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:51:07.236004 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-f9ec0285-ffa6-4c7e-8e68-3c20854949ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:51:07.273724 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca79c9f-44db-4269-b10e-553f6d574291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:07.274364 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca79c9f-44db-4269-b10e-553f6d574291 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:07.274614 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca79c9f-44db-4269-b10e-553f6d574291 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:07.274879 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca79c9f-44db-4269-b10e-553f6d574291 None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:07.275539 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca79c9f-44db-4269-b10e-553f6d574291 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:51:07.275838 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca79c9f-44db-4269-b10e-553f6d574291 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:07.277204 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca79c9f-44db-4269-b10e-553f6d574291 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:07.286190 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 539/1050] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 18 10:51:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:51:07.296249 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca79c9f-44db-4269-b10e-553f6d574291 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:07.333593 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 512/1051] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:51:07 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 10:51:07.415221 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca79c9f-44db-4269-b10e-553f6d574291 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:07.435750 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:07.452071 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b156b09-37c3-4897-8612-9d390a603d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:07.452711 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b156b09-37c3-4897-8612-9d390a603d19 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:07.452990 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b156b09-37c3-4897-8612-9d390a603d19 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:07.453263 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b156b09-37c3-4897-8612-9d390a603d19 None admin] PATH_INFO: `/v3/users/28dbf588c17b43fab1ce6b60dc8c5ab7` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:07.469005 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b156b09-37c3-4897-8612-9d390a603d19 None admin] RBAC: Authorizing `identity:get_user(user_id=28dbf588c17b43fab1ce6b60dc8c5ab7)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:07.470402 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b156b09-37c3-4897-8612-9d390a603d19 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:07.472251 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 540/1052] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Aug 18 10:51:07 2022] GET /identity/v3/users/28dbf588c17b43fab1ce6b60dc8c5ab7 => generated 285 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 10:51:07.478412 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ec0285-ffa6-4c7e-8e68-3c20854949ad None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:07.544010 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:07.589749 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ec0285-ffa6-4c7e-8e68-3c20854949ad None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:07.597716 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b156b09-37c3-4897-8612-9d390a603d19 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:07.639628 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38571764-14f0-4a61-93af-f10e46794ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:07.640303 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38571764-14f0-4a61-93af-f10e46794ab0 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:07.640587 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38571764-14f0-4a61-93af-f10e46794ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:07.640860 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38571764-14f0-4a61-93af-f10e46794ab0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:07.702109 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b156b09-37c3-4897-8612-9d390a603d19 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:07.722252 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38571764-14f0-4a61-93af-f10e46794ab0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:07.724244 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38571764-14f0-4a61-93af-f10e46794ab0 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:07.743174 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318dc4b7-499e-4fba-817c-bae4e8b4f6d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:07.743895 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318dc4b7-499e-4fba-817c-bae4e8b4f6d8 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:07.744120 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318dc4b7-499e-4fba-817c-bae4e8b4f6d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:07.744374 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318dc4b7-499e-4fba-817c-bae4e8b4f6d8 None admin] PATH_INFO: `/v3/services/image` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:07.744947 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318dc4b7-499e-4fba-817c-bae4e8b4f6d8 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:07.746384 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318dc4b7-499e-4fba-817c-bae4e8b4f6d8 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:07.755144 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-318dc4b7-499e-4fba-817c-bae4e8b4f6d8 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 10:51:07.755144 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:51:07.755144 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 10:51:07.755144 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 10:51:07.755144 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 10:51:07.755144 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 10:51:07.755144 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 10:51:07.755144 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 10:51:07.755144 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 10:51:07.755144 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:51:07.755144 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 10:51:07.755144 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:51:07.755144 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:51:07.755144 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:51:07.755144 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:51:07.755144 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:51:07.755144 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:51:07.756301 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:51:07.756301 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:51:07.756301 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:51:07.756301 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:51:07.756301 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:51:07.756301 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:51:07.756301 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 10:51:07.756301 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 10:51:07.756301 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 10:51:07.756301 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 10:51:07.756301 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:51:07.756301 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:51:07.756301 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:51:07.756301 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:51:07.756301 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:51:07.756301 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:51:07.757378 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:51:07.757378 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:51:07.757378 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:51:07.757378 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:51:07.757378 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:51:07.757378 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:51:07.757378 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:51:07.757378 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:51:07.757378 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:51:07.757378 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:51:07.757378 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 10:51:07.757378 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 10:51:07.757378 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 10:51:07.757378 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:51:07.762081 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 541/1053] 10.222.0.15 () {56 vars in 1105 bytes} [Thu Aug 18 10:51:07 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 10:51:07.762922 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318dc4b7-499e-4fba-817c-bae4e8b4f6d8 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:07.799647 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:07.813751 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:07.851079 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 513/1054] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 18 10:51:07 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 10:51:07.857201 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38571764-14f0-4a61-93af-f10e46794ab0 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:07.883657 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318dc4b7-499e-4fba-817c-bae4e8b4f6d8 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:07.928590 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea16114-26d7-45e4-84d2-a3e5cff20c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:07.929198 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea16114-26d7-45e4-84d2-a3e5cff20c5c None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:07.929466 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea16114-26d7-45e4-84d2-a3e5cff20c5c None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:07.929755 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea16114-26d7-45e4-84d2-a3e5cff20c5c None admin] PATH_INFO: `/v3/services` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:07.930378 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea16114-26d7-45e4-84d2-a3e5cff20c5c None admin] RBAC: Adding query filter params (name=image) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:51:07.930671 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea16114-26d7-45e4-84d2-a3e5cff20c5c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:07.932051 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea16114-26d7-45e4-84d2-a3e5cff20c5c None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:07.937355 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 542/1055] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:51:07 2022] GET /identity/v3/services?name=image => generated 122 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 10:51:07.944171 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea16114-26d7-45e4-84d2-a3e5cff20c5c None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:07.981508 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38571764-14f0-4a61-93af-f10e46794ab0 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:08.018431 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4f1ad1-0837-4882-a246-15619dc7e98b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:08.019058 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f1ad1-0837-4882-a246-15619dc7e98b None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:08.019335 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f1ad1-0837-4882-a246-15619dc7e98b None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:08.019607 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f1ad1-0837-4882-a246-15619dc7e98b None admin] PATH_INFO: `/v3/projects/909295b933f3490daa022ddd278d626f` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:08.020732 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4f1ad1-0837-4882-a246-15619dc7e98b None admin] RBAC: Authorizing `identity:get_project(project_id=909295b933f3490daa022ddd278d626f)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:08.022287 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4f1ad1-0837-4882-a246-15619dc7e98b None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:08.024417 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 514/1056] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 18 10:51:07 2022] GET /identity/v3/projects/909295b933f3490daa022ddd278d626f => generated 311 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:51:08.030143 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4f1ad1-0837-4882-a246-15619dc7e98b None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:08.052469 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea16114-26d7-45e4-84d2-a3e5cff20c5c None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:08.060914 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:08.062274 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:08.094432 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4368090-071b-45bd-bcf3-1c948323b0c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:08.095120 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4368090-071b-45bd-bcf3-1c948323b0c8 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:08.095328 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4368090-071b-45bd-bcf3-1c948323b0c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:08.095586 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4368090-071b-45bd-bcf3-1c948323b0c8 None admin] PATH_INFO: `/v3/services` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:08.096220 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4368090-071b-45bd-bcf3-1c948323b0c8 None admin] RBAC: Adding query filter params (type=image) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:51:08.096520 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4368090-071b-45bd-bcf3-1c948323b0c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:08.097925 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4368090-071b-45bd-bcf3-1c948323b0c8 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:08.104020 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 543/1057] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:51:07 2022] GET /identity/v3/services?type=image => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:51:08.109414 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4368090-071b-45bd-bcf3-1c948323b0c8 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:08.142224 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4f1ad1-0837-4882-a246-15619dc7e98b None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:08.181736 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce54670-24cc-45c5-8005-20625b119b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:08.182346 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce54670-24cc-45c5-8005-20625b119b71 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:08.182628 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce54670-24cc-45c5-8005-20625b119b71 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:08.182901 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce54670-24cc-45c5-8005-20625b119b71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:08.183634 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce54670-24cc-45c5-8005-20625b119b71 None admin] RBAC: Adding query filter params (role.id=127fdc7ef05b4e0b98a940b334e5fcab, scope.project.id=909295b933f3490daa022ddd278d626f, user.id=28dbf588c17b43fab1ce6b60dc8c5ab7) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:51:08.183944 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce54670-24cc-45c5-8005-20625b119b71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:08.185375 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce54670-24cc-45c5-8005-20625b119b71 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:08.191328 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 515/1058] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Aug 18 10:51:08 2022] GET /identity/v3/role_assignments?user.id=28dbf588c17b43fab1ce6b60dc8c5ab7&scope.project.id=909295b933f3490daa022ddd278d626f&role.id=127fdc7ef05b4e0b98a940b334e5fcab => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 10:51:08.233251 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4368090-071b-45bd-bcf3-1c948323b0c8 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:08.274333 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6974d440-15b3-4bc8-8699-afc497c2346d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:08.274956 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6974d440-15b3-4bc8-8699-afc497c2346d None admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:08.275237 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6974d440-15b3-4bc8-8699-afc497c2346d None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:08.275515 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6974d440-15b3-4bc8-8699-afc497c2346d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:08.276193 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6974d440-15b3-4bc8-8699-afc497c2346d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:08.277699 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6974d440-15b3-4bc8-8699-afc497c2346d None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:08.321552 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 544/1059] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 10:51:08 2022] POST /identity/v3/endpoints => generated 327 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 10:51:08.421697 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069429bb-e473-4172-b7dc-aae84e7f41ba None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:08.422069 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069429bb-e473-4172-b7dc-aae84e7f41ba None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:08.422273 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069429bb-e473-4172-b7dc-aae84e7f41ba None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:08.423781 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 516/1060] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:51:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:51:08.429836 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca067fc-7ebb-4ffc-bffc-7944a1f49e16 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:08.430149 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca067fc-7ebb-4ffc-bffc-7944a1f49e16 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:08.430399 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca067fc-7ebb-4ffc-bffc-7944a1f49e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:08.450745 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-fca067fc-7ebb-4ffc-bffc-7944a1f49e16 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:51:08.451968 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-fca067fc-7ebb-4ffc-bffc-7944a1f49e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:51:08.475352 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:08.543862 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 545/1061] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:51:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 10:51:08.818198 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069429bb-e473-4172-b7dc-aae84e7f41ba None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:08.922697 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:08.932547 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069429bb-e473-4172-b7dc-aae84e7f41ba None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:08.967650 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7364ff64-9a1d-43ed-a6f6-a33e16330439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:08.968282 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7364ff64-9a1d-43ed-a6f6-a33e16330439 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:08.968563 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7364ff64-9a1d-43ed-a6f6-a33e16330439 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:08.968838 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7364ff64-9a1d-43ed-a6f6-a33e16330439 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:08.980503 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7364ff64-9a1d-43ed-a6f6-a33e16330439 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:51:08.985154 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-7364ff64-9a1d-43ed-a6f6-a33e16330439 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 10:51:08.985154 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:51:08.985154 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:51:08.985154 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:51:08.985154 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:51:08.985154 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:51:08.985154 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:51:08.985154 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:51:08.985154 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:51:08.985154 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:51:08.985154 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:51:08.985154 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:51:08.985154 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:51:08.985154 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:51:08.985154 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:51:08.985154 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:51:08.986511 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:51:08.986511 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:51:08.986511 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:51:08.986511 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:51:08.986511 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:51:08.986511 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:51:08.986511 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:51:08.986511 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:51:08.986511 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:51:08.986511 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:51:08.986511 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:51:08.986511 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:51:08.986511 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:51:08.986511 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:51:08.986511 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:51:08.986511 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:51:08.987366 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:51:08.987366 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:51:08.987366 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:51:08.987366 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:51:08.987366 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:51:08.987366 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:51:08.987366 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:51:08.987366 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:51:08.987366 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:51:08.987366 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:51:08.987366 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 10:51:08.987366 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:51:08.989830 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 517/1062] 10.222.0.15 () {56 vars in 1120 bytes} [Thu Aug 18 10:51:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 10:51:08.993556 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca067fc-7ebb-4ffc-bffc-7944a1f49e16 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:09.097325 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca067fc-7ebb-4ffc-bffc-7944a1f49e16 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:09.135130 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61e39ee-b85d-480e-a4e7-4b795ce3addd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:09.135747 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e39ee-b85d-480e-a4e7-4b795ce3addd None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:09.136028 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e39ee-b85d-480e-a4e7-4b795ce3addd None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:09.136311 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e39ee-b85d-480e-a4e7-4b795ce3addd None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:09.136982 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61e39ee-b85d-480e-a4e7-4b795ce3addd None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:51:09.137287 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61e39ee-b85d-480e-a4e7-4b795ce3addd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:09.138685 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61e39ee-b85d-480e-a4e7-4b795ce3addd None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:09.147867 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 546/1063] 10.222.0.15 () {56 vars in 1115 bytes} [Thu Aug 18 10:51:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:51:09.154221 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7364ff64-9a1d-43ed-a6f6-a33e16330439 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:09.272968 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7364ff64-9a1d-43ed-a6f6-a33e16330439 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:09.311390 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33d0003-953e-4681-9e31-1ed534418e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:09.312028 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33d0003-953e-4681-9e31-1ed534418e0f None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:09.312309 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33d0003-953e-4681-9e31-1ed534418e0f None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:09.312582 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33d0003-953e-4681-9e31-1ed534418e0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:09.323761 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33d0003-953e-4681-9e31-1ed534418e0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:09.325241 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33d0003-953e-4681-9e31-1ed534418e0f None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:09.340912 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-b33d0003-953e-4681-9e31-1ed534418e0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:51:09.340912 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:51:09.340912 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:51:09.340912 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:51:09.340912 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:51:09.340912 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:51:09.340912 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:51:09.340912 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:51:09.340912 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:51:09.340912 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:51:09.340912 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:51:09.340912 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:51:09.340912 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 10:51:09.340912 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 10:51:09.340912 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 10:51:09.340912 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 10:51:09.342098 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:51:09.342098 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:51:09.342098 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:51:09.342098 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:51:09.342098 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:51:09.342098 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:51:09.342098 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:51:09.342098 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:51:09.342098 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:51:09.342098 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:51:09.342098 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:51:09.342098 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:51:09.342098 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:51:09.342098 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:51:09.342098 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:51:09.342098 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:51:09.342098 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 10:51:09.342993 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 10:51:09.342993 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:51:09.342993 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:51:09.345902 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 518/1064] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:51:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:51:09.348116 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61e39ee-b85d-480e-a4e7-4b795ce3addd None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:09.365737 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:09.455461 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61e39ee-b85d-480e-a4e7-4b795ce3addd None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:09.489919 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ec17fc-5e41-40d2-a405-17bb90e19ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:09.491096 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec17fc-5e41-40d2-a405-17bb90e19ccc None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:09.491384 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec17fc-5e41-40d2-a405-17bb90e19ccc None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:09.491662 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec17fc-5e41-40d2-a405-17bb90e19ccc None admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:09.492312 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ec17fc-5e41-40d2-a405-17bb90e19ccc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:51:09.492625 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ec17fc-5e41-40d2-a405-17bb90e19ccc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:09.494149 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ec17fc-5e41-40d2-a405-17bb90e19ccc None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:09.506474 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 547/1065] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 18 10:51:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 10:51:09.512079 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33d0003-953e-4681-9e31-1ed534418e0f None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:09.522307 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:09.617156 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33d0003-953e-4681-9e31-1ed534418e0f None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:09.653324 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2be54f-661b-4be0-b9a2-25d7dd605f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:09.654040 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2be54f-661b-4be0-b9a2-25d7dd605f2b None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:09.654327 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2be54f-661b-4be0-b9a2-25d7dd605f2b None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:09.654602 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2be54f-661b-4be0-b9a2-25d7dd605f2b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:09.663024 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2be54f-661b-4be0-b9a2-25d7dd605f2b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:09.664485 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2be54f-661b-4be0-b9a2-25d7dd605f2b None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:09.675714 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-5c2be54f-661b-4be0-b9a2-25d7dd605f2b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 10:51:09.675714 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:51:09.675714 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:51:09.675714 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:51:09.675714 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:51:09.675714 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:51:09.675714 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:51:09.675714 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:51:09.675714 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:51:09.675714 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:51:09.675714 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:51:09.675714 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:51:09.675714 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 10:51:09.675714 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 10:51:09.675714 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 10:51:09.675714 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 10:51:09.676731 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:51:09.676731 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:51:09.676731 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 10:51:09.676731 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 10:51:09.676731 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 10:51:09.676731 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 10:51:09.676731 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:51:09.676731 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:51:09.676731 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:51:09.676731 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:51:09.676731 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:51:09.676731 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:51:09.676731 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:51:09.676731 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:51:09.676731 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:51:09.676731 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:51:09.676731 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:51:09.676731 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:51:09.678734 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:51:09.678734 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:51:09.678734 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 10:51:09.678734 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 10:51:09.678734 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 10:51:09.678734 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 10:51:09.678734 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 10:51:09.678734 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 10:51:09.678734 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 10:51:09.678734 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:51:09.681845 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 519/1066] 10.222.0.15 () {56 vars in 1093 bytes} [Thu Aug 18 10:51:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:51:09.682935 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ec17fc-5e41-40d2-a405-17bb90e19ccc None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:09.765654 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:09.794141 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ec17fc-5e41-40d2-a405-17bb90e19ccc None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:09.830235 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b85e2c4-0cb7-43c1-9de3-3d471b38cb5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:09.830758 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b85e2c4-0cb7-43c1-9de3-3d471b38cb5f None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:09.831036 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b85e2c4-0cb7-43c1-9de3-3d471b38cb5f None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:09.831309 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b85e2c4-0cb7-43c1-9de3-3d471b38cb5f None admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:09.832069 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b85e2c4-0cb7-43c1-9de3-3d471b38cb5f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:51:09.832381 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b85e2c4-0cb7-43c1-9de3-3d471b38cb5f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:09.833830 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b85e2c4-0cb7-43c1-9de3-3d471b38cb5f None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:09.852193 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 548/1067] 10.222.0.15 () {56 vars in 1133 bytes} [Thu Aug 18 10:51:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:51:09.857816 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2be54f-661b-4be0-b9a2-25d7dd605f2b None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:09.928389 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:09.967293 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2be54f-661b-4be0-b9a2-25d7dd605f2b None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:10.002034 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79916c2d-576f-4e14-92c6-1c61ac072250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:10.002688 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79916c2d-576f-4e14-92c6-1c61ac072250 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:10.002923 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79916c2d-576f-4e14-92c6-1c61ac072250 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:10.003198 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79916c2d-576f-4e14-92c6-1c61ac072250 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:10.014976 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79916c2d-576f-4e14-92c6-1c61ac072250 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:10.016421 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79916c2d-576f-4e14-92c6-1c61ac072250 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:10.031062 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-79916c2d-576f-4e14-92c6-1c61ac072250 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:51:10.031062 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:51:10.031062 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:51:10.031062 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:51:10.031062 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:51:10.031062 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:51:10.031062 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:51:10.031062 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:51:10.031062 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:51:10.031062 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:51:10.031062 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:51:10.031062 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:51:10.031062 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 10:51:10.031062 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 10:51:10.031062 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 10:51:10.031062 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 10:51:10.032069 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:51:10.032069 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:51:10.032069 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:51:10.032069 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:51:10.032069 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:51:10.032069 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:51:10.032069 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:51:10.032069 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:51:10.032069 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:51:10.032069 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:51:10.032069 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:51:10.032069 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:51:10.032069 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:51:10.032069 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:51:10.032069 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:51:10.032069 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:51:10.032069 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 10:51:10.032982 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 10:51:10.032982 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:51:10.032982 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:51:10.037149 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 520/1068] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:51:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:51:10.038633 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b85e2c4-0cb7-43c1-9de3-3d471b38cb5f None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:10.111294 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c535f70-26d9-42cb-9e69-2ba1d39b2de8 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:10.111578 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c535f70-26d9-42cb-9e69-2ba1d39b2de8 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:10.111848 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c535f70-26d9-42cb-9e69-2ba1d39b2de8 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:10.113194 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 521/1069] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:51:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 10:51:10.119294 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463962d2-7723-4e8b-9407-9a4839dae97a None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:10.119588 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463962d2-7723-4e8b-9407-9a4839dae97a None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:10.119851 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463962d2-7723-4e8b-9407-9a4839dae97a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:10.140093 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-463962d2-7723-4e8b-9407-9a4839dae97a None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:51:10.141278 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-463962d2-7723-4e8b-9407-9a4839dae97a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:51:10.148674 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b85e2c4-0cb7-43c1-9de3-3d471b38cb5f None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:10.180623 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:10.186886 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e9842-fd06-4a89-808a-3b9eaa3314f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:10.187925 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e9842-fd06-4a89-808a-3b9eaa3314f5 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:10.188207 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e9842-fd06-4a89-808a-3b9eaa3314f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:10.188486 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e9842-fd06-4a89-808a-3b9eaa3314f5 None admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:10.189128 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98e9842-fd06-4a89-808a-3b9eaa3314f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:51:10.189429 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98e9842-fd06-4a89-808a-3b9eaa3314f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:10.191203 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98e9842-fd06-4a89-808a-3b9eaa3314f5 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:10.211921 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 549/1070] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 18 10:51:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 10:51:10.213490 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e9842-fd06-4a89-808a-3b9eaa3314f5 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:10.221425 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 522/1071] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:51:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 10:51:10.279299 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3356ff52-b639-4edf-850d-bb5530f67841 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:10.279620 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3356ff52-b639-4edf-850d-bb5530f67841 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:10.279870 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3356ff52-b639-4edf-850d-bb5530f67841 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:10.282253 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 523/1072] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:51:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 10:51:10.287542 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea5312a-e2c7-433b-bc31-effcb85ea824 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:10.288057 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea5312a-e2c7-433b-bc31-effcb85ea824 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:10.288360 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea5312a-e2c7-433b-bc31-effcb85ea824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:10.307032 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-4ea5312a-e2c7-433b-bc31-effcb85ea824 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:51:10.308239 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-4ea5312a-e2c7-433b-bc31-effcb85ea824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:51:10.324906 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e9842-fd06-4a89-808a-3b9eaa3314f5 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:10.359231 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:10.363409 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa72408-2237-4c9b-a191-08a0d05f4905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:10.364035 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa72408-2237-4c9b-a191-08a0d05f4905 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:10.364316 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa72408-2237-4c9b-a191-08a0d05f4905 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:10.364583 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa72408-2237-4c9b-a191-08a0d05f4905 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:10.372684 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa72408-2237-4c9b-a191-08a0d05f4905 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:10.374147 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa72408-2237-4c9b-a191-08a0d05f4905 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:10.385069 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-caa72408-2237-4c9b-a191-08a0d05f4905 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 10:51:10.385069 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:51:10.385069 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:51:10.385069 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:51:10.385069 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:51:10.385069 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:51:10.385069 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:51:10.385069 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:51:10.385069 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:51:10.385069 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:51:10.385069 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:51:10.385069 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:51:10.385069 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 10:51:10.385069 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 10:51:10.385069 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 10:51:10.386201 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 10:51:10.386201 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:51:10.386201 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:51:10.386201 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:51:10.386201 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:51:10.386201 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:51:10.386201 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:51:10.386201 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:51:10.386201 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:51:10.386201 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:51:10.386201 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:51:10.386201 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:51:10.386201 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:51:10.386201 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:51:10.386201 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:51:10.386201 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:51:10.386201 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:51:10.387125 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 10:51:10.387125 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 10:51:10.387125 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 10:51:10.387125 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 10:51:10.387125 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 10:51:10.387125 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 10:51:10.387125 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 10:51:10.387125 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:51:10.387125 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 550/1073] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 18 10:51:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:51:10.389389 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 524/1074] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:51:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 10:51:10.394659 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa72408-2237-4c9b-a191-08a0d05f4905 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:10.451300 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:10.500471 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea5312a-e2c7-433b-bc31-effcb85ea824 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:10.503550 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa72408-2237-4c9b-a191-08a0d05f4905 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:10.542783 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc948b08-98c5-4743-bae4-4e7ef26f6467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:10.543390 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc948b08-98c5-4743-bae4-4e7ef26f6467 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:10.543674 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc948b08-98c5-4743-bae4-4e7ef26f6467 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:10.543950 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc948b08-98c5-4743-bae4-4e7ef26f6467 None admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:10.544652 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc948b08-98c5-4743-bae4-4e7ef26f6467 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:51:10.544956 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc948b08-98c5-4743-bae4-4e7ef26f6467 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:10.546425 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc948b08-98c5-4743-bae4-4e7ef26f6467 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:10.559932 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 551/1075] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Aug 18 10:51:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 10:51:10.565736 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc948b08-98c5-4743-bae4-4e7ef26f6467 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:10.614259 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea5312a-e2c7-433b-bc31-effcb85ea824 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:10.652775 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc059c6-0a4b-4466-99e0-167b92d15d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:10.653758 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc059c6-0a4b-4466-99e0-167b92d15d66 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:10.654038 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc059c6-0a4b-4466-99e0-167b92d15d66 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:10.654313 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc059c6-0a4b-4466-99e0-167b92d15d66 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:10.665104 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc059c6-0a4b-4466-99e0-167b92d15d66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:51:10.669880 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-4bc059c6-0a4b-4466-99e0-167b92d15d66 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 10:51:10.669880 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:51:10.669880 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:51:10.669880 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:51:10.669880 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:51:10.669880 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:51:10.669880 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:51:10.669880 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:51:10.669880 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:51:10.669880 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:51:10.669880 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:51:10.669880 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:51:10.669880 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:51:10.669880 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:51:10.669880 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:51:10.669880 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:51:10.671020 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:51:10.671020 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:51:10.671020 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:51:10.671020 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:51:10.671020 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:51:10.671020 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:51:10.671020 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:51:10.671020 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:51:10.671020 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:51:10.671020 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:51:10.671020 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:51:10.671020 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:51:10.671020 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:51:10.671020 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:51:10.671020 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:51:10.671020 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:51:10.672211 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:51:10.672211 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:51:10.672211 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:51:10.672211 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:51:10.672211 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:51:10.672211 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:51:10.672211 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:51:10.672211 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:51:10.672211 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:51:10.672211 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:51:10.672211 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 10:51:10.672211 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:51:10.672211 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 525/1076] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Aug 18 10:51:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:51:10.672211 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc059c6-0a4b-4466-99e0-167b92d15d66 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:10.676951 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc948b08-98c5-4743-bae4-4e7ef26f6467 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:10.690779 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:10.716503 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755d5712-ab46-461e-a776-448df793ac8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:10.717071 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d5712-ab46-461e-a776-448df793ac8c None admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:10.717344 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d5712-ab46-461e-a776-448df793ac8c None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:10.721668 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d5712-ab46-461e-a776-448df793ac8c None admin] PATH_INFO: `/v3/projects/1575e8ebaaab4650995841659b6e631b/users/a005d8f0c46d44c7b6f2201a54717b12/roles/3e108171f00d4bff8db5c27b4446c417` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:10.723376 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755d5712-ab46-461e-a776-448df793ac8c None admin] RBAC: Authorizing `identity:create_grant(project_id=1575e8ebaaab4650995841659b6e631b, user_id=a005d8f0c46d44c7b6f2201a54717b12, role_id=3e108171f00d4bff8db5c27b4446c417)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:10.723865 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:10.724882 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755d5712-ab46-461e-a776-448df793ac8c None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:10.738801 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 552/1077] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Aug 18 10:51:10 2022] PUT /identity/v3/projects/1575e8ebaaab4650995841659b6e631b/users/a005d8f0c46d44c7b6f2201a54717b12/roles/3e108171f00d4bff8db5c27b4446c417 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 10:51:10.739382 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755d5712-ab46-461e-a776-448df793ac8c None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:10.801334 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc059c6-0a4b-4466-99e0-167b92d15d66 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:10.843596 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2b509b-cf49-4af5-86d7-a3ebeb88ac57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:10.844213 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b509b-cf49-4af5-86d7-a3ebeb88ac57 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:10.844546 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b509b-cf49-4af5-86d7-a3ebeb88ac57 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:10.844815 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b509b-cf49-4af5-86d7-a3ebeb88ac57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:10.858623 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755d5712-ab46-461e-a776-448df793ac8c None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:10.903012 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ce4d4d-9f71-4faa-a4a7-59dd90220eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:10.903617 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ce4d4d-9f71-4faa-a4a7-59dd90220eac None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:10.903894 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ce4d4d-9f71-4faa-a4a7-59dd90220eac None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:10.904167 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ce4d4d-9f71-4faa-a4a7-59dd90220eac None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:10.904838 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ce4d4d-9f71-4faa-a4a7-59dd90220eac None admin] RBAC: Adding query filter params (name=admin) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:51:10.905139 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ce4d4d-9f71-4faa-a4a7-59dd90220eac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:10.906536 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ce4d4d-9f71-4faa-a4a7-59dd90220eac None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:10.918872 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 553/1078] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 18 10:51:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:51:10.924355 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ce4d4d-9f71-4faa-a4a7-59dd90220eac None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:10.926272 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2b509b-cf49-4af5-86d7-a3ebeb88ac57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:10.928280 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2b509b-cf49-4af5-86d7-a3ebeb88ac57 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:10.961334 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:10.971546 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:11.040922 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 526/1079] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 18 10:51:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 10:51:11.045677 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ce4d4d-9f71-4faa-a4a7-59dd90220eac None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:11.046480 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2b509b-cf49-4af5-86d7-a3ebeb88ac57 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:11.084115 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d020ce0-3400-4593-b796-c911a6b605ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:11.084743 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d020ce0-3400-4593-b796-c911a6b605ee None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:11.085210 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d020ce0-3400-4593-b796-c911a6b605ee None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:11.085488 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d020ce0-3400-4593-b796-c911a6b605ee None admin] PATH_INFO: `/v3/users/28dbf588c17b43fab1ce6b60dc8c5ab7` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:11.086678 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d020ce0-3400-4593-b796-c911a6b605ee None admin] RBAC: Authorizing `identity:get_user(user_id=28dbf588c17b43fab1ce6b60dc8c5ab7)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:11.088100 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d020ce0-3400-4593-b796-c911a6b605ee None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:11.089726 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 554/1080] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Aug 18 10:51:10 2022] GET /identity/v3/users/28dbf588c17b43fab1ce6b60dc8c5ab7 => generated 285 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 10:51:11.095615 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d020ce0-3400-4593-b796-c911a6b605ee None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:11.165280 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2b509b-cf49-4af5-86d7-a3ebeb88ac57 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:11.206066 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f53bfb-ab16-48a5-a54e-f97321639284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:11.206721 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f53bfb-ab16-48a5-a54e-f97321639284 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:11.207004 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f53bfb-ab16-48a5-a54e-f97321639284 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:11.207279 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f53bfb-ab16-48a5-a54e-f97321639284 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:11.212117 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d020ce0-3400-4593-b796-c911a6b605ee None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:11.214098 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:11.218123 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:11.226672 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f53bfb-ab16-48a5-a54e-f97321639284 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:11.229328 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f53bfb-ab16-48a5-a54e-f97321639284 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:11.248763 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-14f53bfb-ab16-48a5-a54e-f97321639284 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:51:11.248763 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:51:11.248763 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:51:11.248763 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:51:11.248763 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:51:11.248763 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:51:11.248763 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:51:11.248763 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:51:11.248763 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:51:11.248763 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:51:11.248763 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:51:11.248763 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:51:11.248763 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 10:51:11.248763 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 10:51:11.248763 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 10:51:11.248763 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 10:51:11.249893 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:51:11.249893 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:51:11.249893 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:51:11.249893 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:51:11.249893 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:51:11.249893 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:51:11.249893 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:51:11.249893 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:51:11.249893 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:51:11.249893 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:51:11.249893 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:51:11.249893 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:51:11.249893 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:51:11.249893 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:51:11.249893 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:51:11.249893 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:51:11.249893 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 10:51:11.250762 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 10:51:11.250762 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:51:11.250762 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:51:11.250762 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 527/1081] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:51:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 10:51:11.256451 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df703a3-dd32-492d-bcc9-8e3a09bde977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:11.257342 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f53bfb-ab16-48a5-a54e-f97321639284 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:11.257558 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df703a3-dd32-492d-bcc9-8e3a09bde977 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:11.257813 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df703a3-dd32-492d-bcc9-8e3a09bde977 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:11.258088 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df703a3-dd32-492d-bcc9-8e3a09bde977 None admin] PATH_INFO: `/v3/projects/909295b933f3490daa022ddd278d626f` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:11.259235 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df703a3-dd32-492d-bcc9-8e3a09bde977 None admin] RBAC: Authorizing `identity:get_project(project_id=909295b933f3490daa022ddd278d626f)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:11.260935 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df703a3-dd32-492d-bcc9-8e3a09bde977 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:11.263303 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 555/1082] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 18 10:51:11 2022] GET /identity/v3/projects/909295b933f3490daa022ddd278d626f => generated 311 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:51:11.269200 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df703a3-dd32-492d-bcc9-8e3a09bde977 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:11.374495 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df703a3-dd32-492d-bcc9-8e3a09bde977 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:11.378929 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f53bfb-ab16-48a5-a54e-f97321639284 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:11.411721 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2e9430-e750-4648-ab4b-985e9e2be5a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:11.413031 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e9430-e750-4648-ab4b-985e9e2be5a3 None admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:11.413333 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e9430-e750-4648-ab4b-985e9e2be5a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:11.413622 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e9430-e750-4648-ab4b-985e9e2be5a3 None admin] PATH_INFO: `/v3/projects/909295b933f3490daa022ddd278d626f/users/28dbf588c17b43fab1ce6b60dc8c5ab7/roles/127fdc7ef05b4e0b98a940b334e5fcab` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:11.415618 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2e9430-e750-4648-ab4b-985e9e2be5a3 None admin] RBAC: Authorizing `identity:create_grant(project_id=909295b933f3490daa022ddd278d626f, user_id=28dbf588c17b43fab1ce6b60dc8c5ab7, role_id=127fdc7ef05b4e0b98a940b334e5fcab)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:11.417049 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2e9430-e750-4648-ab4b-985e9e2be5a3 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:11.422392 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a45a63-e019-47aa-a1fe-cf8d5e8ac46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:11.423373 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a45a63-e019-47aa-a1fe-cf8d5e8ac46f None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:11.423651 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a45a63-e019-47aa-a1fe-cf8d5e8ac46f None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:11.424013 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a45a63-e019-47aa-a1fe-cf8d5e8ac46f None admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:11.424687 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a45a63-e019-47aa-a1fe-cf8d5e8ac46f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:51:11.424983 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a45a63-e019-47aa-a1fe-cf8d5e8ac46f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:11.426527 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a45a63-e019-47aa-a1fe-cf8d5e8ac46f None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:11.435586 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 556/1083] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Aug 18 10:51:11 2022] PUT /identity/v3/projects/909295b933f3490daa022ddd278d626f/users/28dbf588c17b43fab1ce6b60dc8c5ab7/roles/127fdc7ef05b4e0b98a940b334e5fcab => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 10:51:11.446209 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 528/1084] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 18 10:51:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:51:12.746153 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc7357-5344-4898-9cb6-159b93fcaf94 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:12.746701 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc7357-5344-4898-9cb6-159b93fcaf94 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:12.746701 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc7357-5344-4898-9cb6-159b93fcaf94 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:12.748040 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 557/1085] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:51:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:51:12.753332 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e80e8-f158-40ee-b789-c652f9b8f7ec None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:12.753781 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e80e8-f158-40ee-b789-c652f9b8f7ec None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:12.753930 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e80e8-f158-40ee-b789-c652f9b8f7ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:12.773917 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-528e80e8-f158-40ee-b789-c652f9b8f7ec None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:51:12.775116 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-528e80e8-f158-40ee-b789-c652f9b8f7ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:51:12.829466 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:12.852715 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 529/1086] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:51:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 10:51:13.135659 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcc7357-5344-4898-9cb6-159b93fcaf94 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:13.166599 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:13.243636 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcc7357-5344-4898-9cb6-159b93fcaf94 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:13.278392 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0dc110-9412-411f-81e6-3b0230dbafee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:13.279017 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0dc110-9412-411f-81e6-3b0230dbafee None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:13.279323 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0dc110-9412-411f-81e6-3b0230dbafee None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:13.279598 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0dc110-9412-411f-81e6-3b0230dbafee None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:13.290658 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0dc110-9412-411f-81e6-3b0230dbafee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:51:13.295398 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-8b0dc110-9412-411f-81e6-3b0230dbafee None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 10:51:13.295398 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:51:13.295398 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:51:13.295398 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:51:13.295398 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:51:13.295398 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:51:13.295398 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:51:13.295398 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:51:13.295398 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:51:13.295398 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:51:13.295398 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:51:13.295398 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:51:13.295398 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:51:13.295398 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:51:13.295398 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:51:13.295398 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:51:13.296507 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:51:13.296507 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:51:13.296507 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:51:13.296507 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:51:13.296507 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:51:13.296507 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:51:13.296507 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:51:13.296507 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:51:13.296507 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:51:13.296507 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:51:13.296507 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:51:13.296507 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:51:13.296507 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:51:13.296507 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:51:13.296507 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:51:13.296507 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:51:13.297561 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:51:13.297561 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:51:13.297561 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:51:13.297561 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:51:13.297561 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:51:13.297561 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:51:13.297561 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:51:13.297561 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:51:13.297561 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:51:13.297561 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:51:13.297561 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 10:51:13.297561 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:51:13.301494 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 558/1087] 10.222.0.15 () {56 vars in 1120 bytes} [Thu Aug 18 10:51:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:51:13.302525 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528e80e8-f158-40ee-b789-c652f9b8f7ec None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:13.381020 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee70e0e-2711-48ec-8a78-995522f60807 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:13.381546 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee70e0e-2711-48ec-8a78-995522f60807 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:13.381953 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee70e0e-2711-48ec-8a78-995522f60807 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:13.383306 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 559/1088] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:51:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 10:51:13.388704 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d2583-9ee1-47fe-8dc6-9db35396730d None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:13.388895 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d2583-9ee1-47fe-8dc6-9db35396730d None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:13.389147 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d2583-9ee1-47fe-8dc6-9db35396730d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:13.407005 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528e80e8-f158-40ee-b789-c652f9b8f7ec None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:13.407193 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-4b0d2583-9ee1-47fe-8dc6-9db35396730d None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:51:13.408202 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-4b0d2583-9ee1-47fe-8dc6-9db35396730d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:51:13.441996 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6494c624-a79b-4039-a250-56df48efdbee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:13.442847 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6494c624-a79b-4039-a250-56df48efdbee None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:13.443125 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6494c624-a79b-4039-a250-56df48efdbee None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:13.443540 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6494c624-a79b-4039-a250-56df48efdbee None admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:13.444365 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6494c624-a79b-4039-a250-56df48efdbee None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:51:13.444668 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6494c624-a79b-4039-a250-56df48efdbee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:13.446072 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6494c624-a79b-4039-a250-56df48efdbee None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:13.454322 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 530/1089] 10.222.0.15 () {56 vars in 1115 bytes} [Thu Aug 18 10:51:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:51:13.459940 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6494c624-a79b-4039-a250-56df48efdbee None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:13.480492 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 560/1090] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:51:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 10:51:13.504886 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:13.562216 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6494c624-a79b-4039-a250-56df48efdbee None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:13.595173 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1b6515-f251-4399-b3b5-e9f5e85f8eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:13.595799 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b6515-f251-4399-b3b5-e9f5e85f8eb0 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:13.596076 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b6515-f251-4399-b3b5-e9f5e85f8eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:13.596350 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b6515-f251-4399-b3b5-e9f5e85f8eb0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:13.607266 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1b6515-f251-4399-b3b5-e9f5e85f8eb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:13.608701 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1b6515-f251-4399-b3b5-e9f5e85f8eb0 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:13.623252 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-9a1b6515-f251-4399-b3b5-e9f5e85f8eb0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:51:13.623252 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:51:13.623252 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:51:13.623252 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:51:13.623252 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:51:13.623252 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:51:13.623252 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:51:13.623252 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:51:13.623252 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:51:13.623252 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:51:13.623252 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:51:13.623252 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:51:13.623252 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 10:51:13.623252 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 10:51:13.623252 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 10:51:13.623252 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 10:51:13.624389 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:51:13.624389 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:51:13.624389 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:51:13.624389 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:51:13.624389 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:51:13.624389 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:51:13.624389 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:51:13.624389 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:51:13.624389 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:51:13.624389 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:51:13.624389 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:51:13.624389 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:51:13.624389 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:51:13.624389 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:51:13.624389 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:51:13.624389 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:51:13.624389 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 10:51:13.625282 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 10:51:13.625282 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:51:13.625282 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:51:13.625282 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 531/1091] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:51:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 10:51:13.630334 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0d2583-9ee1-47fe-8dc6-9db35396730d None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:13.652129 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:13.732229 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0d2583-9ee1-47fe-8dc6-9db35396730d None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:13.751709 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1b6515-f251-4399-b3b5-e9f5e85f8eb0 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:13.766099 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad51218-f5dc-4dff-a1e2-6605febb53ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:13.766719 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad51218-f5dc-4dff-a1e2-6605febb53ea None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:13.766996 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad51218-f5dc-4dff-a1e2-6605febb53ea None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:13.767267 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad51218-f5dc-4dff-a1e2-6605febb53ea None admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:13.767912 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad51218-f5dc-4dff-a1e2-6605febb53ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:51:13.768213 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad51218-f5dc-4dff-a1e2-6605febb53ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:13.769592 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad51218-f5dc-4dff-a1e2-6605febb53ea None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:13.784156 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 561/1092] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 18 10:51:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:51:13.795372 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad51218-f5dc-4dff-a1e2-6605febb53ea None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:13.856708 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:13.864434 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1b6515-f251-4399-b3b5-e9f5e85f8eb0 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:13.881254 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:13.902317 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad51218-f5dc-4dff-a1e2-6605febb53ea None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:13.905174 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29bd7c6-a0ec-4d88-ba85-ca6271bea2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:13.905851 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29bd7c6-a0ec-4d88-ba85-ca6271bea2fa None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:13.906134 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29bd7c6-a0ec-4d88-ba85-ca6271bea2fa None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:13.906408 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29bd7c6-a0ec-4d88-ba85-ca6271bea2fa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:13.918346 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29bd7c6-a0ec-4d88-ba85-ca6271bea2fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:51:13.923042 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-b29bd7c6-a0ec-4d88-ba85-ca6271bea2fa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 10:51:13.923042 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:51:13.923042 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:51:13.923042 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:51:13.923042 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:51:13.923042 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:51:13.923042 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:51:13.923042 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:51:13.923042 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:51:13.923042 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:51:13.923042 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:51:13.923042 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:51:13.923042 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:51:13.923042 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:51:13.923042 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:51:13.923042 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:51:13.924051 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:51:13.924051 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:51:13.924051 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:51:13.924051 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:51:13.924051 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:51:13.924051 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:51:13.924051 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:51:13.924051 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:51:13.924051 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:51:13.924051 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:51:13.924051 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:51:13.924051 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:51:13.924051 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:51:13.924051 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:51:13.924051 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:51:13.924051 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:51:13.924962 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:51:13.924962 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:51:13.924962 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:51:13.924962 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:51:13.924962 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:51:13.924962 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:51:13.924962 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:51:13.924962 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:51:13.924962 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:51:13.924962 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:51:13.924962 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 10:51:13.924962 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:51:13.924962 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 532/1093] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Aug 18 10:51:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 10:51:13.930391 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29bd7c6-a0ec-4d88-ba85-ca6271bea2fa None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:13.937649 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb7f65c-3a12-4c83-9294-88636c1191b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:13.938277 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb7f65c-3a12-4c83-9294-88636c1191b3 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:13.938553 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb7f65c-3a12-4c83-9294-88636c1191b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:13.938822 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb7f65c-3a12-4c83-9294-88636c1191b3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:13.946530 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb7f65c-3a12-4c83-9294-88636c1191b3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:13.947950 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb7f65c-3a12-4c83-9294-88636c1191b3 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:13.959464 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-8fb7f65c-3a12-4c83-9294-88636c1191b3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 10:51:13.959464 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:51:13.959464 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:51:13.959464 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:51:13.959464 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:51:13.959464 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:51:13.959464 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:51:13.959464 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:51:13.959464 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:51:13.959464 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:51:13.959464 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:51:13.959464 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:51:13.959464 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 10:51:13.959464 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 10:51:13.959464 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 10:51:13.959464 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 10:51:13.960656 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:51:13.960656 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:51:13.960656 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 10:51:13.960656 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 10:51:13.960656 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 10:51:13.960656 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 10:51:13.960656 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:51:13.960656 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:51:13.960656 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:51:13.960656 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:51:13.960656 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:51:13.960656 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:51:13.960656 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:51:13.960656 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:51:13.960656 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:51:13.960656 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:51:13.960656 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:51:13.960656 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:51:13.961850 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:51:13.961850 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:51:13.961850 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 10:51:13.961850 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 10:51:13.961850 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 10:51:13.961850 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 10:51:13.961850 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 10:51:13.961850 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 10:51:13.961850 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 10:51:13.961850 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:51:13.961850 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 562/1094] 10.222.0.15 () {56 vars in 1093 bytes} [Thu Aug 18 10:51:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 10:51:13.967400 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb7f65c-3a12-4c83-9294-88636c1191b3 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:14.035531 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29bd7c6-a0ec-4d88-ba85-ca6271bea2fa None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:14.070748 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb7f65c-3a12-4c83-9294-88636c1191b3 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:14.070994 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0d4ac3-675b-4053-9dd7-2662610ddf44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:14.071696 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0d4ac3-675b-4053-9dd7-2662610ddf44 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:14.072025 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0d4ac3-675b-4053-9dd7-2662610ddf44 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:14.072301 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0d4ac3-675b-4053-9dd7-2662610ddf44 None admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:14.072964 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0d4ac3-675b-4053-9dd7-2662610ddf44 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:51:14.073261 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0d4ac3-675b-4053-9dd7-2662610ddf44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:14.074647 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0d4ac3-675b-4053-9dd7-2662610ddf44 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:14.083942 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 533/1095] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 18 10:51:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 10:51:14.091056 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0d4ac3-675b-4053-9dd7-2662610ddf44 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:14.104960 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886dcdd6-f958-4730-b816-c9e66ff8fe97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:14.105591 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886dcdd6-f958-4730-b816-c9e66ff8fe97 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:14.105865 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886dcdd6-f958-4730-b816-c9e66ff8fe97 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:14.106130 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886dcdd6-f958-4730-b816-c9e66ff8fe97 None admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:14.106851 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886dcdd6-f958-4730-b816-c9e66ff8fe97 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:51:14.107163 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886dcdd6-f958-4730-b816-c9e66ff8fe97 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:14.108569 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886dcdd6-f958-4730-b816-c9e66ff8fe97 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:14.109136 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:14.123609 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:14.129365 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 563/1096] 10.222.0.15 () {56 vars in 1133 bytes} [Thu Aug 18 10:51:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 10:51:14.137259 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886dcdd6-f958-4730-b816-c9e66ff8fe97 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:14.200565 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0d4ac3-675b-4053-9dd7-2662610ddf44 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:14.237027 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e67d4a-4c66-4d34-8cb8-2d64e94bde0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:14.237691 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e67d4a-4c66-4d34-8cb8-2d64e94bde0f None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:14.237970 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e67d4a-4c66-4d34-8cb8-2d64e94bde0f None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:14.238240 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e67d4a-4c66-4d34-8cb8-2d64e94bde0f None admin] PATH_INFO: `/v3/users/28dbf588c17b43fab1ce6b60dc8c5ab7` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:14.239369 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e67d4a-4c66-4d34-8cb8-2d64e94bde0f None admin] RBAC: Authorizing `identity:get_user(user_id=28dbf588c17b43fab1ce6b60dc8c5ab7)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:14.241069 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e67d4a-4c66-4d34-8cb8-2d64e94bde0f None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:14.242703 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 534/1097] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Aug 18 10:51:14 2022] GET /identity/v3/users/28dbf588c17b43fab1ce6b60dc8c5ab7 => generated 285 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 10:51:14.248413 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e67d4a-4c66-4d34-8cb8-2d64e94bde0f None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:14.254120 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886dcdd6-f958-4730-b816-c9e66ff8fe97 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:14.289851 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf5a0d-e40b-421a-b01d-afbb7231aaf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:14.290448 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf5a0d-e40b-421a-b01d-afbb7231aaf0 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:14.290722 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf5a0d-e40b-421a-b01d-afbb7231aaf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:14.290991 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf5a0d-e40b-421a-b01d-afbb7231aaf0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:14.336493 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:14.353481 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e67d4a-4c66-4d34-8cb8-2d64e94bde0f None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:14.356771 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:14.360185 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaf5a0d-e40b-421a-b01d-afbb7231aaf0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:14.361970 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaf5a0d-e40b-421a-b01d-afbb7231aaf0 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:14.390070 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4aa819-464c-4a5e-9b41-02ddcc5ada14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:14.390854 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4aa819-464c-4a5e-9b41-02ddcc5ada14 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:14.391221 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4aa819-464c-4a5e-9b41-02ddcc5ada14 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:14.391672 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4aa819-464c-4a5e-9b41-02ddcc5ada14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:14.460537 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 564/1098] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 18 10:51:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 10:51:14.463682 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4aa819-464c-4a5e-9b41-02ddcc5ada14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:14.465346 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4aa819-464c-4a5e-9b41-02ddcc5ada14 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:14.466252 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf5a0d-e40b-421a-b01d-afbb7231aaf0 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:14.567340 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:14.572705 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:14.576528 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf5a0d-e40b-421a-b01d-afbb7231aaf0 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:14.585858 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 535/1099] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 18 10:51:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 18 10:51:14.591889 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4aa819-464c-4a5e-9b41-02ddcc5ada14 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:14.613985 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30be50b0-9a73-47d0-aced-6ba41089a9e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:14.614610 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be50b0-9a73-47d0-aced-6ba41089a9e9 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:14.614883 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be50b0-9a73-47d0-aced-6ba41089a9e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:14.615187 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be50b0-9a73-47d0-aced-6ba41089a9e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:14.625604 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30be50b0-9a73-47d0-aced-6ba41089a9e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:14.627283 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30be50b0-9a73-47d0-aced-6ba41089a9e9 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:14.642718 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-30be50b0-9a73-47d0-aced-6ba41089a9e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:51:14.642718 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:51:14.642718 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:51:14.642718 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:51:14.642718 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:51:14.642718 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:51:14.642718 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:51:14.642718 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:51:14.642718 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:51:14.642718 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:51:14.642718 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:51:14.642718 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:51:14.642718 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 10:51:14.642718 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 10:51:14.642718 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 10:51:14.642718 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 10:51:14.643704 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:51:14.643704 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:51:14.643704 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:51:14.643704 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:51:14.643704 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:51:14.643704 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:51:14.643704 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:51:14.643704 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:51:14.643704 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:51:14.643704 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:51:14.643704 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:51:14.643704 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:51:14.643704 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:51:14.643704 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:51:14.643704 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:51:14.643704 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:51:14.643704 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 10:51:14.644601 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 10:51:14.644601 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:51:14.644601 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:51:14.644601 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 565/1100] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:51:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 10:51:14.650570 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30be50b0-9a73-47d0-aced-6ba41089a9e9 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:14.705543 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4aa819-464c-4a5e-9b41-02ddcc5ada14 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:14.739466 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bd9511-eace-4200-a4b8-4396863b0508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:14.740601 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd9511-eace-4200-a4b8-4396863b0508 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:14.740880 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd9511-eace-4200-a4b8-4396863b0508 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:14.741152 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd9511-eace-4200-a4b8-4396863b0508 None admin] PATH_INFO: `/v3/projects/909295b933f3490daa022ddd278d626f` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:14.742306 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bd9511-eace-4200-a4b8-4396863b0508 None admin] RBAC: Authorizing `identity:get_project(project_id=909295b933f3490daa022ddd278d626f)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:14.743732 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bd9511-eace-4200-a4b8-4396863b0508 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:14.745357 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 536/1101] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 18 10:51:14 2022] GET /identity/v3/projects/909295b933f3490daa022ddd278d626f => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 10:51:14.751376 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bd9511-eace-4200-a4b8-4396863b0508 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:14.760149 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30be50b0-9a73-47d0-aced-6ba41089a9e9 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:14.794865 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a894dfbe-7ee2-413f-b478-3add2043f5df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:14.795534 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a894dfbe-7ee2-413f-b478-3add2043f5df None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:14.795740 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a894dfbe-7ee2-413f-b478-3add2043f5df None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:14.796018 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a894dfbe-7ee2-413f-b478-3add2043f5df None admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:14.796657 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a894dfbe-7ee2-413f-b478-3add2043f5df None admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:51:14.796965 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a894dfbe-7ee2-413f-b478-3add2043f5df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:14.798364 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a894dfbe-7ee2-413f-b478-3add2043f5df None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:14.805755 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:14.811323 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 566/1102] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 18 10:51:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 10:51:14.818100 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a894dfbe-7ee2-413f-b478-3add2043f5df None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:14.831365 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:14.855650 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bd9511-eace-4200-a4b8-4396863b0508 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:14.890755 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2095fdbb-89ea-4ece-9774-6db755c70806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:14.891394 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2095fdbb-89ea-4ece-9774-6db755c70806 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:14.891623 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2095fdbb-89ea-4ece-9774-6db755c70806 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:14.891889 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2095fdbb-89ea-4ece-9774-6db755c70806 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:14.892615 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2095fdbb-89ea-4ece-9774-6db755c70806 None admin] RBAC: Adding query filter params (role.id=127fdc7ef05b4e0b98a940b334e5fcab, scope.project.id=909295b933f3490daa022ddd278d626f, user.id=28dbf588c17b43fab1ce6b60dc8c5ab7) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:51:14.892916 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2095fdbb-89ea-4ece-9774-6db755c70806 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:14.894387 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2095fdbb-89ea-4ece-9774-6db755c70806 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:14.903063 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 537/1103] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Aug 18 10:51:14 2022] GET /identity/v3/role_assignments?user.id=28dbf588c17b43fab1ce6b60dc8c5ab7&scope.project.id=909295b933f3490daa022ddd278d626f&role.id=127fdc7ef05b4e0b98a940b334e5fcab => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 10:51:14.927700 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a894dfbe-7ee2-413f-b478-3add2043f5df None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:14.969031 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7043802f-257c-4359-8ebb-88d239367d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:14.969709 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7043802f-257c-4359-8ebb-88d239367d78 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:14.969985 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7043802f-257c-4359-8ebb-88d239367d78 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:14.970251 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7043802f-257c-4359-8ebb-88d239367d78 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:14.977743 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7043802f-257c-4359-8ebb-88d239367d78 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:14.979204 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7043802f-257c-4359-8ebb-88d239367d78 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:14.991216 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-7043802f-257c-4359-8ebb-88d239367d78 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 10:51:14.991216 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:51:14.991216 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:51:14.991216 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:51:14.991216 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:51:14.991216 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:51:14.991216 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:51:14.991216 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:51:14.991216 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:51:14.991216 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:51:14.991216 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:51:14.991216 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:51:14.991216 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 10:51:14.991216 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 10:51:14.991216 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 10:51:14.992300 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 10:51:14.992300 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:51:14.992300 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:51:14.992300 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:51:14.992300 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:51:14.992300 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:51:14.992300 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:51:14.992300 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:51:14.992300 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:51:14.992300 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:51:14.992300 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:51:14.992300 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:51:14.992300 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:51:14.992300 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:51:14.992300 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:51:14.992300 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:51:14.992300 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:51:14.993545 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 10:51:14.993545 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 10:51:14.993545 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 10:51:14.993545 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 10:51:14.993545 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 10:51:14.993545 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 10:51:14.993545 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 10:51:14.993545 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:51:14.993545 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 567/1104] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 18 10:51:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:51:14.998434 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2095fdbb-89ea-4ece-9774-6db755c70806 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:15.104920 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2095fdbb-89ea-4ece-9774-6db755c70806 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:15.122807 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:15.141508 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7232180f-1438-43a1-b8fc-d93171a5647f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:15.142128 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232180f-1438-43a1-b8fc-d93171a5647f None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:15.142402 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232180f-1438-43a1-b8fc-d93171a5647f None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:15.142670 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232180f-1438-43a1-b8fc-d93171a5647f None admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:15.143349 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7232180f-1438-43a1-b8fc-d93171a5647f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:51:15.143649 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7232180f-1438-43a1-b8fc-d93171a5647f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:15.145069 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7232180f-1438-43a1-b8fc-d93171a5647f None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:15.158192 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 538/1105] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Aug 18 10:51:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 10:51:15.165049 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7043802f-257c-4359-8ebb-88d239367d78 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:15.240021 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:15.272563 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7043802f-257c-4359-8ebb-88d239367d78 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:15.309022 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f5ff2e-3526-416b-8af9-00f75d23c2f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:15.311500 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f5ff2e-3526-416b-8af9-00f75d23c2f8 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:15.311792 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f5ff2e-3526-416b-8af9-00f75d23c2f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:15.312069 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f5ff2e-3526-416b-8af9-00f75d23c2f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:15.312803 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f5ff2e-3526-416b-8af9-00f75d23c2f8 None admin] RBAC: Adding query filter params (role.id=3e108171f00d4bff8db5c27b4446c417, scope.project.id=1575e8ebaaab4650995841659b6e631b, user.id=a005d8f0c46d44c7b6f2201a54717b12) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:51:15.313111 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f5ff2e-3526-416b-8af9-00f75d23c2f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:15.314562 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f5ff2e-3526-416b-8af9-00f75d23c2f8 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:15.321840 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 568/1106] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Aug 18 10:51:15 2022] GET /identity/v3/role_assignments?user.id=a005d8f0c46d44c7b6f2201a54717b12&scope.project.id=1575e8ebaaab4650995841659b6e631b&role.id=3e108171f00d4bff8db5c27b4446c417 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:51:16.839989 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75806c-0121-4651-9b55-47ec20b3ec19 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:16.840516 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75806c-0121-4651-9b55-47ec20b3ec19 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:16.840627 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75806c-0121-4651-9b55-47ec20b3ec19 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:16.842040 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 539/1107] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:51:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:51:16.847120 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2205284-772d-47d3-b496-079ba9440e88 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:16.847521 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2205284-772d-47d3-b496-079ba9440e88 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:16.847668 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2205284-772d-47d3-b496-079ba9440e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:16.865988 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-b2205284-772d-47d3-b496-079ba9440e88 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:51:16.867243 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-b2205284-772d-47d3-b496-079ba9440e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:51:16.941493 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 569/1108] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:51:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 10:51:17.211734 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc75806c-0121-4651-9b55-47ec20b3ec19 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:17.314648 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc75806c-0121-4651-9b55-47ec20b3ec19 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:17.347453 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb96286-1f3c-4c32-a64a-e543f29090e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:17.348072 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb96286-1f3c-4c32-a64a-e543f29090e1 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:17.348359 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb96286-1f3c-4c32-a64a-e543f29090e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:17.348627 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb96286-1f3c-4c32-a64a-e543f29090e1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:17.350276 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb96286-1f3c-4c32-a64a-e543f29090e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:17.351707 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb96286-1f3c-4c32-a64a-e543f29090e1 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:17.353263 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 540/1109] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:51:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:51:17.359071 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2205284-772d-47d3-b496-079ba9440e88 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:17.420108 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:17.457007 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2205284-772d-47d3-b496-079ba9440e88 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:17.490720 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d6018-1f8e-4fd2-823f-c897877759b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:17.491325 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d6018-1f8e-4fd2-823f-c897877759b4 None admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:17.491604 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d6018-1f8e-4fd2-823f-c897877759b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:17.491876 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d6018-1f8e-4fd2-823f-c897877759b4 None admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:17.492528 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5d6018-1f8e-4fd2-823f-c897877759b4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:17.493974 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5d6018-1f8e-4fd2-823f-c897877759b4 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:17.514352 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 570/1110] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Aug 18 10:51:17 2022] POST /identity/v3/users => generated 286 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 10:51:19.475691 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f813b-469d-44e3-a02a-94d7efcecccd None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:19.476205 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f813b-469d-44e3-a02a-94d7efcecccd None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:19.476310 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f813b-469d-44e3-a02a-94d7efcecccd None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:19.477605 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 541/1111] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:51:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:51:19.482789 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dac9a4-c239-4a22-9e33-b599ce2df122 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:19.483203 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dac9a4-c239-4a22-9e33-b599ce2df122 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:19.483346 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dac9a4-c239-4a22-9e33-b599ce2df122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:19.502854 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-16dac9a4-c239-4a22-9e33-b599ce2df122 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:51:19.504074 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-16dac9a4-c239-4a22-9e33-b599ce2df122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:51:19.571896 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 571/1112] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:51:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 10:51:19.844282 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589f813b-469d-44e3-a02a-94d7efcecccd None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:19.893204 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:19.950207 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589f813b-469d-44e3-a02a-94d7efcecccd None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:19.984479 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8bc846-56e4-452b-947c-2b23ebb147b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:19.985101 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8bc846-56e4-452b-947c-2b23ebb147b8 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:19.985381 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8bc846-56e4-452b-947c-2b23ebb147b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:19.985683 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8bc846-56e4-452b-947c-2b23ebb147b8 None admin] PATH_INFO: `/v3/roles/0ecb6b324fc643f3826b2878f2f6174b` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:19.987086 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8bc846-56e4-452b-947c-2b23ebb147b8 None admin] RBAC: Authorizing `identity:get_role(role_id=0ecb6b324fc643f3826b2878f2f6174b)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:19.988455 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8bc846-56e4-452b-947c-2b23ebb147b8 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:19.989800 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 542/1113] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Aug 18 10:51:19 2022] GET /identity/v3/roles/0ecb6b324fc643f3826b2878f2f6174b => generated 223 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:51:19.995985 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dac9a4-c239-4a22-9e33-b599ce2df122 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:20.044940 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:20.095857 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dac9a4-c239-4a22-9e33-b599ce2df122 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:20.128539 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfef95c-94e1-464c-a5e7-95fa8c8a6b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:20.129152 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfef95c-94e1-464c-a5e7-95fa8c8a6b85 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:20.129434 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfef95c-94e1-464c-a5e7-95fa8c8a6b85 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:20.129744 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfef95c-94e1-464c-a5e7-95fa8c8a6b85 None admin] PATH_INFO: `/v3/users/b44dfba2333e41a384d031061e2c9d2a` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:20.144000 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfef95c-94e1-464c-a5e7-95fa8c8a6b85 None admin] RBAC: Authorizing `identity:get_user(user_id=b44dfba2333e41a384d031061e2c9d2a)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:20.145468 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfef95c-94e1-464c-a5e7-95fa8c8a6b85 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:20.147701 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 572/1114] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Aug 18 10:51:19 2022] GET /identity/v3/users/b44dfba2333e41a384d031061e2c9d2a => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:51:20.153848 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8bc846-56e4-452b-947c-2b23ebb147b8 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:20.254599 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8bc846-56e4-452b-947c-2b23ebb147b8 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:20.268235 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:20.291079 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa91d3d-f3ff-4086-ad6f-a3a39a90dd8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:20.291678 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa91d3d-f3ff-4086-ad6f-a3a39a90dd8b None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:20.291954 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa91d3d-f3ff-4086-ad6f-a3a39a90dd8b None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:20.292223 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa91d3d-f3ff-4086-ad6f-a3a39a90dd8b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:20.360584 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa91d3d-f3ff-4086-ad6f-a3a39a90dd8b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:20.361973 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa91d3d-f3ff-4086-ad6f-a3a39a90dd8b None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:20.460100 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 543/1115] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 18 10:51:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 10:51:20.466073 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfef95c-94e1-464c-a5e7-95fa8c8a6b85 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:20.566851 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfef95c-94e1-464c-a5e7-95fa8c8a6b85 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:20.576866 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:20.601165 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0542d64-4a05-4099-a1f4-c8ac83cab318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:20.601821 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0542d64-4a05-4099-a1f4-c8ac83cab318 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:20.602095 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0542d64-4a05-4099-a1f4-c8ac83cab318 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:20.602366 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0542d64-4a05-4099-a1f4-c8ac83cab318 None admin] PATH_INFO: `/v3/projects/909295b933f3490daa022ddd278d626f` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:20.603467 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0542d64-4a05-4099-a1f4-c8ac83cab318 None admin] RBAC: Authorizing `identity:get_project(project_id=909295b933f3490daa022ddd278d626f)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:20.604877 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0542d64-4a05-4099-a1f4-c8ac83cab318 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:20.606525 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 573/1116] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 18 10:51:20 2022] GET /identity/v3/projects/909295b933f3490daa022ddd278d626f => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:51:20.612852 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa91d3d-f3ff-4086-ad6f-a3a39a90dd8b None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:20.627927 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:20.714005 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa91d3d-f3ff-4086-ad6f-a3a39a90dd8b None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:20.746844 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57145b5e-5733-4556-a913-7ff267a8dd2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:20.747534 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57145b5e-5733-4556-a913-7ff267a8dd2c None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:20.747705 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57145b5e-5733-4556-a913-7ff267a8dd2c None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:20.747972 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57145b5e-5733-4556-a913-7ff267a8dd2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:20.748684 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57145b5e-5733-4556-a913-7ff267a8dd2c None admin] RBAC: Adding query filter params (role.id=0ecb6b324fc643f3826b2878f2f6174b, scope.project.id=909295b933f3490daa022ddd278d626f, user.id=b44dfba2333e41a384d031061e2c9d2a) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:51:20.748983 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57145b5e-5733-4556-a913-7ff267a8dd2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:20.750422 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57145b5e-5733-4556-a913-7ff267a8dd2c None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:20.755600 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 544/1117] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Aug 18 10:51:20 2022] GET /identity/v3/role_assignments?user.id=b44dfba2333e41a384d031061e2c9d2a&scope.project.id=909295b933f3490daa022ddd278d626f&role.id=0ecb6b324fc643f3826b2878f2f6174b => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:51:22.623589 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfc1199-4da5-419e-a1cf-a66ce71330ba None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:22.624176 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfc1199-4da5-419e-a1cf-a66ce71330ba None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:22.624176 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfc1199-4da5-419e-a1cf-a66ce71330ba None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:22.625482 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 574/1118] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:51:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:51:22.631179 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d0bea-9d80-42e6-9891-555b48b3d52c None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:22.631739 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d0bea-9d80-42e6-9891-555b48b3d52c None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:22.631739 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d0bea-9d80-42e6-9891-555b48b3d52c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:22.650058 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-c95d0bea-9d80-42e6-9891-555b48b3d52c None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:51:22.651232 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-c95d0bea-9d80-42e6-9891-555b48b3d52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:51:22.715490 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 545/1119] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:51:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 10:51:22.989291 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfc1199-4da5-419e-a1cf-a66ce71330ba None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:23.087315 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfc1199-4da5-419e-a1cf-a66ce71330ba None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:23.119814 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce98087-285b-494c-a411-4f20a5e0f1ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:23.120430 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce98087-285b-494c-a411-4f20a5e0f1ee None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:23.120705 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce98087-285b-494c-a411-4f20a5e0f1ee None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:23.120974 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce98087-285b-494c-a411-4f20a5e0f1ee None admin] PATH_INFO: `/v3/roles/0ecb6b324fc643f3826b2878f2f6174b` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:23.122376 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce98087-285b-494c-a411-4f20a5e0f1ee None admin] RBAC: Authorizing `identity:get_role(role_id=0ecb6b324fc643f3826b2878f2f6174b)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:23.123726 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce98087-285b-494c-a411-4f20a5e0f1ee None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:23.125032 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 575/1120] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Aug 18 10:51:22 2022] GET /identity/v3/roles/0ecb6b324fc643f3826b2878f2f6174b => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:51:23.131679 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95d0bea-9d80-42e6-9891-555b48b3d52c None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:23.140728 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:23.245020 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95d0bea-9d80-42e6-9891-555b48b3d52c None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:23.286996 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d1fdc0-0bfd-4e21-9a7d-9d0a02377c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:23.287633 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d1fdc0-0bfd-4e21-9a7d-9d0a02377c8c None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:23.287913 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d1fdc0-0bfd-4e21-9a7d-9d0a02377c8c None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:23.288188 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d1fdc0-0bfd-4e21-9a7d-9d0a02377c8c None admin] PATH_INFO: `/v3/users/b44dfba2333e41a384d031061e2c9d2a` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:23.289320 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d1fdc0-0bfd-4e21-9a7d-9d0a02377c8c None admin] RBAC: Authorizing `identity:get_user(user_id=b44dfba2333e41a384d031061e2c9d2a)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:23.290800 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d1fdc0-0bfd-4e21-9a7d-9d0a02377c8c None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:23.292392 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 546/1121] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Aug 18 10:51:23 2022] GET /identity/v3/users/b44dfba2333e41a384d031061e2c9d2a => generated 286 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:51:23.298385 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce98087-285b-494c-a411-4f20a5e0f1ee None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:23.344752 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:23.397416 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce98087-285b-494c-a411-4f20a5e0f1ee None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:23.430409 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880371d0-585b-43fc-9464-67f9b0f7892f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:23.431016 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880371d0-585b-43fc-9464-67f9b0f7892f None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:23.431289 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880371d0-585b-43fc-9464-67f9b0f7892f None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:23.431557 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880371d0-585b-43fc-9464-67f9b0f7892f None admin] PATH_INFO: `/v3/projects/909295b933f3490daa022ddd278d626f` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:23.432647 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880371d0-585b-43fc-9464-67f9b0f7892f None admin] RBAC: Authorizing `identity:get_project(project_id=909295b933f3490daa022ddd278d626f)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:23.434094 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880371d0-585b-43fc-9464-67f9b0f7892f None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:23.435762 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 576/1122] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 18 10:51:23 2022] GET /identity/v3/projects/909295b933f3490daa022ddd278d626f => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:51:23.442444 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d1fdc0-0bfd-4e21-9a7d-9d0a02377c8c None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:23.527196 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:23.554680 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d1fdc0-0bfd-4e21-9a7d-9d0a02377c8c None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:23.590432 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d4c8e2-3302-4ac4-8cd4-d6f4c0b21671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:23.591088 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d4c8e2-3302-4ac4-8cd4-d6f4c0b21671 None admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:23.591363 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d4c8e2-3302-4ac4-8cd4-d6f4c0b21671 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:23.591633 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d4c8e2-3302-4ac4-8cd4-d6f4c0b21671 None admin] PATH_INFO: `/v3/projects/909295b933f3490daa022ddd278d626f/users/b44dfba2333e41a384d031061e2c9d2a/roles/0ecb6b324fc643f3826b2878f2f6174b` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:23.593776 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d4c8e2-3302-4ac4-8cd4-d6f4c0b21671 None admin] RBAC: Authorizing `identity:create_grant(project_id=909295b933f3490daa022ddd278d626f, user_id=b44dfba2333e41a384d031061e2c9d2a, role_id=0ecb6b324fc643f3826b2878f2f6174b)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:23.595212 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d4c8e2-3302-4ac4-8cd4-d6f4c0b21671 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:23.607942 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 547/1123] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Aug 18 10:51:23 2022] PUT /identity/v3/projects/909295b933f3490daa022ddd278d626f/users/b44dfba2333e41a384d031061e2c9d2a/roles/0ecb6b324fc643f3826b2878f2f6174b => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 10:51:25.472865 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df151f4-fef0-4f56-93e2-28473599fada None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:25.473389 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df151f4-fef0-4f56-93e2-28473599fada None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:25.473389 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df151f4-fef0-4f56-93e2-28473599fada None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:25.475368 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 577/1124] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:51:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:51:25.480635 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3eaf37-7ca5-43d9-a8e9-4f33cd5f267e None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:25.481064 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3eaf37-7ca5-43d9-a8e9-4f33cd5f267e None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:25.481205 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3eaf37-7ca5-43d9-a8e9-4f33cd5f267e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:25.499661 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-bd3eaf37-7ca5-43d9-a8e9-4f33cd5f267e None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:51:25.500832 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-bd3eaf37-7ca5-43d9-a8e9-4f33cd5f267e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:51:25.566503 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 548/1125] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:51:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 10:51:25.833145 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df151f4-fef0-4f56-93e2-28473599fada None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:25.939453 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df151f4-fef0-4f56-93e2-28473599fada None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:25.953440 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:25.974136 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2925667-4db7-4138-a53e-73d172bb3063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:25.974845 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2925667-4db7-4138-a53e-73d172bb3063 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:25.975125 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2925667-4db7-4138-a53e-73d172bb3063 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:25.975395 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2925667-4db7-4138-a53e-73d172bb3063 None admin] PATH_INFO: `/v3/roles/0ecb6b324fc643f3826b2878f2f6174b` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:25.976777 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2925667-4db7-4138-a53e-73d172bb3063 None admin] RBAC: Authorizing `identity:get_role(role_id=0ecb6b324fc643f3826b2878f2f6174b)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:25.978209 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2925667-4db7-4138-a53e-73d172bb3063 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:25.979520 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 578/1126] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Aug 18 10:51:25 2022] GET /identity/v3/roles/0ecb6b324fc643f3826b2878f2f6174b => generated 223 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:51:25.985422 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3eaf37-7ca5-43d9-a8e9-4f33cd5f267e None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:26.049560 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:26.089303 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3eaf37-7ca5-43d9-a8e9-4f33cd5f267e None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:26.124195 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5fea26-726e-49b8-aadf-742de5103e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:26.124814 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5fea26-726e-49b8-aadf-742de5103e61 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:26.125094 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5fea26-726e-49b8-aadf-742de5103e61 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:26.125368 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5fea26-726e-49b8-aadf-742de5103e61 None admin] PATH_INFO: `/v3/users/b44dfba2333e41a384d031061e2c9d2a` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:26.126515 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5fea26-726e-49b8-aadf-742de5103e61 None admin] RBAC: Authorizing `identity:get_user(user_id=b44dfba2333e41a384d031061e2c9d2a)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:26.127941 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5fea26-726e-49b8-aadf-742de5103e61 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:26.129503 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 549/1127] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Aug 18 10:51:25 2022] GET /identity/v3/users/b44dfba2333e41a384d031061e2c9d2a => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:51:26.135454 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2925667-4db7-4138-a53e-73d172bb3063 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:26.234888 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2925667-4db7-4138-a53e-73d172bb3063 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:26.270470 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e544319-adc1-4114-9b30-b0fa7ff35a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:26.271915 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e544319-adc1-4114-9b30-b0fa7ff35a13 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:26.272398 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e544319-adc1-4114-9b30-b0fa7ff35a13 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:26.272685 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e544319-adc1-4114-9b30-b0fa7ff35a13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:26.321074 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:26.340531 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e544319-adc1-4114-9b30-b0fa7ff35a13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:26.341942 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e544319-adc1-4114-9b30-b0fa7ff35a13 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:26.438208 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 579/1128] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 18 10:51:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 10:51:26.445010 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5fea26-726e-49b8-aadf-742de5103e61 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:26.542850 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5fea26-726e-49b8-aadf-742de5103e61 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:26.572864 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:26.578258 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3375b2-311d-4264-a1fe-ad1b5eecc9a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:26.578881 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3375b2-311d-4264-a1fe-ad1b5eecc9a0 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:26.579159 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3375b2-311d-4264-a1fe-ad1b5eecc9a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:26.579427 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3375b2-311d-4264-a1fe-ad1b5eecc9a0 None admin] PATH_INFO: `/v3/projects/909295b933f3490daa022ddd278d626f` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:26.580531 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3375b2-311d-4264-a1fe-ad1b5eecc9a0 None admin] RBAC: Authorizing `identity:get_project(project_id=909295b933f3490daa022ddd278d626f)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:26.581994 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3375b2-311d-4264-a1fe-ad1b5eecc9a0 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:26.583703 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 550/1129] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 18 10:51:26 2022] GET /identity/v3/projects/909295b933f3490daa022ddd278d626f => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 10:51:26.590745 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e544319-adc1-4114-9b30-b0fa7ff35a13 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:26.688976 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:26.708623 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e544319-adc1-4114-9b30-b0fa7ff35a13 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:26.741913 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be187f2d-33f4-4b59-9849-a29675bb49ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:26.742500 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be187f2d-33f4-4b59-9849-a29675bb49ad None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:26.742776 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be187f2d-33f4-4b59-9849-a29675bb49ad None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:26.743044 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be187f2d-33f4-4b59-9849-a29675bb49ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:26.743752 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be187f2d-33f4-4b59-9849-a29675bb49ad None admin] RBAC: Adding query filter params (role.id=0ecb6b324fc643f3826b2878f2f6174b, scope.project.id=909295b933f3490daa022ddd278d626f, user.id=b44dfba2333e41a384d031061e2c9d2a) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:51:26.744049 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be187f2d-33f4-4b59-9849-a29675bb49ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:26.745452 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be187f2d-33f4-4b59-9849-a29675bb49ad None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:26.751152 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 580/1130] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Aug 18 10:51:26 2022] GET /identity/v3/role_assignments?user.id=b44dfba2333e41a384d031061e2c9d2a&scope.project.id=909295b933f3490daa022ddd278d626f&role.id=0ecb6b324fc643f3826b2878f2f6174b => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:51:28.653373 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27677659-091c-4c09-8f92-46d177b3f79b None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:28.653973 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27677659-091c-4c09-8f92-46d177b3f79b None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:28.653973 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27677659-091c-4c09-8f92-46d177b3f79b None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:28.655271 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 551/1131] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:51:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:51:28.660945 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a4bb8c-638b-4e1b-9bc2-97f0b5b906d6 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:28.661336 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a4bb8c-638b-4e1b-9bc2-97f0b5b906d6 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:28.661492 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a4bb8c-638b-4e1b-9bc2-97f0b5b906d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:28.679600 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-10a4bb8c-638b-4e1b-9bc2-97f0b5b906d6 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:51:28.680774 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-10a4bb8c-638b-4e1b-9bc2-97f0b5b906d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:51:28.744717 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 581/1132] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:51:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 10:51:29.014411 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27677659-091c-4c09-8f92-46d177b3f79b None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:29.118726 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27677659-091c-4c09-8f92-46d177b3f79b None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:29.153607 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162fa439-f5d8-4920-93f4-038be81db1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:29.154232 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162fa439-f5d8-4920-93f4-038be81db1b4 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:29.154511 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162fa439-f5d8-4920-93f4-038be81db1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:29.154784 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162fa439-f5d8-4920-93f4-038be81db1b4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:29.155900 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162fa439-f5d8-4920-93f4-038be81db1b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:29.157334 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162fa439-f5d8-4920-93f4-038be81db1b4 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:29.158929 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 552/1133] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:51:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:51:29.164947 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a4bb8c-638b-4e1b-9bc2-97f0b5b906d6 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:29.239424 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:29.265471 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a4bb8c-638b-4e1b-9bc2-97f0b5b906d6 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:29.298687 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3ee6b5-f5f2-431c-bab0-af929f7897d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:29.299289 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ee6b5-f5f2-431c-bab0-af929f7897d6 None admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:29.299571 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ee6b5-f5f2-431c-bab0-af929f7897d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:29.299846 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ee6b5-f5f2-431c-bab0-af929f7897d6 None admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:29.300487 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3ee6b5-f5f2-431c-bab0-af929f7897d6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:29.301935 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3ee6b5-f5f2-431c-bab0-af929f7897d6 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:29.329522 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 582/1134] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Aug 18 10:51:29 2022] POST /identity/v3/projects => generated 311 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 10:51:31.310766 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca87c2-ba04-409d-8e26-bd78fead8a6a None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:31.311292 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca87c2-ba04-409d-8e26-bd78fead8a6a None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:31.311292 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca87c2-ba04-409d-8e26-bd78fead8a6a None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:31.312622 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 553/1135] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:51:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:51:31.318179 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b278a-f8b2-4fc0-aeb6-8fa4bca7c79a None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:31.318179 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b278a-f8b2-4fc0-aeb6-8fa4bca7c79a None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:31.318969 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b278a-f8b2-4fc0-aeb6-8fa4bca7c79a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:31.337321 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-bc7b278a-f8b2-4fc0-aeb6-8fa4bca7c79a None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:51:31.338557 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-bc7b278a-f8b2-4fc0-aeb6-8fa4bca7c79a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:51:31.404176 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 583/1136] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:51:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 10:51:31.675881 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca87c2-ba04-409d-8e26-bd78fead8a6a None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:31.744354 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:31.779966 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca87c2-ba04-409d-8e26-bd78fead8a6a None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:31.813412 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8f0824-fd20-4e00-a71b-4f8ae6664bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:31.814048 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f0824-fd20-4e00-a71b-4f8ae6664bb1 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:31.814322 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f0824-fd20-4e00-a71b-4f8ae6664bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:31.814588 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f0824-fd20-4e00-a71b-4f8ae6664bb1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:31.815679 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8f0824-fd20-4e00-a71b-4f8ae6664bb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:31.817104 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8f0824-fd20-4e00-a71b-4f8ae6664bb1 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:31.819179 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 554/1137] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:51:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:51:31.824981 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7b278a-f8b2-4fc0-aeb6-8fa4bca7c79a None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:31.878130 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:31.922932 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7b278a-f8b2-4fc0-aeb6-8fa4bca7c79a None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:31.955460 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60646f9f-bab4-4044-8ae3-8a3330944fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:31.955999 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60646f9f-bab4-4044-8ae3-8a3330944fb5 None admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:31.956277 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60646f9f-bab4-4044-8ae3-8a3330944fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:31.956548 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60646f9f-bab4-4044-8ae3-8a3330944fb5 None admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:31.957201 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60646f9f-bab4-4044-8ae3-8a3330944fb5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:31.959253 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60646f9f-bab4-4044-8ae3-8a3330944fb5 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:31.979788 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 584/1138] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Aug 18 10:51:31 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 10:51:33.932189 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f92543-a9ba-4f80-9ae5-8657339c5b04 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:33.932723 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f92543-a9ba-4f80-9ae5-8657339c5b04 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:33.932723 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f92543-a9ba-4f80-9ae5-8657339c5b04 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:33.934089 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 555/1139] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:51:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:51:33.939153 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e969a-2128-41be-8700-bebfe3407909 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:33.939605 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e969a-2128-41be-8700-bebfe3407909 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:33.939698 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e969a-2128-41be-8700-bebfe3407909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:33.959884 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-f31e969a-2128-41be-8700-bebfe3407909 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:51:33.961094 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-f31e969a-2128-41be-8700-bebfe3407909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:51:34.029303 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 585/1140] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:51:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 10:51:34.311154 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f92543-a9ba-4f80-9ae5-8657339c5b04 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:34.414740 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f92543-a9ba-4f80-9ae5-8657339c5b04 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:34.449047 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913613ee-6d81-440c-93fc-a404c0d73fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:34.449695 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913613ee-6d81-440c-93fc-a404c0d73fa6 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:34.449977 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913613ee-6d81-440c-93fc-a404c0d73fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:34.450249 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913613ee-6d81-440c-93fc-a404c0d73fa6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:34.452819 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:34.461025 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913613ee-6d81-440c-93fc-a404c0d73fa6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:51:34.465608 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-913613ee-6d81-440c-93fc-a404c0d73fa6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 10:51:34.465608 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:51:34.465608 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:51:34.465608 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:51:34.465608 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:51:34.465608 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:51:34.465608 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:51:34.465608 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:51:34.465608 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:51:34.465608 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:51:34.465608 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:51:34.465608 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:51:34.465608 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:51:34.465608 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:51:34.465608 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:51:34.465608 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:51:34.466802 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:51:34.466802 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:51:34.466802 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:51:34.466802 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:51:34.466802 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:51:34.466802 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:51:34.466802 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:51:34.466802 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:51:34.466802 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:51:34.466802 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:51:34.466802 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:51:34.466802 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:51:34.466802 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:51:34.466802 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:51:34.466802 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:51:34.466802 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:51:34.468004 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:51:34.468004 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:51:34.468004 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:51:34.468004 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:51:34.468004 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:51:34.468004 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:51:34.468004 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:51:34.468004 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:51:34.468004 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:51:34.468004 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:51:34.468004 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 10:51:34.468004 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:51:34.468004 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 556/1141] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Aug 18 10:51:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:51:34.472803 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31e969a-2128-41be-8700-bebfe3407909 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:34.514508 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:34.571735 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31e969a-2128-41be-8700-bebfe3407909 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:34.603866 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ff6429-7f43-412e-a2c9-dc0e7e4fd702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:34.604468 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ff6429-7f43-412e-a2c9-dc0e7e4fd702 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:34.604740 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ff6429-7f43-412e-a2c9-dc0e7e4fd702 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:34.605004 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ff6429-7f43-412e-a2c9-dc0e7e4fd702 None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:34.605680 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ff6429-7f43-412e-a2c9-dc0e7e4fd702 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:51:34.605977 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ff6429-7f43-412e-a2c9-dc0e7e4fd702 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:34.607330 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ff6429-7f43-412e-a2c9-dc0e7e4fd702 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:34.615723 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 586/1142] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 18 10:51:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:51:34.621773 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913613ee-6d81-440c-93fc-a404c0d73fa6 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:34.728566 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913613ee-6d81-440c-93fc-a404c0d73fa6 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:34.763449 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dd87c3-d070-4738-ab85-c15be15062de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:34.764063 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd87c3-d070-4738-ab85-c15be15062de None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:34.764337 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd87c3-d070-4738-ab85-c15be15062de None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:34.764605 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd87c3-d070-4738-ab85-c15be15062de None admin] PATH_INFO: `/v3/users/dfde8c42e3f94969952d9682357b3b1a` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:34.777945 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dd87c3-d070-4738-ab85-c15be15062de None admin] RBAC: Authorizing `identity:get_user(user_id=dfde8c42e3f94969952d9682357b3b1a)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:34.779405 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dd87c3-d070-4738-ab85-c15be15062de None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:34.780982 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 557/1143] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Aug 18 10:51:34 2022] GET /identity/v3/users/dfde8c42e3f94969952d9682357b3b1a => generated 286 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:51:34.787456 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ff6429-7f43-412e-a2c9-dc0e7e4fd702 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:34.886030 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ff6429-7f43-412e-a2c9-dc0e7e4fd702 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:34.888317 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:34.920425 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbbc302-c8a9-4307-bcf0-01872ac71b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:34.921029 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbbc302-c8a9-4307-bcf0-01872ac71b8c None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:34.921309 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbbc302-c8a9-4307-bcf0-01872ac71b8c None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:34.921609 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbbc302-c8a9-4307-bcf0-01872ac71b8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:34.987299 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbbc302-c8a9-4307-bcf0-01872ac71b8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:34.988750 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbbc302-c8a9-4307-bcf0-01872ac71b8c None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:35.109470 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 587/1144] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 18 10:51:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 10:51:35.116192 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dd87c3-d070-4738-ab85-c15be15062de None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:35.171321 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:35.216870 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dd87c3-d070-4738-ab85-c15be15062de None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:35.260160 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f713dc98-663f-4fe9-b4f3-cb39ab310d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:35.260707 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f713dc98-663f-4fe9-b4f3-cb39ab310d7e None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:35.260988 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f713dc98-663f-4fe9-b4f3-cb39ab310d7e None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:35.261263 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f713dc98-663f-4fe9-b4f3-cb39ab310d7e None admin] PATH_INFO: `/v3/projects/4af27359bc4840d0a66032b2f5c0a986` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:35.262409 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f713dc98-663f-4fe9-b4f3-cb39ab310d7e None admin] RBAC: Authorizing `identity:get_project(project_id=4af27359bc4840d0a66032b2f5c0a986)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:35.263863 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f713dc98-663f-4fe9-b4f3-cb39ab310d7e None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:35.265491 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 558/1145] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 18 10:51:35 2022] GET /identity/v3/projects/4af27359bc4840d0a66032b2f5c0a986 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:51:35.271892 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbbc302-c8a9-4307-bcf0-01872ac71b8c None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:35.275215 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:35.369453 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbbc302-c8a9-4307-bcf0-01872ac71b8c None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:35.404785 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49f796f-11a8-43fb-bef6-1068c7e039a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:35.405371 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f796f-11a8-43fb-bef6-1068c7e039a1 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:35.405677 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f796f-11a8-43fb-bef6-1068c7e039a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:35.405950 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f796f-11a8-43fb-bef6-1068c7e039a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:35.406666 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49f796f-11a8-43fb-bef6-1068c7e039a1 None admin] RBAC: Adding query filter params (role.id=127fdc7ef05b4e0b98a940b334e5fcab, scope.project.id=4af27359bc4840d0a66032b2f5c0a986, user.id=dfde8c42e3f94969952d9682357b3b1a) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:51:35.406967 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49f796f-11a8-43fb-bef6-1068c7e039a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:35.408376 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49f796f-11a8-43fb-bef6-1068c7e039a1 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:35.413743 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 588/1146] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Aug 18 10:51:35 2022] GET /identity/v3/role_assignments?user.id=dfde8c42e3f94969952d9682357b3b1a&scope.project.id=4af27359bc4840d0a66032b2f5c0a986&role.id=127fdc7ef05b4e0b98a940b334e5fcab => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:51:37.285332 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a0123c-95cb-4ecd-8fb5-ac696e32857c None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:37.285875 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a0123c-95cb-4ecd-8fb5-ac696e32857c None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:37.285875 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a0123c-95cb-4ecd-8fb5-ac696e32857c None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:37.287922 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 559/1147] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:51:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:51:37.293328 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2aefc0-44be-4281-bbd1-fcdfd77084e9 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:37.293890 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2aefc0-44be-4281-bbd1-fcdfd77084e9 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:37.293890 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2aefc0-44be-4281-bbd1-fcdfd77084e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:37.315078 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-ac2aefc0-44be-4281-bbd1-fcdfd77084e9 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:51:37.316265 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-ac2aefc0-44be-4281-bbd1-fcdfd77084e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:51:37.381021 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:37.386775 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 589/1148] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:51:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 10:51:37.658455 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a0123c-95cb-4ecd-8fb5-ac696e32857c None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:37.761258 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a0123c-95cb-4ecd-8fb5-ac696e32857c None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:37.783712 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:37.795851 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5080e044-5a9b-44f8-9db4-3c800e9af7a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:37.796509 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5080e044-5a9b-44f8-9db4-3c800e9af7a5 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:37.796836 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5080e044-5a9b-44f8-9db4-3c800e9af7a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:37.797129 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5080e044-5a9b-44f8-9db4-3c800e9af7a5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:37.808566 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5080e044-5a9b-44f8-9db4-3c800e9af7a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:51:37.813231 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-5080e044-5a9b-44f8-9db4-3c800e9af7a5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 10:51:37.813231 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:51:37.813231 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:51:37.813231 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:51:37.813231 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:51:37.813231 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:51:37.813231 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:51:37.813231 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:51:37.813231 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:51:37.813231 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:51:37.813231 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:51:37.813231 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:51:37.813231 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:51:37.813231 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:51:37.813231 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:51:37.813231 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:51:37.814307 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:51:37.814307 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:51:37.814307 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:51:37.814307 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:51:37.814307 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:51:37.814307 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:51:37.814307 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:51:37.814307 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:51:37.814307 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:51:37.814307 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:51:37.814307 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:51:37.814307 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:51:37.814307 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:51:37.814307 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:51:37.814307 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:51:37.814307 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:51:37.815615 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:51:37.815615 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:51:37.815615 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:51:37.815615 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:51:37.815615 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:51:37.815615 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:51:37.815615 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:51:37.815615 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:51:37.815615 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:51:37.815615 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:51:37.815615 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 10:51:37.815615 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:51:37.815615 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 560/1149] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Aug 18 10:51:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:51:37.821091 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2aefc0-44be-4281-bbd1-fcdfd77084e9 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:37.918030 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2aefc0-44be-4281-bbd1-fcdfd77084e9 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:37.951678 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db25990d-027f-4e39-9f08-f60eebe36efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:37.952279 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db25990d-027f-4e39-9f08-f60eebe36efe None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:37.952560 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db25990d-027f-4e39-9f08-f60eebe36efe None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:37.952833 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db25990d-027f-4e39-9f08-f60eebe36efe None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:37.953493 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db25990d-027f-4e39-9f08-f60eebe36efe None admin] RBAC: Adding query filter params (name=admin) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:51:37.953827 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db25990d-027f-4e39-9f08-f60eebe36efe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:37.955191 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db25990d-027f-4e39-9f08-f60eebe36efe None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:37.963679 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 590/1150] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 18 10:51:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:51:37.970065 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5080e044-5a9b-44f8-9db4-3c800e9af7a5 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:38.078956 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5080e044-5a9b-44f8-9db4-3c800e9af7a5 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:38.113932 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29622312-f8e8-4d99-b378-eb9f9f60f54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:38.114589 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29622312-f8e8-4d99-b378-eb9f9f60f54f None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:38.114890 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29622312-f8e8-4d99-b378-eb9f9f60f54f None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:38.115191 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29622312-f8e8-4d99-b378-eb9f9f60f54f None admin] PATH_INFO: `/v3/users/dfde8c42e3f94969952d9682357b3b1a` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:38.116504 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29622312-f8e8-4d99-b378-eb9f9f60f54f None admin] RBAC: Authorizing `identity:get_user(user_id=dfde8c42e3f94969952d9682357b3b1a)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:38.117962 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29622312-f8e8-4d99-b378-eb9f9f60f54f None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:38.119546 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 561/1151] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Aug 18 10:51:37 2022] GET /identity/v3/users/dfde8c42e3f94969952d9682357b3b1a => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:51:38.125546 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db25990d-027f-4e39-9f08-f60eebe36efe None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:38.182935 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:38.225197 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db25990d-027f-4e39-9f08-f60eebe36efe None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:38.259426 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a56fc8-7e1c-4ab0-8294-856208eb372d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:38.260058 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a56fc8-7e1c-4ab0-8294-856208eb372d None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:38.260342 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a56fc8-7e1c-4ab0-8294-856208eb372d None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:38.260628 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a56fc8-7e1c-4ab0-8294-856208eb372d None admin] PATH_INFO: `/v3/projects/4af27359bc4840d0a66032b2f5c0a986` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:38.261823 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a56fc8-7e1c-4ab0-8294-856208eb372d None admin] RBAC: Authorizing `identity:get_project(project_id=4af27359bc4840d0a66032b2f5c0a986)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:38.263215 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a56fc8-7e1c-4ab0-8294-856208eb372d None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:38.264887 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 591/1152] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 18 10:51:38 2022] GET /identity/v3/projects/4af27359bc4840d0a66032b2f5c0a986 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:51:38.271630 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29622312-f8e8-4d99-b378-eb9f9f60f54f None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:38.324755 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:38.384649 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29622312-f8e8-4d99-b378-eb9f9f60f54f None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:38.425079 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6541c4b7-b5b4-486d-b330-e084e6be92d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:38.425765 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541c4b7-b5b4-486d-b330-e084e6be92d8 None admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:38.426050 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541c4b7-b5b4-486d-b330-e084e6be92d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:38.426329 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541c4b7-b5b4-486d-b330-e084e6be92d8 None admin] PATH_INFO: `/v3/projects/4af27359bc4840d0a66032b2f5c0a986/users/dfde8c42e3f94969952d9682357b3b1a/roles/127fdc7ef05b4e0b98a940b334e5fcab` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:38.428468 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6541c4b7-b5b4-486d-b330-e084e6be92d8 None admin] RBAC: Authorizing `identity:create_grant(project_id=4af27359bc4840d0a66032b2f5c0a986, user_id=dfde8c42e3f94969952d9682357b3b1a, role_id=127fdc7ef05b4e0b98a940b334e5fcab)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:38.429938 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6541c4b7-b5b4-486d-b330-e084e6be92d8 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:38.446718 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 562/1153] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Aug 18 10:51:38 2022] PUT /identity/v3/projects/4af27359bc4840d0a66032b2f5c0a986/users/dfde8c42e3f94969952d9682357b3b1a/roles/127fdc7ef05b4e0b98a940b334e5fcab => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 10:51:40.335448 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c9160d-76f1-42c4-a027-36b62ad21ec9 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:40.335962 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c9160d-76f1-42c4-a027-36b62ad21ec9 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:40.336075 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c9160d-76f1-42c4-a027-36b62ad21ec9 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:40.337333 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 592/1154] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:51:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:51:40.342451 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871faa9-d535-4ac8-ad3c-3ac01e07b7d8 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:40.342829 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871faa9-d535-4ac8-ad3c-3ac01e07b7d8 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:40.343004 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871faa9-d535-4ac8-ad3c-3ac01e07b7d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:40.361065 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-c871faa9-d535-4ac8-ad3c-3ac01e07b7d8 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:51:40.362286 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-c871faa9-d535-4ac8-ad3c-3ac01e07b7d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:51:40.433423 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 563/1155] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:51:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 10:51:40.703230 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c9160d-76f1-42c4-a027-36b62ad21ec9 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:40.803933 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c9160d-76f1-42c4-a027-36b62ad21ec9 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:40.829099 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:40.837841 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74d075c-e107-451e-a977-ea29677d3d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:40.838468 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d075c-e107-451e-a977-ea29677d3d88 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:40.838746 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d075c-e107-451e-a977-ea29677d3d88 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:40.839020 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d075c-e107-451e-a977-ea29677d3d88 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:40.849907 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74d075c-e107-451e-a977-ea29677d3d88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:51:40.854501 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-e74d075c-e107-451e-a977-ea29677d3d88 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 10:51:40.854501 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:51:40.854501 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:51:40.854501 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:51:40.854501 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:51:40.854501 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:51:40.854501 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:51:40.854501 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:51:40.854501 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:51:40.854501 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:51:40.854501 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:51:40.854501 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:51:40.854501 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:51:40.854501 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:51:40.854501 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:51:40.854501 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:51:40.855619 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:51:40.855619 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:51:40.855619 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:51:40.855619 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:51:40.855619 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:51:40.855619 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:51:40.855619 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:51:40.855619 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:51:40.855619 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:51:40.855619 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:51:40.855619 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:51:40.855619 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:51:40.855619 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:51:40.855619 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:51:40.855619 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:51:40.855619 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:51:40.856482 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:51:40.856482 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:51:40.856482 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:51:40.856482 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:51:40.856482 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:51:40.856482 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:51:40.856482 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:51:40.856482 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:51:40.856482 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:51:40.856482 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:51:40.856482 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 10:51:40.856482 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:51:40.856482 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 593/1156] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Aug 18 10:51:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:51:40.861796 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c871faa9-d535-4ac8-ad3c-3ac01e07b7d8 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:40.903913 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:40.963371 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c871faa9-d535-4ac8-ad3c-3ac01e07b7d8 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:40.996906 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9add2ec-0928-40fe-8400-86a33c6f210f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:40.997510 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9add2ec-0928-40fe-8400-86a33c6f210f None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:40.997820 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9add2ec-0928-40fe-8400-86a33c6f210f None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:40.998095 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9add2ec-0928-40fe-8400-86a33c6f210f None admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:40.998756 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9add2ec-0928-40fe-8400-86a33c6f210f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:51:40.999083 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9add2ec-0928-40fe-8400-86a33c6f210f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:41.000433 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9add2ec-0928-40fe-8400-86a33c6f210f None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:41.009025 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 564/1157] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 18 10:51:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:51:41.014895 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74d075c-e107-451e-a977-ea29677d3d88 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:41.113695 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74d075c-e107-451e-a977-ea29677d3d88 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:41.147649 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f133a5-97a0-47db-ad73-94194b1c5948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:41.148268 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f133a5-97a0-47db-ad73-94194b1c5948 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:41.148545 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f133a5-97a0-47db-ad73-94194b1c5948 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:41.148816 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f133a5-97a0-47db-ad73-94194b1c5948 None admin] PATH_INFO: `/v3/users/dfde8c42e3f94969952d9682357b3b1a` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:41.150195 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f133a5-97a0-47db-ad73-94194b1c5948 None admin] RBAC: Authorizing `identity:get_user(user_id=dfde8c42e3f94969952d9682357b3b1a)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:41.151612 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f133a5-97a0-47db-ad73-94194b1c5948 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:41.153192 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 594/1158] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Aug 18 10:51:41 2022] GET /identity/v3/users/dfde8c42e3f94969952d9682357b3b1a => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:51:41.161274 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9add2ec-0928-40fe-8400-86a33c6f210f None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:41.263847 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9add2ec-0928-40fe-8400-86a33c6f210f None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:41.265411 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:41.298420 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4ab3d4-5d3a-4c86-90f8-f8956fb4f205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:41.299015 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ab3d4-5d3a-4c86-90f8-f8956fb4f205 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:41.299304 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ab3d4-5d3a-4c86-90f8-f8956fb4f205 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:41.299573 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ab3d4-5d3a-4c86-90f8-f8956fb4f205 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:41.367011 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4ab3d4-5d3a-4c86-90f8-f8956fb4f205 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:41.368454 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4ab3d4-5d3a-4c86-90f8-f8956fb4f205 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:41.466182 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 565/1159] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 18 10:51:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 10:51:41.472136 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f133a5-97a0-47db-ad73-94194b1c5948 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:41.529659 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:41.573444 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f133a5-97a0-47db-ad73-94194b1c5948 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:41.606776 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8154f030-495f-4a52-bd73-29d485b79eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:41.607403 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8154f030-495f-4a52-bd73-29d485b79eca None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:41.607682 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8154f030-495f-4a52-bd73-29d485b79eca None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:41.607958 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8154f030-495f-4a52-bd73-29d485b79eca None admin] PATH_INFO: `/v3/projects/4af27359bc4840d0a66032b2f5c0a986` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:41.609087 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8154f030-495f-4a52-bd73-29d485b79eca None admin] RBAC: Authorizing `identity:get_project(project_id=4af27359bc4840d0a66032b2f5c0a986)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:41.610545 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8154f030-495f-4a52-bd73-29d485b79eca None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:41.612177 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 595/1160] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 18 10:51:41 2022] GET /identity/v3/projects/4af27359bc4840d0a66032b2f5c0a986 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:51:41.618917 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4ab3d4-5d3a-4c86-90f8-f8956fb4f205 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:41.621078 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:41.727396 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4ab3d4-5d3a-4c86-90f8-f8956fb4f205 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:41.763127 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c65796f-8dcd-404c-befd-ab18d947bdd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:41.763735 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c65796f-8dcd-404c-befd-ab18d947bdd2 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:41.764014 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c65796f-8dcd-404c-befd-ab18d947bdd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:41.764287 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c65796f-8dcd-404c-befd-ab18d947bdd2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:41.765012 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c65796f-8dcd-404c-befd-ab18d947bdd2 None admin] RBAC: Adding query filter params (role.id=127fdc7ef05b4e0b98a940b334e5fcab, scope.project.id=4af27359bc4840d0a66032b2f5c0a986, user.id=dfde8c42e3f94969952d9682357b3b1a) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:51:41.765318 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c65796f-8dcd-404c-befd-ab18d947bdd2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:41.766777 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c65796f-8dcd-404c-befd-ab18d947bdd2 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:41.772803 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 566/1161] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Aug 18 10:51:41 2022] GET /identity/v3/role_assignments?user.id=dfde8c42e3f94969952d9682357b3b1a&scope.project.id=4af27359bc4840d0a66032b2f5c0a986&role.id=127fdc7ef05b4e0b98a940b334e5fcab => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:51:43.750181 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c73294-4823-4498-9880-932a0acccdd6 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:43.750730 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c73294-4823-4498-9880-932a0acccdd6 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:43.750730 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c73294-4823-4498-9880-932a0acccdd6 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:43.752059 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 596/1162] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:51:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:51:43.757801 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e63b7e-6689-465f-a969-cab394af6c37 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:43.758211 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e63b7e-6689-465f-a969-cab394af6c37 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:43.758355 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e63b7e-6689-465f-a969-cab394af6c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:43.779244 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-75e63b7e-6689-465f-a969-cab394af6c37 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:51:43.780813 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-75e63b7e-6689-465f-a969-cab394af6c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:51:43.845361 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:43.853821 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 567/1163] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:51:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 10:51:44.124746 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c73294-4823-4498-9880-932a0acccdd6 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:44.230130 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c73294-4823-4498-9880-932a0acccdd6 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:44.252654 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:44.264215 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7bb95e-517c-4aa8-a407-f890c0c0a3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:44.264816 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7bb95e-517c-4aa8-a407-f890c0c0a3ab None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:44.265089 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7bb95e-517c-4aa8-a407-f890c0c0a3ab None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:44.265359 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7bb95e-517c-4aa8-a407-f890c0c0a3ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:44.330507 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7bb95e-517c-4aa8-a407-f890c0c0a3ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:44.331938 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7bb95e-517c-4aa8-a407-f890c0c0a3ab None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:44.428634 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 597/1164] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 18 10:51:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 10:51:44.434534 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e63b7e-6689-465f-a969-cab394af6c37 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:44.533710 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e63b7e-6689-465f-a969-cab394af6c37 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:44.567167 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0274f6a0-0c4c-452e-9418-865aca360b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:44.568516 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274f6a0-0c4c-452e-9418-865aca360b8e None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:44.568654 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274f6a0-0c4c-452e-9418-865aca360b8e None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:44.568822 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274f6a0-0c4c-452e-9418-865aca360b8e None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:44.575687 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0274f6a0-0c4c-452e-9418-865aca360b8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:44.577111 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0274f6a0-0c4c-452e-9418-865aca360b8e None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:44.588889 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-0274f6a0-0c4c-452e-9418-865aca360b8e None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 18 10:51:44.588889 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:51:44.588889 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 18 10:51:44.588889 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 18 10:51:44.588889 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 10:51:44.588889 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 10:51:44.588889 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 10:51:44.588889 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 10:51:44.588889 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 18 10:51:44.588889 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:51:44.588889 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 10:51:44.588889 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:51:44.588889 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:51:44.588889 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:51:44.588889 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:51:44.588889 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:51:44.588889 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:51:44.590096 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:51:44.590096 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:51:44.590096 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:51:44.590096 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:51:44.590096 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:51:44.590096 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:51:44.590096 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 10:51:44.590096 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 10:51:44.590096 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 10:51:44.590096 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 10:51:44.590096 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:51:44.590096 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:51:44.590096 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:51:44.590096 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:51:44.590096 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:51:44.590096 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:51:44.591331 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:51:44.591331 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:51:44.591331 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:51:44.591331 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:51:44.591331 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:51:44.591331 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:51:44.591331 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:51:44.591331 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:51:44.591331 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:51:44.591331 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:51:44.591331 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 18 10:51:44.591331 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 10:51:44.591331 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 18 10:51:44.591331 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:51:44.591331 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 568/1165] 10.222.0.15 () {56 vars in 1117 bytes} [Thu Aug 18 10:51:44 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:51:44.596001 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7bb95e-517c-4aa8-a407-f890c0c0a3ab None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:44.619546 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:44.696359 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7bb95e-517c-4aa8-a407-f890c0c0a3ab None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:44.729706 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8f4812-94d8-4eba-8c7b-501dded59203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:44.730313 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f4812-94d8-4eba-8c7b-501dded59203 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:44.730589 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f4812-94d8-4eba-8c7b-501dded59203 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:44.730863 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f4812-94d8-4eba-8c7b-501dded59203 None admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:44.731496 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8f4812-94d8-4eba-8c7b-501dded59203 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:51:44.731792 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8f4812-94d8-4eba-8c7b-501dded59203 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:44.733155 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8f4812-94d8-4eba-8c7b-501dded59203 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:44.740338 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 598/1166] 10.222.0.15 () {56 vars in 1115 bytes} [Thu Aug 18 10:51:44 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:51:46.672611 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b655043-c576-466c-9a56-012357e163d2 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:46.673139 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b655043-c576-466c-9a56-012357e163d2 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:46.673139 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b655043-c576-466c-9a56-012357e163d2 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:46.674525 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 569/1167] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:51:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:51:46.680633 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a469eef-c864-4386-8286-a305d8762097 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:46.681104 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a469eef-c864-4386-8286-a305d8762097 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:46.681197 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a469eef-c864-4386-8286-a305d8762097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:46.698896 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-5a469eef-c864-4386-8286-a305d8762097 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:51:46.700082 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-5a469eef-c864-4386-8286-a305d8762097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:51:46.765612 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 599/1168] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:51:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 10:51:47.040483 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b655043-c576-466c-9a56-012357e163d2 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:47.098350 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:47.143656 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b655043-c576-466c-9a56-012357e163d2 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:47.177787 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed47851-9458-4ebc-8f46-d738e5e056fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:47.178556 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed47851-9458-4ebc-8f46-d738e5e056fb None admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:47.178835 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed47851-9458-4ebc-8f46-d738e5e056fb None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:47.179110 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed47851-9458-4ebc-8f46-d738e5e056fb None admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:47.179781 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed47851-9458-4ebc-8f46-d738e5e056fb None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:47.181161 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed47851-9458-4ebc-8f46-d738e5e056fb None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:47.197723 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 570/1169] 10.222.0.15 () {60 vars in 1138 bytes} [Thu Aug 18 10:51:47 2022] POST /identity/v3/domains => generated 267 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 10:51:49.145053 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a435e-c457-4ed9-996c-e1ee6a8b29c6 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:49.145924 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a435e-c457-4ed9-996c-e1ee6a8b29c6 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:49.145924 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a435e-c457-4ed9-996c-e1ee6a8b29c6 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:49.148135 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 600/1170] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:51:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:51:49.153976 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a4c20f-e09a-44d2-89a8-2b7f9ccdec96 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:49.154469 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a4c20f-e09a-44d2-89a8-2b7f9ccdec96 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:49.154571 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a4c20f-e09a-44d2-89a8-2b7f9ccdec96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:49.173598 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-74a4c20f-e09a-44d2-89a8-2b7f9ccdec96 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:51:49.174824 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-74a4c20f-e09a-44d2-89a8-2b7f9ccdec96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:51:49.253096 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 571/1171] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:51:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 10:51:49.550750 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5a435e-c457-4ed9-996c-e1ee6a8b29c6 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:49.570665 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:49.667572 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5a435e-c457-4ed9-996c-e1ee6a8b29c6 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:49.702704 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9544a28-665c-4ff2-a003-a03d715fca07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:49.703332 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9544a28-665c-4ff2-a003-a03d715fca07 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:49.703614 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9544a28-665c-4ff2-a003-a03d715fca07 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:49.703894 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9544a28-665c-4ff2-a003-a03d715fca07 None admin] PATH_INFO: `/v3/domains/5b7367f9f066410c8f1d00b3b767f1b6` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:49.715575 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9544a28-665c-4ff2-a003-a03d715fca07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=5b7367f9f066410c8f1d00b3b767f1b6)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:49.717020 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9544a28-665c-4ff2-a003-a03d715fca07 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:49.718683 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 601/1172] 10.222.0.15 () {56 vars in 1183 bytes} [Thu Aug 18 10:51:49 2022] GET /identity/v3/domains/5b7367f9f066410c8f1d00b3b767f1b6 => generated 267 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:51:49.725176 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a4c20f-e09a-44d2-89a8-2b7f9ccdec96 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:49.770904 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:49.826707 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a4c20f-e09a-44d2-89a8-2b7f9ccdec96 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:49.861184 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a3321e-c2ea-4e24-8248-d70ce7d88dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:49.861822 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a3321e-c2ea-4e24-8248-d70ce7d88dfd None admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:49.862100 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a3321e-c2ea-4e24-8248-d70ce7d88dfd None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:49.862372 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a3321e-c2ea-4e24-8248-d70ce7d88dfd None admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:49.863030 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a3321e-c2ea-4e24-8248-d70ce7d88dfd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:49.865090 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a3321e-c2ea-4e24-8248-d70ce7d88dfd None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:49.891832 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 572/1173] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Aug 18 10:51:49 2022] POST /identity/v3/projects => generated 361 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 10:51:51.827328 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04181c78-8896-45d0-b8ee-0b662a893506 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:51.827876 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04181c78-8896-45d0-b8ee-0b662a893506 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:51.827876 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04181c78-8896-45d0-b8ee-0b662a893506 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:51.829203 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 602/1174] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:51:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:51:51.835586 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f86e6be-3c7f-4b5e-b74e-cf34dcd72707 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:51.836014 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f86e6be-3c7f-4b5e-b74e-cf34dcd72707 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:51.836117 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f86e6be-3c7f-4b5e-b74e-cf34dcd72707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:51.854652 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-4f86e6be-3c7f-4b5e-b74e-cf34dcd72707 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:51:51.855847 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-4f86e6be-3c7f-4b5e-b74e-cf34dcd72707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:51:51.924853 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 573/1175] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:51:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 10:51:52.193709 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04181c78-8896-45d0-b8ee-0b662a893506 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:52.278145 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:52.300788 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04181c78-8896-45d0-b8ee-0b662a893506 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:52.334735 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e3d19f-c26f-4e42-9da6-bf2aa1b277bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:52.335356 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e3d19f-c26f-4e42-9da6-bf2aa1b277bf None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:52.335633 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e3d19f-c26f-4e42-9da6-bf2aa1b277bf None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:52.335903 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e3d19f-c26f-4e42-9da6-bf2aa1b277bf None admin] PATH_INFO: `/v3/domains/5b7367f9f066410c8f1d00b3b767f1b6` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:52.337015 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e3d19f-c26f-4e42-9da6-bf2aa1b277bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=5b7367f9f066410c8f1d00b3b767f1b6)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:52.338457 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e3d19f-c26f-4e42-9da6-bf2aa1b277bf None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:52.340022 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 603/1176] 10.222.0.15 () {56 vars in 1183 bytes} [Thu Aug 18 10:51:52 2022] GET /identity/v3/domains/5b7367f9f066410c8f1d00b3b767f1b6 => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:51:52.345864 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f86e6be-3c7f-4b5e-b74e-cf34dcd72707 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:52.373791 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:52.447738 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f86e6be-3c7f-4b5e-b74e-cf34dcd72707 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:52.481948 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c538ef65-fbd8-48f3-87c6-b401a253d1c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:52.482549 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c538ef65-fbd8-48f3-87c6-b401a253d1c7 None admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:52.482827 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c538ef65-fbd8-48f3-87c6-b401a253d1c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:52.483100 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c538ef65-fbd8-48f3-87c6-b401a253d1c7 None admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:52.483754 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c538ef65-fbd8-48f3-87c6-b401a253d1c7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:52.485189 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c538ef65-fbd8-48f3-87c6-b401a253d1c7 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:52.506818 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 574/1177] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Aug 18 10:51:52 2022] POST /identity/v3/users => generated 311 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 10:51:54.450978 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef887a55-6574-4634-8769-e0d3f1131d92 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:54.451534 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef887a55-6574-4634-8769-e0d3f1131d92 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:54.451534 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef887a55-6574-4634-8769-e0d3f1131d92 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:54.452845 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 604/1178] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:51:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:51:54.458369 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5db23-d626-4abc-a2d4-e774e4f1d4f7 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:54.458795 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5db23-d626-4abc-a2d4-e774e4f1d4f7 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:54.458904 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5db23-d626-4abc-a2d4-e774e4f1d4f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:54.477119 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-7dd5db23-d626-4abc-a2d4-e774e4f1d4f7 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:51:54.478341 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-7dd5db23-d626-4abc-a2d4-e774e4f1d4f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:51:54.545400 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 575/1179] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:51:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 10:51:54.813530 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef887a55-6574-4634-8769-e0d3f1131d92 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:54.918713 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef887a55-6574-4634-8769-e0d3f1131d92 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:54.951931 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d0f9ef-4d91-4705-b331-74fe65798e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:54.952555 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d0f9ef-4d91-4705-b331-74fe65798e09 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:54.952833 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d0f9ef-4d91-4705-b331-74fe65798e09 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:54.953106 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d0f9ef-4d91-4705-b331-74fe65798e09 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:54.964381 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d0f9ef-4d91-4705-b331-74fe65798e09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:51:54.969029 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-51d0f9ef-4d91-4705-b331-74fe65798e09 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 10:51:54.969029 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:51:54.969029 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:51:54.969029 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:51:54.969029 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:51:54.969029 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:51:54.969029 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:51:54.969029 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:51:54.969029 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:51:54.969029 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:51:54.969029 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:51:54.969029 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:51:54.969029 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:51:54.969029 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:51:54.969029 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:51:54.969029 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:51:54.970220 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:51:54.970220 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:51:54.970220 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:51:54.970220 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:51:54.970220 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:51:54.970220 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:51:54.970220 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:51:54.970220 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:51:54.970220 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:51:54.970220 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:51:54.970220 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:51:54.970220 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:51:54.970220 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:51:54.970220 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:51:54.970220 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:51:54.970220 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:51:54.971462 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:51:54.971462 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:51:54.971462 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:51:54.971462 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:51:54.971462 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:51:54.971462 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:51:54.971462 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:51:54.971462 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:51:54.971462 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:51:54.971462 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:51:54.971462 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 10:51:54.971462 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:51:54.971462 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 605/1180] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Aug 18 10:51:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:51:54.976927 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd5db23-d626-4abc-a2d4-e774e4f1d4f7 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:54.991742 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:55.076628 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd5db23-d626-4abc-a2d4-e774e4f1d4f7 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:55.110799 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50406e8-f49b-4a37-98d5-229ab767bf94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:55.111469 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50406e8-f49b-4a37-98d5-229ab767bf94 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:55.111749 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50406e8-f49b-4a37-98d5-229ab767bf94 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:55.112024 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50406e8-f49b-4a37-98d5-229ab767bf94 None admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:55.112681 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50406e8-f49b-4a37-98d5-229ab767bf94 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:51:55.112982 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50406e8-f49b-4a37-98d5-229ab767bf94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:55.114454 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50406e8-f49b-4a37-98d5-229ab767bf94 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:55.122535 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 576/1181] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 18 10:51:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:51:55.128443 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d0f9ef-4d91-4705-b331-74fe65798e09 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:55.138106 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:55.228910 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d0f9ef-4d91-4705-b331-74fe65798e09 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:55.261149 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4eb920-4785-41b9-ba52-41a32eba7515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:55.261777 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4eb920-4785-41b9-ba52-41a32eba7515 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:55.262054 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4eb920-4785-41b9-ba52-41a32eba7515 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:55.262324 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4eb920-4785-41b9-ba52-41a32eba7515 None admin] PATH_INFO: `/v3/users/bd211aae5f2e4b38bded9f162b13611f` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:55.275809 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4eb920-4785-41b9-ba52-41a32eba7515 None admin] RBAC: Authorizing `identity:get_user(user_id=bd211aae5f2e4b38bded9f162b13611f)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:55.277230 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4eb920-4785-41b9-ba52-41a32eba7515 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:55.278862 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 606/1182] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Aug 18 10:51:55 2022] GET /identity/v3/users/bd211aae5f2e4b38bded9f162b13611f => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:51:55.284852 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50406e8-f49b-4a37-98d5-229ab767bf94 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:55.364828 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:55.388473 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50406e8-f49b-4a37-98d5-229ab767bf94 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:55.421960 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e913939-c270-472a-b611-e445753878e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:55.422557 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e913939-c270-472a-b611-e445753878e2 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:55.422839 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e913939-c270-472a-b611-e445753878e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:55.423107 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e913939-c270-472a-b611-e445753878e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:55.490845 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e913939-c270-472a-b611-e445753878e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:55.492337 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e913939-c270-472a-b611-e445753878e2 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:55.569406 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:55.594268 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 577/1183] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 18 10:51:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 10:51:55.600968 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4eb920-4785-41b9-ba52-41a32eba7515 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:55.662307 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:55.699350 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4eb920-4785-41b9-ba52-41a32eba7515 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:55.732174 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae50467-2820-47ab-93a5-feab3cb86ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:55.732791 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae50467-2820-47ab-93a5-feab3cb86ca6 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:55.733063 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae50467-2820-47ab-93a5-feab3cb86ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:55.733335 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae50467-2820-47ab-93a5-feab3cb86ca6 None admin] PATH_INFO: `/v3/projects/02bfbeb40f5243a0af0f437e6c524872` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:55.734460 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae50467-2820-47ab-93a5-feab3cb86ca6 None admin] RBAC: Authorizing `identity:get_project(project_id=02bfbeb40f5243a0af0f437e6c524872)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:55.735879 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae50467-2820-47ab-93a5-feab3cb86ca6 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:55.737497 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 607/1184] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 18 10:51:55 2022] GET /identity/v3/projects/02bfbeb40f5243a0af0f437e6c524872 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:51:55.743947 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e913939-c270-472a-b611-e445753878e2 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:55.843817 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e913939-c270-472a-b611-e445753878e2 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:55.877301 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e786d-d560-4659-ad8d-5f5e567d2153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:55.877923 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e786d-d560-4659-ad8d-5f5e567d2153 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:55.878204 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e786d-d560-4659-ad8d-5f5e567d2153 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:55.878481 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e786d-d560-4659-ad8d-5f5e567d2153 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:55.879206 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e786d-d560-4659-ad8d-5f5e567d2153 None admin] RBAC: Adding query filter params (role.id=127fdc7ef05b4e0b98a940b334e5fcab, scope.project.id=02bfbeb40f5243a0af0f437e6c524872, user.id=bd211aae5f2e4b38bded9f162b13611f) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:51:55.879517 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e786d-d560-4659-ad8d-5f5e567d2153 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:55.881575 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e786d-d560-4659-ad8d-5f5e567d2153 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:55.886960 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 578/1185] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Aug 18 10:51:55 2022] GET /identity/v3/role_assignments?user.id=bd211aae5f2e4b38bded9f162b13611f&scope.project.id=02bfbeb40f5243a0af0f437e6c524872&role.id=127fdc7ef05b4e0b98a940b334e5fcab => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:51:57.767881 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff52786-7814-4a28-b607-3f3bd7bfb5c6 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:57.768436 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff52786-7814-4a28-b607-3f3bd7bfb5c6 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:57.768436 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff52786-7814-4a28-b607-3f3bd7bfb5c6 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:57.769822 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 608/1186] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:51:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:51:57.775290 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5465d185-2dbb-4bd8-8df6-50c62d80a30d None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:57.775686 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5465d185-2dbb-4bd8-8df6-50c62d80a30d None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:57.775840 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5465d185-2dbb-4bd8-8df6-50c62d80a30d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:57.795026 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-5465d185-2dbb-4bd8-8df6-50c62d80a30d None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:51:57.796225 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-5465d185-2dbb-4bd8-8df6-50c62d80a30d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:51:57.835815 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:57.874286 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 579/1187] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:51:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 10:51:58.155166 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff52786-7814-4a28-b607-3f3bd7bfb5c6 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:58.261465 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff52786-7814-4a28-b607-3f3bd7bfb5c6 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:58.290752 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:58.295994 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c880e-a736-4e0d-ae55-94fffd6564a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:58.296614 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c880e-a736-4e0d-ae55-94fffd6564a9 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:58.296891 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c880e-a736-4e0d-ae55-94fffd6564a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:58.297163 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c880e-a736-4e0d-ae55-94fffd6564a9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:58.309572 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615c880e-a736-4e0d-ae55-94fffd6564a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:51:58.314537 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-615c880e-a736-4e0d-ae55-94fffd6564a9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 10:51:58.314537 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:51:58.314537 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:51:58.314537 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:51:58.314537 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:51:58.314537 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:51:58.314537 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:51:58.314537 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:51:58.314537 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:51:58.314537 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:51:58.314537 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:51:58.314537 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:51:58.314537 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:51:58.314537 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:51:58.314537 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:51:58.314537 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:51:58.315675 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:51:58.315675 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:51:58.315675 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:51:58.315675 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:51:58.315675 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:51:58.315675 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:51:58.315675 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:51:58.315675 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:51:58.315675 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:51:58.315675 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:51:58.315675 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:51:58.315675 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:51:58.315675 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:51:58.315675 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:51:58.315675 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:51:58.315675 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:51:58.316787 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:51:58.316787 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:51:58.316787 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:51:58.316787 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:51:58.316787 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:51:58.316787 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:51:58.316787 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:51:58.316787 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:51:58.316787 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:51:58.316787 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:51:58.316787 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 10:51:58.316787 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:51:58.316787 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 609/1188] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Aug 18 10:51:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:51:58.322215 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5465d185-2dbb-4bd8-8df6-50c62d80a30d None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:58.423573 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5465d185-2dbb-4bd8-8df6-50c62d80a30d None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:58.457055 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228bd288-2b37-40ed-85a9-2f6005a5bf3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:58.457683 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228bd288-2b37-40ed-85a9-2f6005a5bf3e None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:58.458517 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228bd288-2b37-40ed-85a9-2f6005a5bf3e None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:58.458793 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228bd288-2b37-40ed-85a9-2f6005a5bf3e None admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:58.459462 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228bd288-2b37-40ed-85a9-2f6005a5bf3e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:51:58.459774 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228bd288-2b37-40ed-85a9-2f6005a5bf3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:58.461140 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228bd288-2b37-40ed-85a9-2f6005a5bf3e None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:58.469165 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 580/1189] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 18 10:51:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:51:58.475667 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c880e-a736-4e0d-ae55-94fffd6564a9 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:58.574216 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c880e-a736-4e0d-ae55-94fffd6564a9 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:58.607962 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f2969b-2a95-47d2-b5ed-2a4873035e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:58.608571 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2969b-2a95-47d2-b5ed-2a4873035e26 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:58.608847 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2969b-2a95-47d2-b5ed-2a4873035e26 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:58.609117 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2969b-2a95-47d2-b5ed-2a4873035e26 None admin] PATH_INFO: `/v3/users/bd211aae5f2e4b38bded9f162b13611f` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:58.610249 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f2969b-2a95-47d2-b5ed-2a4873035e26 None admin] RBAC: Authorizing `identity:get_user(user_id=bd211aae5f2e4b38bded9f162b13611f)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:58.611665 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f2969b-2a95-47d2-b5ed-2a4873035e26 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:58.613226 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 610/1190] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Aug 18 10:51:58 2022] GET /identity/v3/users/bd211aae5f2e4b38bded9f162b13611f => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:51:58.619181 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228bd288-2b37-40ed-85a9-2f6005a5bf3e None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:58.651302 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:58.719556 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228bd288-2b37-40ed-85a9-2f6005a5bf3e None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:58.752739 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4195c1f8-4525-454d-a338-2e9618ff651d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:58.753367 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4195c1f8-4525-454d-a338-2e9618ff651d None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:58.753680 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4195c1f8-4525-454d-a338-2e9618ff651d None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:58.753958 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4195c1f8-4525-454d-a338-2e9618ff651d None admin] PATH_INFO: `/v3/projects/02bfbeb40f5243a0af0f437e6c524872` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:58.755791 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4195c1f8-4525-454d-a338-2e9618ff651d None admin] RBAC: Authorizing `identity:get_project(project_id=02bfbeb40f5243a0af0f437e6c524872)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:58.757217 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4195c1f8-4525-454d-a338-2e9618ff651d None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:58.758876 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 581/1191] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 18 10:51:58 2022] GET /identity/v3/projects/02bfbeb40f5243a0af0f437e6c524872 => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:51:58.764924 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f2969b-2a95-47d2-b5ed-2a4873035e26 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:51:58.823719 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:51:58.864193 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f2969b-2a95-47d2-b5ed-2a4873035e26 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:51:58.898458 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22bcbf5-cccd-42bf-88dd-1a781e698855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:51:58.899360 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22bcbf5-cccd-42bf-88dd-1a781e698855 None admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:51:58.899647 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22bcbf5-cccd-42bf-88dd-1a781e698855 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:51:58.899922 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22bcbf5-cccd-42bf-88dd-1a781e698855 None admin] PATH_INFO: `/v3/projects/02bfbeb40f5243a0af0f437e6c524872/users/bd211aae5f2e4b38bded9f162b13611f/roles/127fdc7ef05b4e0b98a940b334e5fcab` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:51:58.901860 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22bcbf5-cccd-42bf-88dd-1a781e698855 None admin] RBAC: Authorizing `identity:create_grant(project_id=02bfbeb40f5243a0af0f437e6c524872, user_id=bd211aae5f2e4b38bded9f162b13611f, role_id=127fdc7ef05b4e0b98a940b334e5fcab)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:51:58.903292 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22bcbf5-cccd-42bf-88dd-1a781e698855 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:51:58.917026 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 611/1192] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Aug 18 10:51:58 2022] PUT /identity/v3/projects/02bfbeb40f5243a0af0f437e6c524872/users/bd211aae5f2e4b38bded9f162b13611f/roles/127fdc7ef05b4e0b98a940b334e5fcab => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 10:52:00.796256 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc38f4-c071-47e5-8267-91d2b1d3e035 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:52:00.796817 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc38f4-c071-47e5-8267-91d2b1d3e035 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:52:00.796817 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc38f4-c071-47e5-8267-91d2b1d3e035 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:52:00.798164 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 582/1193] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:52:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:52:00.803826 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd330c-0c82-4db0-9c82-e11df3f3f90c None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:52:00.804268 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd330c-0c82-4db0-9c82-e11df3f3f90c None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:52:00.804362 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd330c-0c82-4db0-9c82-e11df3f3f90c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:52:00.822840 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-f5cd330c-0c82-4db0-9c82-e11df3f3f90c None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:52:00.824034 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-f5cd330c-0c82-4db0-9c82-e11df3f3f90c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:52:00.889058 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 612/1194] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:52:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 10:52:01.163386 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cc38f4-c071-47e5-8267-91d2b1d3e035 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:52:01.263178 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:52:01.267730 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cc38f4-c071-47e5-8267-91d2b1d3e035 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:52:01.303581 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138762aa-168c-41eb-95ff-7ccf24434b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:52:01.304206 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138762aa-168c-41eb-95ff-7ccf24434b67 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:52:01.304487 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138762aa-168c-41eb-95ff-7ccf24434b67 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:52:01.304757 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138762aa-168c-41eb-95ff-7ccf24434b67 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:52:01.316244 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138762aa-168c-41eb-95ff-7ccf24434b67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:52:01.322058 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-138762aa-168c-41eb-95ff-7ccf24434b67 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 10:52:01.322058 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:52:01.322058 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:52:01.322058 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:52:01.322058 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:52:01.322058 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:52:01.322058 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:52:01.322058 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:52:01.322058 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:52:01.322058 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:52:01.322058 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:52:01.322058 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:52:01.322058 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:52:01.322058 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:52:01.322058 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:52:01.322058 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:52:01.323173 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:52:01.323173 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:52:01.323173 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:52:01.323173 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:52:01.323173 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:52:01.323173 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:52:01.323173 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:52:01.323173 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:52:01.323173 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:52:01.323173 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:52:01.323173 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:52:01.323173 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:52:01.323173 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:52:01.323173 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:52:01.323173 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:52:01.323173 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:52:01.324366 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:52:01.324366 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:52:01.324366 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:52:01.324366 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:52:01.324366 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:52:01.324366 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:52:01.324366 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:52:01.324366 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:52:01.324366 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:52:01.324366 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:52:01.324366 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 10:52:01.324366 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:52:01.324366 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 583/1195] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Aug 18 10:52:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:52:01.329482 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cd330c-0c82-4db0-9c82-e11df3f3f90c None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:52:01.377227 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:52:01.427734 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cd330c-0c82-4db0-9c82-e11df3f3f90c None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:52:01.461676 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689c94af-cdd8-4a99-92e4-b1453f214e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:52:01.462273 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689c94af-cdd8-4a99-92e4-b1453f214e16 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:52:01.462554 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689c94af-cdd8-4a99-92e4-b1453f214e16 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:52:01.462830 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689c94af-cdd8-4a99-92e4-b1453f214e16 None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:52:01.463494 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689c94af-cdd8-4a99-92e4-b1453f214e16 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:52:01.463796 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689c94af-cdd8-4a99-92e4-b1453f214e16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:52:01.465160 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689c94af-cdd8-4a99-92e4-b1453f214e16 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:52:01.472972 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 613/1196] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 18 10:52:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:52:01.479118 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138762aa-168c-41eb-95ff-7ccf24434b67 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:52:01.580585 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138762aa-168c-41eb-95ff-7ccf24434b67 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:52:01.615812 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2d7685-4b33-47cb-b450-df9c55eecc39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:52:01.616431 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2d7685-4b33-47cb-b450-df9c55eecc39 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:52:01.616709 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2d7685-4b33-47cb-b450-df9c55eecc39 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:52:01.616984 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2d7685-4b33-47cb-b450-df9c55eecc39 None admin] PATH_INFO: `/v3/users/bd211aae5f2e4b38bded9f162b13611f` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:52:01.618127 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2d7685-4b33-47cb-b450-df9c55eecc39 None admin] RBAC: Authorizing `identity:get_user(user_id=bd211aae5f2e4b38bded9f162b13611f)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:52:01.619553 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2d7685-4b33-47cb-b450-df9c55eecc39 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:52:01.621131 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 584/1197] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Aug 18 10:52:01 2022] GET /identity/v3/users/bd211aae5f2e4b38bded9f162b13611f => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:52:01.627095 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689c94af-cdd8-4a99-92e4-b1453f214e16 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:52:01.727994 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689c94af-cdd8-4a99-92e4-b1453f214e16 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:52:01.740640 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:52:01.762390 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04751b55-5f63-4101-9332-ddb244dff533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:52:01.762994 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04751b55-5f63-4101-9332-ddb244dff533 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:52:01.763277 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04751b55-5f63-4101-9332-ddb244dff533 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:52:01.763549 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04751b55-5f63-4101-9332-ddb244dff533 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:52:01.835956 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04751b55-5f63-4101-9332-ddb244dff533 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:52:01.837407 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04751b55-5f63-4101-9332-ddb244dff533 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:52:01.935448 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 614/1198] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 18 10:52:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 10:52:01.941430 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2d7685-4b33-47cb-b450-df9c55eecc39 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:52:01.970560 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:52:02.042336 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2d7685-4b33-47cb-b450-df9c55eecc39 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:52:02.075443 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a476d343-84d3-48fe-9bfb-9f40571e3ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:52:02.076058 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a476d343-84d3-48fe-9bfb-9f40571e3ff6 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:52:02.076335 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a476d343-84d3-48fe-9bfb-9f40571e3ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:52:02.076607 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a476d343-84d3-48fe-9bfb-9f40571e3ff6 None admin] PATH_INFO: `/v3/projects/02bfbeb40f5243a0af0f437e6c524872` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:52:02.077756 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a476d343-84d3-48fe-9bfb-9f40571e3ff6 None admin] RBAC: Authorizing `identity:get_project(project_id=02bfbeb40f5243a0af0f437e6c524872)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:52:02.079181 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a476d343-84d3-48fe-9bfb-9f40571e3ff6 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:52:02.080802 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 585/1199] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 18 10:52:01 2022] GET /identity/v3/projects/02bfbeb40f5243a0af0f437e6c524872 => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:52:02.088354 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04751b55-5f63-4101-9332-ddb244dff533 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:52:02.102790 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:52:02.188957 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04751b55-5f63-4101-9332-ddb244dff533 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:52:02.223708 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac5370-20d4-4ebe-857f-268192c59f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:52:02.224434 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac5370-20d4-4ebe-857f-268192c59f13 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:52:02.224712 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac5370-20d4-4ebe-857f-268192c59f13 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:52:02.224981 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac5370-20d4-4ebe-857f-268192c59f13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:52:02.225733 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cac5370-20d4-4ebe-857f-268192c59f13 None admin] RBAC: Adding query filter params (role.id=127fdc7ef05b4e0b98a940b334e5fcab, scope.project.id=02bfbeb40f5243a0af0f437e6c524872, user.id=bd211aae5f2e4b38bded9f162b13611f) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:52:02.226037 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cac5370-20d4-4ebe-857f-268192c59f13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:52:02.227443 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cac5370-20d4-4ebe-857f-268192c59f13 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:52:02.233112 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 615/1200] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Aug 18 10:52:02 2022] GET /identity/v3/role_assignments?user.id=bd211aae5f2e4b38bded9f162b13611f&scope.project.id=02bfbeb40f5243a0af0f437e6c524872&role.id=127fdc7ef05b4e0b98a940b334e5fcab => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:52:12.071287 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=52 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:52:12.230576 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=62 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:52:57.945572 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d2e20-9673-4305-aebc-910e87140834 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:52:57.945572 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d2e20-9673-4305-aebc-910e87140834 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:52:57.945572 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d2e20-9673-4305-aebc-910e87140834 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:52:57.946906 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 586/1201] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:52:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:52:57.952603 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e110be1-ad1c-44fb-a786-5007deaeecd0 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:52:57.953094 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e110be1-ad1c-44fb-a786-5007deaeecd0 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:52:57.953181 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e110be1-ad1c-44fb-a786-5007deaeecd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:52:57.974532 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-6e110be1-ad1c-44fb-a786-5007deaeecd0 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:52:57.975909 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-6e110be1-ad1c-44fb-a786-5007deaeecd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:52:58.060152 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 616/1202] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:52:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 10:52:58.336685 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545d2e20-9673-4305-aebc-910e87140834 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:52:58.473878 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545d2e20-9673-4305-aebc-910e87140834 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:52:58.529631 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2236f554-9cc7-49fd-b68d-d0b73857aa15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:52:58.530552 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2236f554-9cc7-49fd-b68d-d0b73857aa15 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:52:58.530838 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2236f554-9cc7-49fd-b68d-d0b73857aa15 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:52:58.531280 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2236f554-9cc7-49fd-b68d-d0b73857aa15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:52:58.548994 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2236f554-9cc7-49fd-b68d-d0b73857aa15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:52:58.550591 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2236f554-9cc7-49fd-b68d-d0b73857aa15 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:52:58.568294 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-2236f554-9cc7-49fd-b68d-d0b73857aa15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:52:58.568294 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:52:58.568294 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:52:58.568294 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:52:58.568294 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:52:58.568294 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:52:58.568294 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:52:58.568294 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:52:58.568294 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:52:58.568294 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:52:58.568294 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:52:58.568294 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:52:58.568294 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 10:52:58.568294 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 10:52:58.568294 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 10:52:58.568294 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 10:52:58.569406 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:52:58.569406 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:52:58.569406 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:52:58.569406 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:52:58.569406 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:52:58.569406 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:52:58.569406 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:52:58.569406 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:52:58.569406 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:52:58.569406 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:52:58.569406 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:52:58.569406 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:52:58.569406 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:52:58.569406 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:52:58.569406 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:52:58.569406 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:52:58.569406 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 10:52:58.570406 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 10:52:58.570406 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:52:58.570406 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:52:58.570406 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 587/1203] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:52:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 10:52:58.577617 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e110be1-ad1c-44fb-a786-5007deaeecd0 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:52:58.712327 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e110be1-ad1c-44fb-a786-5007deaeecd0 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:52:58.747274 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:52:58.758324 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806f432e-936c-42dd-a2f7-ea24c7fce1bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:52:58.759065 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f432e-936c-42dd-a2f7-ea24c7fce1bb None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:52:58.759486 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f432e-936c-42dd-a2f7-ea24c7fce1bb None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:52:58.759769 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f432e-936c-42dd-a2f7-ea24c7fce1bb None admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:52:58.760684 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806f432e-936c-42dd-a2f7-ea24c7fce1bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:52:58.761050 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806f432e-936c-42dd-a2f7-ea24c7fce1bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:52:58.762706 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806f432e-936c-42dd-a2f7-ea24c7fce1bb None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:52:58.778647 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 617/1204] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 18 10:52:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:52:58.785862 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2236f554-9cc7-49fd-b68d-d0b73857aa15 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:52:58.851226 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:52:58.918888 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2236f554-9cc7-49fd-b68d-d0b73857aa15 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:52:58.963328 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7c9b2c-05d1-4f62-a8bf-7936e4cb0a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:52:58.963999 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c9b2c-05d1-4f62-a8bf-7936e4cb0a34 None admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:52:58.964243 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c9b2c-05d1-4f62-a8bf-7936e4cb0a34 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:52:58.964524 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c9b2c-05d1-4f62-a8bf-7936e4cb0a34 None admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:52:58.965360 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7c9b2c-05d1-4f62-a8bf-7936e4cb0a34 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:52:58.966835 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7c9b2c-05d1-4f62-a8bf-7936e4cb0a34 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:52:59.005632 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 588/1205] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Aug 18 10:52:58 2022] POST /identity/v3/users => generated 251 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 10:53:01.305781 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4292d9-ebe7-48a5-8acf-47b03f55cfe0 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:01.306337 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4292d9-ebe7-48a5-8acf-47b03f55cfe0 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:01.306445 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4292d9-ebe7-48a5-8acf-47b03f55cfe0 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:01.307780 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 618/1206] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:53:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:53:01.316977 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e3850e-2d7b-422a-86c8-b69328f60e10 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:01.316977 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e3850e-2d7b-422a-86c8-b69328f60e10 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:01.316977 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e3850e-2d7b-422a-86c8-b69328f60e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:01.339008 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-e5e3850e-2d7b-422a-86c8-b69328f60e10 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:53:01.340260 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-e5e3850e-2d7b-422a-86c8-b69328f60e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:53:01.423366 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 589/1207] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:53:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 10:53:01.713285 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4292d9-ebe7-48a5-8acf-47b03f55cfe0 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:53:01.852450 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4292d9-ebe7-48a5-8acf-47b03f55cfe0 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:53:01.896961 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cfebfc-5612-48b9-9798-86ab48e4068d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:53:01.897687 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cfebfc-5612-48b9-9798-86ab48e4068d None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:01.897904 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cfebfc-5612-48b9-9798-86ab48e4068d None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:01.898182 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cfebfc-5612-48b9-9798-86ab48e4068d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:01.916663 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cfebfc-5612-48b9-9798-86ab48e4068d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:53:01.921964 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-42cfebfc-5612-48b9-9798-86ab48e4068d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 10:53:01.921964 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:53:01.921964 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:53:01.921964 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:53:01.921964 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:53:01.921964 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:53:01.921964 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:53:01.921964 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:53:01.921964 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:53:01.921964 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:53:01.921964 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:53:01.921964 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:53:01.921964 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:53:01.921964 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:53:01.921964 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:53:01.921964 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:53:01.923114 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:53:01.923114 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:53:01.923114 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:53:01.923114 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:53:01.923114 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:53:01.923114 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:53:01.923114 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:53:01.923114 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:53:01.923114 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:53:01.923114 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:53:01.923114 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:53:01.923114 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:53:01.923114 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:53:01.923114 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:53:01.923114 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:53:01.923114 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:53:01.923994 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:53:01.923994 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:53:01.923994 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:53:01.923994 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:53:01.923994 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:53:01.923994 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:53:01.923994 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:53:01.923994 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:53:01.923994 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:53:01.923994 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:53:01.923994 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 10:53:01.923994 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:53:01.923994 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 619/1208] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Aug 18 10:53:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:53:01.930449 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e3850e-2d7b-422a-86c8-b69328f60e10 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:53:01.980984 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:53:02.056066 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e3850e-2d7b-422a-86c8-b69328f60e10 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:53:02.099501 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff09601-00cf-4407-ae86-4e29a2c48381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:53:02.100154 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff09601-00cf-4407-ae86-4e29a2c48381 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:02.100458 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff09601-00cf-4407-ae86-4e29a2c48381 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:02.100796 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff09601-00cf-4407-ae86-4e29a2c48381 None admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:02.101648 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff09601-00cf-4407-ae86-4e29a2c48381 None admin] RBAC: Adding query filter params (name=service) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:53:02.102020 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff09601-00cf-4407-ae86-4e29a2c48381 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:53:02.105433 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff09601-00cf-4407-ae86-4e29a2c48381 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:53:02.118282 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 590/1209] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Aug 18 10:53:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 10:53:02.124354 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cfebfc-5612-48b9-9798-86ab48e4068d None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:53:02.192073 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:53:02.260883 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cfebfc-5612-48b9-9798-86ab48e4068d None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:53:02.303477 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167b08b1-0b2a-47ce-b537-5abca07bb7c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:53:02.307472 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b08b1-0b2a-47ce-b537-5abca07bb7c9 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:02.307472 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b08b1-0b2a-47ce-b537-5abca07bb7c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:02.307472 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b08b1-0b2a-47ce-b537-5abca07bb7c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:02.318313 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167b08b1-0b2a-47ce-b537-5abca07bb7c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:53:02.319949 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167b08b1-0b2a-47ce-b537-5abca07bb7c9 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:53:02.336724 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-167b08b1-0b2a-47ce-b537-5abca07bb7c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:53:02.336724 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:53:02.336724 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:53:02.336724 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:53:02.336724 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:53:02.336724 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:53:02.336724 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:53:02.336724 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:53:02.336724 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:53:02.336724 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:53:02.336724 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:53:02.336724 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:53:02.336724 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 10:53:02.336724 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 10:53:02.336724 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 10:53:02.336724 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 10:53:02.338814 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:53:02.338814 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:53:02.338814 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:53:02.338814 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:53:02.338814 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:53:02.338814 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:53:02.338814 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:53:02.338814 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:53:02.338814 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:53:02.338814 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:53:02.338814 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:53:02.338814 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:53:02.338814 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:53:02.338814 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:53:02.338814 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:53:02.338814 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:53:02.338814 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 10:53:02.339741 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 10:53:02.339741 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:53:02.339741 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:53:02.339741 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 620/1210] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:53:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:53:02.344492 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff09601-00cf-4407-ae86-4e29a2c48381 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:53:02.476180 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:53:02.479525 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff09601-00cf-4407-ae86-4e29a2c48381 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:53:02.520637 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53f35cb-8b78-4aa2-96d3-44981f26d2fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:53:02.521202 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53f35cb-8b78-4aa2-96d3-44981f26d2fc None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:02.521465 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53f35cb-8b78-4aa2-96d3-44981f26d2fc None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:02.521784 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53f35cb-8b78-4aa2-96d3-44981f26d2fc None admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:02.522467 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53f35cb-8b78-4aa2-96d3-44981f26d2fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:53:02.522785 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53f35cb-8b78-4aa2-96d3-44981f26d2fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:53:02.524285 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53f35cb-8b78-4aa2-96d3-44981f26d2fc None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:53:02.539828 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 591/1211] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 18 10:53:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 10:53:02.548468 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167b08b1-0b2a-47ce-b537-5abca07bb7c9 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:53:02.675410 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167b08b1-0b2a-47ce-b537-5abca07bb7c9 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:53:02.677556 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:53:02.718436 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04a606b-37a4-4c39-ada0-e6b2a986ef53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:53:02.719201 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04a606b-37a4-4c39-ada0-e6b2a986ef53 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:02.719489 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04a606b-37a4-4c39-ada0-e6b2a986ef53 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:02.719804 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04a606b-37a4-4c39-ada0-e6b2a986ef53 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:02.730337 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04a606b-37a4-4c39-ada0-e6b2a986ef53 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:53:02.731841 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04a606b-37a4-4c39-ada0-e6b2a986ef53 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:53:02.746810 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-f04a606b-37a4-4c39-ada0-e6b2a986ef53 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 18 10:53:02.746810 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:53:02.746810 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:53:02.746810 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:53:02.746810 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:53:02.746810 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:53:02.746810 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:53:02.746810 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:53:02.746810 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:53:02.746810 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:53:02.746810 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:53:02.746810 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:53:02.746810 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 10:53:02.746810 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 10:53:02.746810 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 10:53:02.746810 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 10:53:02.748427 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:53:02.748427 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:53:02.748427 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 10:53:02.748427 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 10:53:02.748427 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 10:53:02.748427 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 10:53:02.748427 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:53:02.748427 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:53:02.748427 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:53:02.748427 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:53:02.748427 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:53:02.748427 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:53:02.748427 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:53:02.748427 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:53:02.748427 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:53:02.748427 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:53:02.748427 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:53:02.748427 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:53:02.749651 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:53:02.749651 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:53:02.749651 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 10:53:02.749651 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 10:53:02.749651 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 10:53:02.749651 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 10:53:02.749651 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 10:53:02.749651 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 10:53:02.749651 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 18 10:53:02.749651 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:53:02.755192 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53f35cb-8b78-4aa2-96d3-44981f26d2fc None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:53:02.758448 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 621/1212] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:53:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:53:02.878541 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53f35cb-8b78-4aa2-96d3-44981f26d2fc None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:53:02.924388 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa4fd62-4011-4f73-a1fc-6d3bb58e8260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:53:02.926193 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa4fd62-4011-4f73-a1fc-6d3bb58e8260 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:02.926193 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa4fd62-4011-4f73-a1fc-6d3bb58e8260 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:02.926193 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa4fd62-4011-4f73-a1fc-6d3bb58e8260 None admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:02.926763 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa4fd62-4011-4f73-a1fc-6d3bb58e8260 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:53:02.927099 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa4fd62-4011-4f73-a1fc-6d3bb58e8260 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:53:02.928739 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa4fd62-4011-4f73-a1fc-6d3bb58e8260 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:53:02.949688 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 592/1213] 10.222.0.15 () {56 vars in 1143 bytes} [Thu Aug 18 10:53:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:53:02.955544 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04a606b-37a4-4c39-ada0-e6b2a986ef53 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:53:03.090134 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04a606b-37a4-4c39-ada0-e6b2a986ef53 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:53:03.133167 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed84a606-2189-424d-98a3-f9a71c31eae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:53:03.133167 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84a606-2189-424d-98a3-f9a71c31eae2 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:03.133167 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84a606-2189-424d-98a3-f9a71c31eae2 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:03.133167 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84a606-2189-424d-98a3-f9a71c31eae2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:03.173705 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:53:03.236398 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed84a606-2189-424d-98a3-f9a71c31eae2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:53:03.238185 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed84a606-2189-424d-98a3-f9a71c31eae2 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:53:03.379259 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 622/1214] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 18 10:53:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 18 10:53:03.382993 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa4fd62-4011-4f73-a1fc-6d3bb58e8260 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:53:03.406845 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:53:03.507639 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa4fd62-4011-4f73-a1fc-6d3bb58e8260 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:53:03.549852 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ce2e00-386b-494d-a337-3f1f49bbe966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:53:03.550735 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce2e00-386b-494d-a337-3f1f49bbe966 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:03.551016 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce2e00-386b-494d-a337-3f1f49bbe966 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:03.551357 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce2e00-386b-494d-a337-3f1f49bbe966 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:03.562785 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ce2e00-386b-494d-a337-3f1f49bbe966 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:53:03.564296 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ce2e00-386b-494d-a337-3f1f49bbe966 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:53:03.580755 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-62ce2e00-386b-494d-a337-3f1f49bbe966 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:53:03.580755 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:53:03.580755 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:53:03.580755 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:53:03.580755 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:53:03.580755 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:53:03.580755 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:53:03.580755 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:53:03.580755 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:53:03.580755 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:53:03.580755 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:53:03.580755 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:53:03.580755 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 10:53:03.580755 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 10:53:03.580755 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 10:53:03.580755 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 10:53:03.587403 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:53:03.587403 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:53:03.587403 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:53:03.587403 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:53:03.587403 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:53:03.587403 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:53:03.587403 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:53:03.587403 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:53:03.587403 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:53:03.587403 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:53:03.587403 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:53:03.587403 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:53:03.587403 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:53:03.587403 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:53:03.587403 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:53:03.587403 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:53:03.587403 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 10:53:03.588506 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 10:53:03.588506 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:53:03.588506 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:53:03.588506 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 593/1215] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:53:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 10:53:03.588788 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed84a606-2189-424d-98a3-f9a71c31eae2 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:53:03.663032 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:53:03.706644 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed84a606-2189-424d-98a3-f9a71c31eae2 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:53:03.746350 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a60d68-85c3-47e5-89d4-f4e7f579fddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:53:03.746987 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a60d68-85c3-47e5-89d4-f4e7f579fddf None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:03.747280 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a60d68-85c3-47e5-89d4-f4e7f579fddf None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:03.747586 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a60d68-85c3-47e5-89d4-f4e7f579fddf None admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:03.748181 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a60d68-85c3-47e5-89d4-f4e7f579fddf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:53:03.748577 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a60d68-85c3-47e5-89d4-f4e7f579fddf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:53:03.750095 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a60d68-85c3-47e5-89d4-f4e7f579fddf None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:53:03.762714 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 623/1216] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 18 10:53:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:53:03.769125 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ce2e00-386b-494d-a337-3f1f49bbe966 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:53:03.851415 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:53:03.892725 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ce2e00-386b-494d-a337-3f1f49bbe966 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:53:03.939866 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4329c4c6-e862-4d3f-ad73-35dc4af03f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:53:03.940330 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329c4c6-e862-4d3f-ad73-35dc4af03f25 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:03.940606 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329c4c6-e862-4d3f-ad73-35dc4af03f25 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:03.941598 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329c4c6-e862-4d3f-ad73-35dc4af03f25 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:03.950956 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4329c4c6-e862-4d3f-ad73-35dc4af03f25 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:53:03.952389 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4329c4c6-e862-4d3f-ad73-35dc4af03f25 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:53:03.966084 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-4329c4c6-e862-4d3f-ad73-35dc4af03f25 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 10:53:03.966084 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:53:03.966084 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:53:03.966084 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:53:03.966084 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:53:03.966084 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:53:03.966084 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:53:03.966084 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:53:03.966084 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:53:03.966084 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:53:03.966084 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:53:03.966084 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:53:03.966084 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 10:53:03.966084 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 10:53:03.966084 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 10:53:03.967197 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 10:53:03.967197 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:53:03.967197 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:53:03.967197 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:53:03.967197 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:53:03.967197 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:53:03.967197 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:53:03.967197 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:53:03.967197 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:53:03.967197 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:53:03.967197 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:53:03.967197 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:53:03.967197 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:53:03.967197 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:53:03.967197 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:53:03.967197 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:53:03.967197 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:53:03.968133 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 10:53:03.968133 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 10:53:03.968133 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 10:53:03.968133 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 10:53:03.968133 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 10:53:03.968133 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 10:53:03.968133 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 10:53:03.968133 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:53:03.968133 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 594/1217] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 18 10:53:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:53:03.974129 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a60d68-85c3-47e5-89d4-f4e7f579fddf None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:53:04.086468 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a60d68-85c3-47e5-89d4-f4e7f579fddf None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:53:04.111252 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:53:04.126351 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb549ccf-4cae-44ed-9c3a-a89355caf613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:53:04.127051 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb549ccf-4cae-44ed-9c3a-a89355caf613 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:04.127413 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb549ccf-4cae-44ed-9c3a-a89355caf613 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:04.127738 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb549ccf-4cae-44ed-9c3a-a89355caf613 None admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:04.128526 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb549ccf-4cae-44ed-9c3a-a89355caf613 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:53:04.128915 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb549ccf-4cae-44ed-9c3a-a89355caf613 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:53:04.130655 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb549ccf-4cae-44ed-9c3a-a89355caf613 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:53:04.148617 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 624/1218] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Aug 18 10:53:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:53:04.154363 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4329c4c6-e862-4d3f-ad73-35dc4af03f25 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:53:04.300773 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4329c4c6-e862-4d3f-ad73-35dc4af03f25 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:53:04.339975 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:53:04.348142 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36923c73-566d-4786-b956-a38b44403978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:53:04.348844 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36923c73-566d-4786-b956-a38b44403978 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:04.349126 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36923c73-566d-4786-b956-a38b44403978 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:04.349400 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36923c73-566d-4786-b956-a38b44403978 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:04.350417 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36923c73-566d-4786-b956-a38b44403978 None admin] RBAC: Adding query filter params (role.id=13bffd536e214d0893b3007e267f3301, scope.project.id=1575e8ebaaab4650995841659b6e631b, user.id=0f918bcdd83d4d48be3fff5a48c54929) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:53:04.350843 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36923c73-566d-4786-b956-a38b44403978 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:53:04.352696 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36923c73-566d-4786-b956-a38b44403978 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:53:04.369548 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 595/1219] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Aug 18 10:53:04 2022] GET /identity/v3/role_assignments?user.id=0f918bcdd83d4d48be3fff5a48c54929&scope.project.id=1575e8ebaaab4650995841659b6e631b&role.id=13bffd536e214d0893b3007e267f3301 => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:53:06.522027 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06092ade-e270-44eb-b383-8938814482b6 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:06.522580 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06092ade-e270-44eb-b383-8938814482b6 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:06.522580 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06092ade-e270-44eb-b383-8938814482b6 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:06.524351 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 625/1220] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:53:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:53:06.530618 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee4a31-156c-4062-badc-73d0fd91b0c5 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:06.531129 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee4a31-156c-4062-badc-73d0fd91b0c5 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:06.531281 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee4a31-156c-4062-badc-73d0fd91b0c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:06.553390 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-24ee4a31-156c-4062-badc-73d0fd91b0c5 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:53:06.554795 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-24ee4a31-156c-4062-badc-73d0fd91b0c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:53:06.631633 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 596/1221] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:53:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 10:53:06.923947 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06092ade-e270-44eb-b383-8938814482b6 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:53:07.045584 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06092ade-e270-44eb-b383-8938814482b6 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:53:07.081167 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c75abd-70d4-448d-b1a6-484c5c1e284c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:53:07.081914 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c75abd-70d4-448d-b1a6-484c5c1e284c None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:07.082186 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c75abd-70d4-448d-b1a6-484c5c1e284c None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:07.082457 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c75abd-70d4-448d-b1a6-484c5c1e284c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:07.092452 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c75abd-70d4-448d-b1a6-484c5c1e284c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:53:07.097697 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-c4c75abd-70d4-448d-b1a6-484c5c1e284c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 10:53:07.097697 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:53:07.097697 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:53:07.097697 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:53:07.097697 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:53:07.097697 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:53:07.097697 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:53:07.097697 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:53:07.097697 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:53:07.097697 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:53:07.097697 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:53:07.097697 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:53:07.097697 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:53:07.097697 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:53:07.097697 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:53:07.097697 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:53:07.098797 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:53:07.098797 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:53:07.098797 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:53:07.098797 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:53:07.098797 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:53:07.098797 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:53:07.098797 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:53:07.098797 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:53:07.098797 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:53:07.098797 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:53:07.098797 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:53:07.098797 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:53:07.098797 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:53:07.098797 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:53:07.098797 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:53:07.098797 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:53:07.099768 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:53:07.099768 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:53:07.099768 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:53:07.099768 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:53:07.099768 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:53:07.099768 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:53:07.099768 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:53:07.099768 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:53:07.099768 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:53:07.099768 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:53:07.099768 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 10:53:07.099768 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:53:07.099768 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 626/1222] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Aug 18 10:53:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:53:07.105315 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ee4a31-156c-4062-badc-73d0fd91b0c5 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:53:07.218551 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ee4a31-156c-4062-badc-73d0fd91b0c5 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:53:07.246488 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:53:07.258660 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded6d399-64a9-445f-b297-fcbe6433bbbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:53:07.259370 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded6d399-64a9-445f-b297-fcbe6433bbbf None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:07.259653 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded6d399-64a9-445f-b297-fcbe6433bbbf None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:07.259928 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded6d399-64a9-445f-b297-fcbe6433bbbf None admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:07.260664 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded6d399-64a9-445f-b297-fcbe6433bbbf None admin] RBAC: Adding query filter params (name=service) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:53:07.261008 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded6d399-64a9-445f-b297-fcbe6433bbbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:53:07.262785 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded6d399-64a9-445f-b297-fcbe6433bbbf None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:53:07.278329 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 597/1223] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Aug 18 10:53:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:53:07.279727 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c75abd-70d4-448d-b1a6-484c5c1e284c None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:53:07.325747 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:53:07.384339 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c75abd-70d4-448d-b1a6-484c5c1e284c None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:53:07.422138 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fa343a-f22c-4c8f-ae31-095f4960dd39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:53:07.422740 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fa343a-f22c-4c8f-ae31-095f4960dd39 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:07.422992 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fa343a-f22c-4c8f-ae31-095f4960dd39 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:07.423266 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fa343a-f22c-4c8f-ae31-095f4960dd39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:07.435031 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fa343a-f22c-4c8f-ae31-095f4960dd39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:53:07.436465 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fa343a-f22c-4c8f-ae31-095f4960dd39 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:53:07.451076 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-69fa343a-f22c-4c8f-ae31-095f4960dd39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:53:07.451076 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:53:07.451076 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:53:07.451076 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:53:07.451076 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:53:07.451076 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:53:07.451076 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:53:07.451076 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:53:07.451076 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:53:07.451076 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:53:07.451076 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:53:07.451076 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:53:07.451076 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 10:53:07.451076 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 10:53:07.451076 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 10:53:07.451076 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 10:53:07.458794 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:53:07.458794 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:53:07.458794 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:53:07.458794 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:53:07.458794 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:53:07.458794 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:53:07.458794 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:53:07.458794 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:53:07.458794 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:53:07.458794 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:53:07.458794 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:53:07.458794 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:53:07.458794 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:53:07.458794 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:53:07.458794 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:53:07.458794 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:53:07.458794 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 10:53:07.459980 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 10:53:07.459980 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:53:07.459980 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:53:07.459980 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 627/1224] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:53:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:53:07.460243 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded6d399-64a9-445f-b297-fcbe6433bbbf None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:53:07.567333 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded6d399-64a9-445f-b297-fcbe6433bbbf None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:53:07.604000 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cff900-7f5d-4898-be34-09c1befd407b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:53:07.604672 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cff900-7f5d-4898-be34-09c1befd407b None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:07.604954 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cff900-7f5d-4898-be34-09c1befd407b None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:07.605290 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cff900-7f5d-4898-be34-09c1befd407b None admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:07.606069 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cff900-7f5d-4898-be34-09c1befd407b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:53:07.606377 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cff900-7f5d-4898-be34-09c1befd407b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:53:07.608022 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cff900-7f5d-4898-be34-09c1befd407b None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:53:07.622097 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 598/1225] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 18 10:53:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:53:07.628149 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fa343a-f22c-4c8f-ae31-095f4960dd39 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:53:07.732377 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:53:07.742030 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fa343a-f22c-4c8f-ae31-095f4960dd39 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:53:07.785247 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a824789d-5cf0-4b0b-a929-3bf9f03890f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:53:07.785920 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a824789d-5cf0-4b0b-a929-3bf9f03890f7 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:07.786429 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a824789d-5cf0-4b0b-a929-3bf9f03890f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:07.786543 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a824789d-5cf0-4b0b-a929-3bf9f03890f7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:07.795293 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a824789d-5cf0-4b0b-a929-3bf9f03890f7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:53:07.796885 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a824789d-5cf0-4b0b-a929-3bf9f03890f7 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:53:07.809834 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-a824789d-5cf0-4b0b-a929-3bf9f03890f7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 18 10:53:07.809834 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:53:07.809834 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:53:07.809834 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:53:07.809834 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:53:07.809834 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:53:07.809834 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:53:07.809834 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:53:07.809834 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:53:07.809834 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:53:07.809834 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:53:07.809834 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:53:07.809834 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 10:53:07.809834 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 10:53:07.809834 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 10:53:07.809834 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 10:53:07.816255 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:53:07.816255 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:53:07.816255 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 10:53:07.816255 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 10:53:07.816255 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 10:53:07.816255 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 10:53:07.816255 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:53:07.816255 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:53:07.816255 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:53:07.816255 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:53:07.816255 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:53:07.816255 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:53:07.816255 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:53:07.816255 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:53:07.816255 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:53:07.816255 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:53:07.816255 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:53:07.816255 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:53:07.817665 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:53:07.817665 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:53:07.817665 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 10:53:07.817665 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 10:53:07.817665 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 10:53:07.817665 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 10:53:07.817665 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 10:53:07.817665 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 10:53:07.817665 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 18 10:53:07.817665 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:53:07.817665 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 628/1226] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:53:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 10:53:07.818635 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cff900-7f5d-4898-be34-09c1befd407b None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:53:07.881894 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:53:07.943650 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cff900-7f5d-4898-be34-09c1befd407b None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:53:07.986545 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc053e4-310a-43a4-b5d9-be28d7ea3e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:53:07.987217 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc053e4-310a-43a4-b5d9-be28d7ea3e3d None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:07.987518 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc053e4-310a-43a4-b5d9-be28d7ea3e3d None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:07.987879 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc053e4-310a-43a4-b5d9-be28d7ea3e3d None admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:07.988533 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc053e4-310a-43a4-b5d9-be28d7ea3e3d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:53:07.988948 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc053e4-310a-43a4-b5d9-be28d7ea3e3d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:53:07.990506 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc053e4-310a-43a4-b5d9-be28d7ea3e3d None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:53:08.010565 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 599/1227] 10.222.0.15 () {56 vars in 1143 bytes} [Thu Aug 18 10:53:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:53:08.017217 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a824789d-5cf0-4b0b-a929-3bf9f03890f7 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:53:08.137700 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a824789d-5cf0-4b0b-a929-3bf9f03890f7 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:53:08.182703 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0171df0-7fc2-4bbe-8cc4-62d457ba80d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:53:08.183489 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0171df0-7fc2-4bbe-8cc4-62d457ba80d6 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:08.183936 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0171df0-7fc2-4bbe-8cc4-62d457ba80d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:08.184212 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0171df0-7fc2-4bbe-8cc4-62d457ba80d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:08.197194 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0171df0-7fc2-4bbe-8cc4-62d457ba80d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:53:08.199285 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0171df0-7fc2-4bbe-8cc4-62d457ba80d6 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:53:08.216507 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-d0171df0-7fc2-4bbe-8cc4-62d457ba80d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:53:08.216507 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:53:08.216507 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:53:08.216507 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:53:08.216507 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:53:08.216507 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:53:08.216507 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:53:08.216507 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:53:08.216507 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:53:08.216507 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:53:08.216507 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:53:08.216507 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:53:08.216507 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 10:53:08.216507 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 10:53:08.216507 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 10:53:08.216507 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 10:53:08.217605 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:53:08.217605 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:53:08.217605 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:53:08.217605 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:53:08.217605 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:53:08.217605 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:53:08.217605 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:53:08.217605 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:53:08.217605 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:53:08.217605 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:53:08.217605 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:53:08.217605 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:53:08.217605 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:53:08.217605 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:53:08.217605 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:53:08.217605 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:53:08.217605 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 10:53:08.222769 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 10:53:08.222769 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:53:08.222769 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:53:08.222769 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 629/1228] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:53:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 10:53:08.224444 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc053e4-310a-43a4-b5d9-be28d7ea3e3d None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:53:08.353903 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc053e4-310a-43a4-b5d9-be28d7ea3e3d None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:53:08.356273 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:53:08.394932 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726d534f-1d41-4ddc-826a-ab9c04fe3ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:53:08.395636 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d534f-1d41-4ddc-826a-ab9c04fe3ad8 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:08.395920 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d534f-1d41-4ddc-826a-ab9c04fe3ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:08.396221 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d534f-1d41-4ddc-826a-ab9c04fe3ad8 None admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:08.396875 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726d534f-1d41-4ddc-826a-ab9c04fe3ad8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:53:08.397184 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726d534f-1d41-4ddc-826a-ab9c04fe3ad8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:53:08.398629 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726d534f-1d41-4ddc-826a-ab9c04fe3ad8 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:53:08.416394 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 600/1229] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 18 10:53:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:53:08.423468 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0171df0-7fc2-4bbe-8cc4-62d457ba80d6 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:53:08.434128 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:53:08.537119 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0171df0-7fc2-4bbe-8cc4-62d457ba80d6 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:53:08.575749 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b995493a-997a-42b9-8adc-a8b87eca2752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:53:08.576369 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b995493a-997a-42b9-8adc-a8b87eca2752 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:08.576644 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b995493a-997a-42b9-8adc-a8b87eca2752 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:08.576908 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b995493a-997a-42b9-8adc-a8b87eca2752 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:08.584107 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b995493a-997a-42b9-8adc-a8b87eca2752 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:53:08.585781 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b995493a-997a-42b9-8adc-a8b87eca2752 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:53:08.598779 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-b995493a-997a-42b9-8adc-a8b87eca2752 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 10:53:08.598779 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:53:08.598779 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:53:08.598779 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:53:08.598779 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:53:08.598779 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:53:08.598779 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:53:08.598779 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:53:08.598779 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:53:08.598779 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:53:08.598779 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:53:08.598779 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:53:08.598779 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 10:53:08.598779 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 10:53:08.598779 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 10:53:08.599794 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 10:53:08.599794 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:53:08.599794 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:53:08.599794 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:53:08.599794 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:53:08.599794 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:53:08.599794 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:53:08.599794 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:53:08.599794 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:53:08.599794 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:53:08.599794 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:53:08.599794 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:53:08.599794 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:53:08.599794 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:53:08.599794 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:53:08.599794 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:53:08.599794 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:53:08.600696 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 10:53:08.600696 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 10:53:08.600696 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 10:53:08.600696 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 10:53:08.600696 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 10:53:08.600696 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 10:53:08.600696 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 10:53:08.600696 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:53:08.600696 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 630/1230] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 18 10:53:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:53:08.606385 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726d534f-1d41-4ddc-826a-ab9c04fe3ad8 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:53:08.716515 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726d534f-1d41-4ddc-826a-ab9c04fe3ad8 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:53:08.764212 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e2fd6b-0ea6-4093-869f-deabfe8f3e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:53:08.764973 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e2fd6b-0ea6-4093-869f-deabfe8f3e3e None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:08.765295 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e2fd6b-0ea6-4093-869f-deabfe8f3e3e None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:08.765607 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e2fd6b-0ea6-4093-869f-deabfe8f3e3e None admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:08.766385 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e2fd6b-0ea6-4093-869f-deabfe8f3e3e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:53:08.766694 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e2fd6b-0ea6-4093-869f-deabfe8f3e3e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:53:08.768127 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e2fd6b-0ea6-4093-869f-deabfe8f3e3e None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:53:08.782158 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 601/1231] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Aug 18 10:53:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:53:08.789372 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b995493a-997a-42b9-8adc-a8b87eca2752 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:53:08.860829 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:53:08.899416 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b995493a-997a-42b9-8adc-a8b87eca2752 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:53:08.937616 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629e5f0b-d5c7-4154-a3b1-4ba8b8b3aad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:53:08.938277 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e5f0b-d5c7-4154-a3b1-4ba8b8b3aad5 None admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:08.938547 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e5f0b-d5c7-4154-a3b1-4ba8b8b3aad5 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:08.938861 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e5f0b-d5c7-4154-a3b1-4ba8b8b3aad5 None admin] PATH_INFO: `/v3/projects/1575e8ebaaab4650995841659b6e631b/users/0f918bcdd83d4d48be3fff5a48c54929/roles/13bffd536e214d0893b3007e267f3301` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:08.954034 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629e5f0b-d5c7-4154-a3b1-4ba8b8b3aad5 None admin] RBAC: Authorizing `identity:create_grant(project_id=1575e8ebaaab4650995841659b6e631b, user_id=0f918bcdd83d4d48be3fff5a48c54929, role_id=13bffd536e214d0893b3007e267f3301)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:53:08.955463 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629e5f0b-d5c7-4154-a3b1-4ba8b8b3aad5 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:53:08.975053 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 631/1232] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Aug 18 10:53:08 2022] PUT /identity/v3/projects/1575e8ebaaab4650995841659b6e631b/users/0f918bcdd83d4d48be3fff5a48c54929/roles/13bffd536e214d0893b3007e267f3301 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 10:53:11.090729 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5004c1-8006-4bc4-a3d3-c445e07c9ffb None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:11.091282 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5004c1-8006-4bc4-a3d3-c445e07c9ffb None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:11.091282 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5004c1-8006-4bc4-a3d3-c445e07c9ffb None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:11.092632 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 602/1233] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:53:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:53:11.098527 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94011f1-5e27-4ef1-adf1-7008aa0e8fa6 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:11.098983 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94011f1-5e27-4ef1-adf1-7008aa0e8fa6 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:11.099075 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94011f1-5e27-4ef1-adf1-7008aa0e8fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:11.116824 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-b94011f1-5e27-4ef1-adf1-7008aa0e8fa6 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:53:11.118076 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-b94011f1-5e27-4ef1-adf1-7008aa0e8fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:53:11.190474 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 632/1234] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:53:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 10:53:11.508985 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5004c1-8006-4bc4-a3d3-c445e07c9ffb None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:53:11.538751 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:53:11.628376 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5004c1-8006-4bc4-a3d3-c445e07c9ffb None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:53:11.665637 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be56163e-5798-4c40-970a-25af1e71d67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:53:11.666267 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56163e-5798-4c40-970a-25af1e71d67b None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:11.666534 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56163e-5798-4c40-970a-25af1e71d67b None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:11.666797 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56163e-5798-4c40-970a-25af1e71d67b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:11.679948 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be56163e-5798-4c40-970a-25af1e71d67b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:53:11.684653 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-be56163e-5798-4c40-970a-25af1e71d67b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 10:53:11.684653 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:53:11.684653 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:53:11.684653 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:53:11.684653 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:53:11.684653 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:53:11.684653 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:53:11.684653 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:53:11.684653 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:53:11.684653 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:53:11.684653 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:53:11.684653 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:53:11.684653 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:53:11.684653 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:53:11.684653 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:53:11.684653 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:53:11.685804 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:53:11.685804 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:53:11.685804 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:53:11.685804 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:53:11.685804 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:53:11.685804 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:53:11.685804 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:53:11.685804 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:53:11.685804 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:53:11.685804 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:53:11.685804 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:53:11.685804 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:53:11.685804 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:53:11.685804 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:53:11.685804 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:53:11.685804 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:53:11.686677 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:53:11.686677 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:53:11.686677 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:53:11.686677 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:53:11.686677 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:53:11.686677 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:53:11.686677 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:53:11.686677 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:53:11.686677 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:53:11.686677 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:53:11.686677 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 10:53:11.686677 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:53:11.686677 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 603/1235] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Aug 18 10:53:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:53:11.692955 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94011f1-5e27-4ef1-adf1-7008aa0e8fa6 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:53:11.742722 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:53:11.805239 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94011f1-5e27-4ef1-adf1-7008aa0e8fa6 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:53:11.841247 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bab717-4444-46d9-af66-3835625fb880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:53:11.841907 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bab717-4444-46d9-af66-3835625fb880 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:11.842190 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bab717-4444-46d9-af66-3835625fb880 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:11.842511 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bab717-4444-46d9-af66-3835625fb880 None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:11.843569 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bab717-4444-46d9-af66-3835625fb880 None admin] RBAC: Adding query filter params (name=service) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:53:11.843911 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bab717-4444-46d9-af66-3835625fb880 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:53:11.845674 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bab717-4444-46d9-af66-3835625fb880 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:53:11.856209 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 633/1236] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Aug 18 10:53:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 10:53:11.862149 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be56163e-5798-4c40-970a-25af1e71d67b None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:53:11.967178 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:53:11.984771 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be56163e-5798-4c40-970a-25af1e71d67b None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:53:12.025881 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c725cdd-4bde-4830-9cef-f31554e01f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:53:12.026520 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c725cdd-4bde-4830-9cef-f31554e01f0d None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:12.026798 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c725cdd-4bde-4830-9cef-f31554e01f0d None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:12.027135 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c725cdd-4bde-4830-9cef-f31554e01f0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:12.038973 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c725cdd-4bde-4830-9cef-f31554e01f0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:53:12.040720 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c725cdd-4bde-4830-9cef-f31554e01f0d None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:53:12.058057 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-6c725cdd-4bde-4830-9cef-f31554e01f0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:53:12.058057 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:53:12.058057 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:53:12.058057 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:53:12.058057 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:53:12.058057 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:53:12.058057 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:53:12.058057 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:53:12.058057 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:53:12.058057 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:53:12.058057 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:53:12.058057 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:53:12.058057 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 10:53:12.058057 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 10:53:12.058057 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 10:53:12.058057 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 10:53:12.059257 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:53:12.059257 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:53:12.059257 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:53:12.059257 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:53:12.059257 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:53:12.059257 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:53:12.059257 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:53:12.059257 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:53:12.059257 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:53:12.059257 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:53:12.059257 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:53:12.059257 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:53:12.059257 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:53:12.059257 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:53:12.059257 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:53:12.059257 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:53:12.059257 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 10:53:12.060311 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 10:53:12.060311 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:53:12.060311 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:53:12.060311 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 604/1237] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:53:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:53:12.066559 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bab717-4444-46d9-af66-3835625fb880 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:53:12.181849 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bab717-4444-46d9-af66-3835625fb880 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:53:12.192701 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:53:12.224191 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dc95b2-9426-4fdd-94c7-38388e9410ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:53:12.224808 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc95b2-9426-4fdd-94c7-38388e9410ca None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:12.225091 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc95b2-9426-4fdd-94c7-38388e9410ca None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:12.225378 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc95b2-9426-4fdd-94c7-38388e9410ca None admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:12.226207 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dc95b2-9426-4fdd-94c7-38388e9410ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:53:12.226543 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dc95b2-9426-4fdd-94c7-38388e9410ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:53:12.228056 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dc95b2-9426-4fdd-94c7-38388e9410ca None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:53:12.242319 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 634/1238] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 18 10:53:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:53:12.248196 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c725cdd-4bde-4830-9cef-f31554e01f0d None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:53:12.359668 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c725cdd-4bde-4830-9cef-f31554e01f0d None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:53:12.395248 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b93ee0-129c-4787-b500-7a113b6be9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:53:12.395905 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b93ee0-129c-4787-b500-7a113b6be9db None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:12.396172 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b93ee0-129c-4787-b500-7a113b6be9db None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:12.396439 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b93ee0-129c-4787-b500-7a113b6be9db None admin] PATH_INFO: `/v3/users/placement` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:12.399902 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:53:12.405738 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b93ee0-129c-4787-b500-7a113b6be9db None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:53:12.407339 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b93ee0-129c-4787-b500-7a113b6be9db None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:53:12.420334 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-a1b93ee0-129c-4787-b500-7a113b6be9db None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 18 10:53:12.420334 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:53:12.420334 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:53:12.420334 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:53:12.420334 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:53:12.420334 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:53:12.420334 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:53:12.420334 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:53:12.420334 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:53:12.420334 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:53:12.420334 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:53:12.420334 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:53:12.420334 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 10:53:12.420334 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 10:53:12.420334 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 10:53:12.420334 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 10:53:12.421402 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:53:12.421402 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:53:12.421402 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 10:53:12.421402 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 10:53:12.421402 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 10:53:12.421402 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 10:53:12.421402 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:53:12.421402 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:53:12.421402 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:53:12.421402 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:53:12.421402 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:53:12.421402 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:53:12.421402 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:53:12.421402 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:53:12.421402 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:53:12.421402 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:53:12.421402 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:53:12.421402 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:53:12.422754 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:53:12.422754 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:53:12.422754 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 10:53:12.422754 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 10:53:12.422754 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 10:53:12.422754 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 10:53:12.422754 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 10:53:12.422754 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 10:53:12.422754 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 18 10:53:12.422754 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:53:12.422754 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 605/1239] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:53:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 10:53:12.427767 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dc95b2-9426-4fdd-94c7-38388e9410ca None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:53:12.543160 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dc95b2-9426-4fdd-94c7-38388e9410ca None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:53:12.582015 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b245d5-a4b9-47bd-a1d7-5ae9513792e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:53:12.582685 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b245d5-a4b9-47bd-a1d7-5ae9513792e9 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:12.582965 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b245d5-a4b9-47bd-a1d7-5ae9513792e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:12.583232 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b245d5-a4b9-47bd-a1d7-5ae9513792e9 None admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:12.584037 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b245d5-a4b9-47bd-a1d7-5ae9513792e9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:53:12.584273 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b245d5-a4b9-47bd-a1d7-5ae9513792e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:53:12.585708 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b245d5-a4b9-47bd-a1d7-5ae9513792e9 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:53:12.604224 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 635/1240] 10.222.0.15 () {56 vars in 1143 bytes} [Thu Aug 18 10:53:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:53:12.610419 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b93ee0-129c-4787-b500-7a113b6be9db None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:53:12.719643 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b93ee0-129c-4787-b500-7a113b6be9db None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:53:12.760802 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d2c63e-efc7-42ed-afde-85b831f4382c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:53:12.761477 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2c63e-efc7-42ed-afde-85b831f4382c None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:12.761882 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2c63e-efc7-42ed-afde-85b831f4382c None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:12.762167 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2c63e-efc7-42ed-afde-85b831f4382c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:12.849355 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:53:12.858085 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d2c63e-efc7-42ed-afde-85b831f4382c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:53:12.860157 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d2c63e-efc7-42ed-afde-85b831f4382c None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:53:12.982944 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 606/1241] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 18 10:53:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 10:53:12.989603 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b245d5-a4b9-47bd-a1d7-5ae9513792e9 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:53:13.020161 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:53:13.102837 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b245d5-a4b9-47bd-a1d7-5ae9513792e9 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:53:13.141089 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d408213-490d-4dae-9c40-9b4b62dbd279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:53:13.142430 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d408213-490d-4dae-9c40-9b4b62dbd279 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:13.142751 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d408213-490d-4dae-9c40-9b4b62dbd279 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:13.143112 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d408213-490d-4dae-9c40-9b4b62dbd279 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:13.159989 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d408213-490d-4dae-9c40-9b4b62dbd279 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:53:13.161895 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d408213-490d-4dae-9c40-9b4b62dbd279 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:53:13.182744 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-3d408213-490d-4dae-9c40-9b4b62dbd279 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:53:13.182744 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:53:13.182744 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:53:13.182744 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:53:13.182744 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:53:13.182744 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:53:13.182744 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:53:13.182744 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:53:13.182744 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:53:13.182744 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:53:13.182744 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:53:13.182744 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:53:13.182744 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 10:53:13.182744 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 10:53:13.182744 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 10:53:13.182744 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 10:53:13.184512 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:53:13.184512 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:53:13.184512 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:53:13.184512 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:53:13.184512 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:53:13.184512 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:53:13.184512 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:53:13.184512 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:53:13.184512 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:53:13.184512 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:53:13.184512 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:53:13.184512 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:53:13.184512 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:53:13.184512 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:53:13.184512 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:53:13.184512 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:53:13.184512 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 10:53:13.185413 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 10:53:13.185413 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:53:13.185413 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:53:13.185413 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 636/1242] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:53:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:53:13.192049 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d2c63e-efc7-42ed-afde-85b831f4382c None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:53:13.300774 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:53:13.307884 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d2c63e-efc7-42ed-afde-85b831f4382c None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:53:13.344169 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed5ab44-33d9-407a-92a7-899be7bc80e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:53:13.344769 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5ab44-33d9-407a-92a7-899be7bc80e1 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:13.345054 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5ab44-33d9-407a-92a7-899be7bc80e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:13.345355 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5ab44-33d9-407a-92a7-899be7bc80e1 None admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:13.346010 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed5ab44-33d9-407a-92a7-899be7bc80e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:53:13.346346 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed5ab44-33d9-407a-92a7-899be7bc80e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:53:13.348413 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed5ab44-33d9-407a-92a7-899be7bc80e1 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:53:13.366272 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 607/1243] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 18 10:53:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:53:13.367581 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d408213-490d-4dae-9c40-9b4b62dbd279 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:53:13.448692 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:53:13.470346 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d408213-490d-4dae-9c40-9b4b62dbd279 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:53:13.506209 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c044a759-7c27-4c34-8cfe-fe4d1a365262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:53:13.506851 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044a759-7c27-4c34-8cfe-fe4d1a365262 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:13.507124 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044a759-7c27-4c34-8cfe-fe4d1a365262 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:13.507396 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044a759-7c27-4c34-8cfe-fe4d1a365262 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:13.514690 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c044a759-7c27-4c34-8cfe-fe4d1a365262 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:53:13.516290 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c044a759-7c27-4c34-8cfe-fe4d1a365262 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:53:13.529933 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-c044a759-7c27-4c34-8cfe-fe4d1a365262 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 10:53:13.529933 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:53:13.529933 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:53:13.529933 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:53:13.529933 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:53:13.529933 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:53:13.529933 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:53:13.529933 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:53:13.529933 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:53:13.529933 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:53:13.529933 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:53:13.529933 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:53:13.529933 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 10:53:13.529933 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 10:53:13.529933 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 10:53:13.531000 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 10:53:13.531000 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:53:13.531000 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:53:13.531000 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:53:13.531000 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:53:13.531000 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:53:13.531000 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:53:13.531000 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:53:13.531000 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:53:13.531000 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:53:13.531000 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:53:13.531000 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:53:13.531000 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:53:13.531000 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:53:13.531000 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:53:13.531000 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:53:13.531000 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:53:13.531906 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 10:53:13.531906 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 10:53:13.531906 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 10:53:13.531906 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 10:53:13.531906 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 10:53:13.531906 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 10:53:13.531906 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 10:53:13.531906 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:53:13.536568 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 637/1244] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 18 10:53:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:53:13.537705 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed5ab44-33d9-407a-92a7-899be7bc80e1 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:53:13.653257 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed5ab44-33d9-407a-92a7-899be7bc80e1 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:53:13.691943 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb18d87c-90e2-4be1-acc7-09d9a8eee0b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:53:13.692572 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb18d87c-90e2-4be1-acc7-09d9a8eee0b6 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:13.692872 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb18d87c-90e2-4be1-acc7-09d9a8eee0b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:13.693148 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb18d87c-90e2-4be1-acc7-09d9a8eee0b6 None admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:13.693883 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb18d87c-90e2-4be1-acc7-09d9a8eee0b6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:53:13.694195 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb18d87c-90e2-4be1-acc7-09d9a8eee0b6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:53:13.695702 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb18d87c-90e2-4be1-acc7-09d9a8eee0b6 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:53:13.714310 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 608/1245] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Aug 18 10:53:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:53:13.720745 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c044a759-7c27-4c34-8cfe-fe4d1a365262 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:53:13.856807 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c044a759-7c27-4c34-8cfe-fe4d1a365262 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:53:13.904354 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd86c39-b9b0-4ced-a7ec-76f18aa52121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:53:13.904901 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd86c39-b9b0-4ced-a7ec-76f18aa52121 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:13.905171 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd86c39-b9b0-4ced-a7ec-76f18aa52121 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:13.905598 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd86c39-b9b0-4ced-a7ec-76f18aa52121 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:13.906457 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd86c39-b9b0-4ced-a7ec-76f18aa52121 None admin] RBAC: Adding query filter params (role.id=13bffd536e214d0893b3007e267f3301, scope.project.id=1575e8ebaaab4650995841659b6e631b, user.id=0f918bcdd83d4d48be3fff5a48c54929) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:53:13.906835 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd86c39-b9b0-4ced-a7ec-76f18aa52121 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:53:13.908393 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd86c39-b9b0-4ced-a7ec-76f18aa52121 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:53:13.916230 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 638/1246] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Aug 18 10:53:13 2022] GET /identity/v3/role_assignments?user.id=0f918bcdd83d4d48be3fff5a48c54929&scope.project.id=1575e8ebaaab4650995841659b6e631b&role.id=13bffd536e214d0893b3007e267f3301 => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:53:16.274355 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955364dd-1c51-4220-a37c-487c646b8c41 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:16.274889 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955364dd-1c51-4220-a37c-487c646b8c41 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:16.274889 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955364dd-1c51-4220-a37c-487c646b8c41 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:16.276807 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 609/1247] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:53:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:53:16.283247 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc069695-888a-4af4-87c7-12c4ab85d0e6 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:16.283779 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc069695-888a-4af4-87c7-12c4ab85d0e6 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:16.283873 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc069695-888a-4af4-87c7-12c4ab85d0e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:16.291120 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:53:16.306844 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-bc069695-888a-4af4-87c7-12c4ab85d0e6 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:53:16.308428 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-bc069695-888a-4af4-87c7-12c4ab85d0e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:53:16.390798 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 639/1248] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:53:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 10:53:16.707730 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955364dd-1c51-4220-a37c-487c646b8c41 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:53:16.731002 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:53:16.846982 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955364dd-1c51-4220-a37c-487c646b8c41 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:53:16.889250 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b8be1c-b751-46a9-8382-cd6aac936ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:53:16.889931 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b8be1c-b751-46a9-8382-cd6aac936ad9 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:16.890274 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b8be1c-b751-46a9-8382-cd6aac936ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:16.890487 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b8be1c-b751-46a9-8382-cd6aac936ad9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:16.902152 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b8be1c-b751-46a9-8382-cd6aac936ad9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:53:16.906903 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-19b8be1c-b751-46a9-8382-cd6aac936ad9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 10:53:16.906903 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:53:16.906903 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:53:16.906903 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:53:16.906903 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:53:16.906903 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:53:16.906903 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:53:16.906903 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:53:16.906903 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:53:16.906903 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:53:16.906903 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:53:16.906903 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:53:16.906903 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:53:16.906903 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:53:16.906903 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:53:16.906903 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:53:16.908171 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:53:16.908171 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:53:16.908171 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:53:16.908171 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:53:16.908171 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:53:16.908171 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:53:16.908171 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:53:16.908171 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:53:16.908171 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:53:16.908171 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:53:16.908171 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:53:16.908171 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:53:16.908171 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:53:16.908171 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:53:16.908171 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:53:16.908171 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:53:16.909615 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:53:16.909615 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:53:16.909615 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:53:16.909615 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:53:16.909615 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:53:16.909615 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:53:16.909615 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:53:16.909615 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:53:16.909615 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:53:16.909615 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:53:16.909615 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 10:53:16.909615 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:53:16.909615 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 610/1249] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Aug 18 10:53:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:53:16.914702 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc069695-888a-4af4-87c7-12c4ab85d0e6 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:53:17.039045 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc069695-888a-4af4-87c7-12c4ab85d0e6 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:53:17.073537 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:53:17.079734 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b040f1e7-f186-426a-9eed-92d3a94bc77f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:53:17.080412 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b040f1e7-f186-426a-9eed-92d3a94bc77f None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:17.080716 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b040f1e7-f186-426a-9eed-92d3a94bc77f None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:17.081047 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b040f1e7-f186-426a-9eed-92d3a94bc77f None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:17.082184 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b040f1e7-f186-426a-9eed-92d3a94bc77f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:53:17.082184 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b040f1e7-f186-426a-9eed-92d3a94bc77f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:53:17.083445 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b040f1e7-f186-426a-9eed-92d3a94bc77f None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:53:17.092872 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 640/1250] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 18 10:53:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:53:17.099072 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b8be1c-b751-46a9-8382-cd6aac936ad9 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:53:17.197181 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:53:17.226767 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b8be1c-b751-46a9-8382-cd6aac936ad9 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:53:17.271493 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f93815e-f3b5-4680-a9e3-bce35c15493e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:53:17.272392 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93815e-f3b5-4680-a9e3-bce35c15493e None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:17.272857 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93815e-f3b5-4680-a9e3-bce35c15493e None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:17.273288 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93815e-f3b5-4680-a9e3-bce35c15493e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:17.288047 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f93815e-f3b5-4680-a9e3-bce35c15493e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:53:17.289832 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f93815e-f3b5-4680-a9e3-bce35c15493e None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:53:17.305828 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-1f93815e-f3b5-4680-a9e3-bce35c15493e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:53:17.305828 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:53:17.305828 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:53:17.305828 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:53:17.305828 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:53:17.305828 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:53:17.305828 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:53:17.305828 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:53:17.305828 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:53:17.305828 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:53:17.305828 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:53:17.305828 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:53:17.305828 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 10:53:17.305828 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 10:53:17.305828 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 10:53:17.305828 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 10:53:17.312165 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:53:17.312165 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:53:17.312165 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:53:17.312165 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:53:17.312165 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:53:17.312165 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:53:17.312165 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:53:17.312165 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:53:17.312165 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:53:17.312165 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:53:17.312165 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:53:17.312165 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:53:17.312165 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:53:17.312165 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:53:17.312165 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:53:17.312165 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:53:17.312165 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 10:53:17.313197 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 10:53:17.313197 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:53:17.313197 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:53:17.313197 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 611/1251] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:53:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:53:17.313425 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b040f1e7-f186-426a-9eed-92d3a94bc77f None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:53:17.429621 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b040f1e7-f186-426a-9eed-92d3a94bc77f None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:53:17.468021 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a866b471-8619-4f30-aa5c-710f5a514f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:53:17.468702 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a866b471-8619-4f30-aa5c-710f5a514f6f None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:17.469042 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a866b471-8619-4f30-aa5c-710f5a514f6f None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:17.469322 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a866b471-8619-4f30-aa5c-710f5a514f6f None admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:17.470138 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a866b471-8619-4f30-aa5c-710f5a514f6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:53:17.470496 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a866b471-8619-4f30-aa5c-710f5a514f6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:53:17.472435 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a866b471-8619-4f30-aa5c-710f5a514f6f None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:53:17.486026 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 641/1252] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 18 10:53:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:53:17.492833 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f93815e-f3b5-4680-a9e3-bce35c15493e None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:53:17.608218 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f93815e-f3b5-4680-a9e3-bce35c15493e None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:53:17.635521 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:53:17.644398 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a583b1-16dd-445a-baeb-1a4762548030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:53:17.645087 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a583b1-16dd-445a-baeb-1a4762548030 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:17.645433 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a583b1-16dd-445a-baeb-1a4762548030 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:17.645706 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a583b1-16dd-445a-baeb-1a4762548030 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:17.654000 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a583b1-16dd-445a-baeb-1a4762548030 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:53:17.655520 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a583b1-16dd-445a-baeb-1a4762548030 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:53:17.668122 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-46a583b1-16dd-445a-baeb-1a4762548030 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 18 10:53:17.668122 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:53:17.668122 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:53:17.668122 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:53:17.668122 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:53:17.668122 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:53:17.668122 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:53:17.668122 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:53:17.668122 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:53:17.668122 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:53:17.668122 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:53:17.668122 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:53:17.668122 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 10:53:17.668122 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 10:53:17.668122 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 10:53:17.668122 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 10:53:17.669318 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:53:17.669318 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:53:17.669318 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 10:53:17.669318 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 10:53:17.669318 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 10:53:17.669318 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 10:53:17.669318 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:53:17.669318 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:53:17.669318 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:53:17.669318 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:53:17.669318 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:53:17.669318 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:53:17.669318 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:53:17.669318 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:53:17.669318 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:53:17.669318 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:53:17.669318 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:53:17.669318 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:53:17.670470 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:53:17.670470 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:53:17.670470 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 10:53:17.670470 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 10:53:17.670470 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 10:53:17.670470 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 10:53:17.670470 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 10:53:17.670470 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 10:53:17.670470 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 18 10:53:17.670470 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:53:17.670470 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 612/1253] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:53:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:53:17.675530 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a866b471-8619-4f30-aa5c-710f5a514f6f None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:53:17.739702 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:53:17.800855 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a866b471-8619-4f30-aa5c-710f5a514f6f None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:53:17.838263 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6186a208-fd31-4d5f-9032-e32b0168a683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:53:17.838883 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6186a208-fd31-4d5f-9032-e32b0168a683 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:17.839169 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6186a208-fd31-4d5f-9032-e32b0168a683 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:17.839449 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6186a208-fd31-4d5f-9032-e32b0168a683 None admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:17.840189 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6186a208-fd31-4d5f-9032-e32b0168a683 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:53:17.840494 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6186a208-fd31-4d5f-9032-e32b0168a683 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:53:17.841959 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6186a208-fd31-4d5f-9032-e32b0168a683 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:53:17.861121 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 642/1254] 10.222.0.15 () {56 vars in 1143 bytes} [Thu Aug 18 10:53:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:53:17.867347 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a583b1-16dd-445a-baeb-1a4762548030 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:53:17.981078 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a583b1-16dd-445a-baeb-1a4762548030 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:53:18.022615 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a80db2-04bd-466b-899b-7165da1bf84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:53:18.023613 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a80db2-04bd-466b-899b-7165da1bf84a None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:18.023851 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a80db2-04bd-466b-899b-7165da1bf84a None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:18.024196 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a80db2-04bd-466b-899b-7165da1bf84a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:18.086154 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:53:18.101205 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a80db2-04bd-466b-899b-7165da1bf84a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:53:18.102846 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a80db2-04bd-466b-899b-7165da1bf84a None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:53:18.226140 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 613/1255] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 18 10:53:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 10:53:18.232105 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6186a208-fd31-4d5f-9032-e32b0168a683 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:53:18.342457 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6186a208-fd31-4d5f-9032-e32b0168a683 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:53:18.357964 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:53:18.384158 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b67158-6214-4b15-b8b6-55bad2ddb391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:53:18.384832 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b67158-6214-4b15-b8b6-55bad2ddb391 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:18.385108 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b67158-6214-4b15-b8b6-55bad2ddb391 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:18.385376 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b67158-6214-4b15-b8b6-55bad2ddb391 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:18.395993 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b67158-6214-4b15-b8b6-55bad2ddb391 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:53:18.397428 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b67158-6214-4b15-b8b6-55bad2ddb391 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:53:18.413696 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-64b67158-6214-4b15-b8b6-55bad2ddb391 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:53:18.413696 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:53:18.413696 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:53:18.413696 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:53:18.413696 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:53:18.413696 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:53:18.413696 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:53:18.413696 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:53:18.413696 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:53:18.413696 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:53:18.413696 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:53:18.413696 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:53:18.413696 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 10:53:18.413696 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 10:53:18.413696 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 10:53:18.413696 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 10:53:18.414904 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:53:18.414904 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:53:18.414904 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:53:18.414904 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:53:18.414904 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:53:18.414904 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:53:18.414904 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:53:18.414904 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:53:18.414904 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:53:18.414904 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:53:18.414904 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:53:18.414904 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:53:18.414904 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:53:18.414904 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:53:18.414904 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:53:18.414904 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:53:18.414904 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 10:53:18.416124 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 10:53:18.416124 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:53:18.416124 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:53:18.416124 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 643/1256] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:53:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 10:53:18.420791 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a80db2-04bd-466b-899b-7165da1bf84a None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:53:18.528135 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:53:18.544111 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a80db2-04bd-466b-899b-7165da1bf84a None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:53:18.584615 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a2a771-e941-4bb1-b033-e42b4385b086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:53:18.585508 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a2a771-e941-4bb1-b033-e42b4385b086 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:18.585796 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a2a771-e941-4bb1-b033-e42b4385b086 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:18.586062 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a2a771-e941-4bb1-b033-e42b4385b086 None admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:18.586736 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a2a771-e941-4bb1-b033-e42b4385b086 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:53:18.587023 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a2a771-e941-4bb1-b033-e42b4385b086 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:53:18.588383 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a2a771-e941-4bb1-b033-e42b4385b086 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:53:18.601087 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 614/1257] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 18 10:53:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:53:18.606924 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b67158-6214-4b15-b8b6-55bad2ddb391 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:53:18.729370 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b67158-6214-4b15-b8b6-55bad2ddb391 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:53:18.776564 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8328ee-dd06-4084-9d76-6d3112e5dee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:53:18.777227 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8328ee-dd06-4084-9d76-6d3112e5dee3 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:18.777564 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8328ee-dd06-4084-9d76-6d3112e5dee3 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:18.777867 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8328ee-dd06-4084-9d76-6d3112e5dee3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:18.786464 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8328ee-dd06-4084-9d76-6d3112e5dee3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:53:18.787887 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8328ee-dd06-4084-9d76-6d3112e5dee3 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:53:18.800592 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-3c8328ee-dd06-4084-9d76-6d3112e5dee3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 10:53:18.800592 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:53:18.800592 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:53:18.800592 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:53:18.800592 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:53:18.800592 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:53:18.800592 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:53:18.800592 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:53:18.800592 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:53:18.800592 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:53:18.800592 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:53:18.800592 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:53:18.800592 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 10:53:18.800592 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 10:53:18.800592 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 10:53:18.802026 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 10:53:18.802026 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:53:18.802026 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:53:18.802026 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:53:18.802026 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:53:18.802026 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:53:18.802026 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:53:18.802026 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:53:18.802026 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:53:18.802026 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:53:18.802026 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:53:18.802026 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:53:18.802026 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:53:18.802026 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:53:18.802026 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:53:18.802026 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:53:18.802026 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:53:18.802927 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 10:53:18.802927 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 10:53:18.802927 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 10:53:18.802927 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 10:53:18.802927 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 10:53:18.802927 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 10:53:18.802927 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 10:53:18.802927 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:53:18.802927 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 644/1258] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 18 10:53:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:53:18.808115 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a2a771-e941-4bb1-b033-e42b4385b086 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:53:18.923727 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a2a771-e941-4bb1-b033-e42b4385b086 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:53:18.961527 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba4bb97-f05e-4d56-babe-c2bb145ef95e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:53:18.962308 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba4bb97-f05e-4d56-babe-c2bb145ef95e None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:18.962569 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba4bb97-f05e-4d56-babe-c2bb145ef95e None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:18.962891 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba4bb97-f05e-4d56-babe-c2bb145ef95e None admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:18.963986 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba4bb97-f05e-4d56-babe-c2bb145ef95e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:53:18.964286 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba4bb97-f05e-4d56-babe-c2bb145ef95e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:53:18.965798 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba4bb97-f05e-4d56-babe-c2bb145ef95e None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:53:18.983495 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 615/1259] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Aug 18 10:53:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:53:18.991253 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8328ee-dd06-4084-9d76-6d3112e5dee3 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:53:19.020158 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:53:19.124289 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8328ee-dd06-4084-9d76-6d3112e5dee3 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:53:19.161788 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01540e27-c8f1-4e1a-b26b-c24348543fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:53:19.162391 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01540e27-c8f1-4e1a-b26b-c24348543fe7 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:19.162665 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01540e27-c8f1-4e1a-b26b-c24348543fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:19.162932 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01540e27-c8f1-4e1a-b26b-c24348543fe7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:19.163663 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01540e27-c8f1-4e1a-b26b-c24348543fe7 None admin] RBAC: Adding query filter params (role.id=127fdc7ef05b4e0b98a940b334e5fcab, scope.project.id=1575e8ebaaab4650995841659b6e631b, user.id=0f918bcdd83d4d48be3fff5a48c54929) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:53:19.163966 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01540e27-c8f1-4e1a-b26b-c24348543fe7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:53:19.165414 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01540e27-c8f1-4e1a-b26b-c24348543fe7 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:53:19.171606 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 645/1260] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Aug 18 10:53:18 2022] GET /identity/v3/role_assignments?user.id=0f918bcdd83d4d48be3fff5a48c54929&scope.project.id=1575e8ebaaab4650995841659b6e631b&role.id=127fdc7ef05b4e0b98a940b334e5fcab => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:53:21.199081 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4503c226-9026-4706-b012-63f61e0d9ffa None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:21.199676 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4503c226-9026-4706-b012-63f61e0d9ffa None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:21.199676 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4503c226-9026-4706-b012-63f61e0d9ffa None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:21.200974 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 616/1261] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:53:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:53:21.206520 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a11822-7c57-40ed-b7b5-f5ed99ac582e None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:21.207033 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a11822-7c57-40ed-b7b5-f5ed99ac582e None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:21.207129 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a11822-7c57-40ed-b7b5-f5ed99ac582e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:21.225654 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-b7a11822-7c57-40ed-b7b5-f5ed99ac582e None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:53:21.226844 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-b7a11822-7c57-40ed-b7b5-f5ed99ac582e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:53:21.295014 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 646/1262] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:53:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 10:53:21.578205 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4503c226-9026-4706-b012-63f61e0d9ffa None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:53:21.590109 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:53:21.681775 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4503c226-9026-4706-b012-63f61e0d9ffa None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:53:21.715719 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3694af1b-feb4-46a8-a057-79eff22ffa5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:53:21.716341 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3694af1b-feb4-46a8-a057-79eff22ffa5d None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:21.716614 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3694af1b-feb4-46a8-a057-79eff22ffa5d None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:21.716880 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3694af1b-feb4-46a8-a057-79eff22ffa5d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:21.727380 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3694af1b-feb4-46a8-a057-79eff22ffa5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:53:21.731960 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-3694af1b-feb4-46a8-a057-79eff22ffa5d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 10:53:21.731960 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:53:21.731960 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:53:21.731960 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:53:21.731960 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:53:21.731960 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:53:21.731960 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:53:21.731960 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:53:21.731960 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:53:21.731960 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:53:21.731960 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:53:21.731960 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:53:21.731960 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:53:21.731960 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:53:21.731960 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:53:21.731960 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:53:21.733232 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:53:21.733232 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:53:21.733232 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:53:21.733232 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:53:21.733232 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:53:21.733232 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:53:21.733232 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:53:21.733232 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:53:21.733232 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:53:21.733232 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:53:21.733232 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:53:21.733232 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:53:21.733232 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:53:21.733232 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:53:21.733232 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:53:21.733232 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:53:21.734390 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:53:21.734390 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:53:21.734390 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:53:21.734390 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:53:21.734390 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:53:21.734390 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:53:21.734390 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:53:21.734390 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:53:21.734390 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:53:21.734390 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:53:21.734390 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 10:53:21.734390 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:53:21.734390 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 617/1263] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Aug 18 10:53:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:53:21.740594 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a11822-7c57-40ed-b7b5-f5ed99ac582e None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:53:21.760497 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:53:21.851708 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a11822-7c57-40ed-b7b5-f5ed99ac582e None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:53:21.884765 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7ae478-51c3-49c0-bdd1-8af73ca3b4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:53:21.885364 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ae478-51c3-49c0-bdd1-8af73ca3b4d6 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:21.885827 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ae478-51c3-49c0-bdd1-8af73ca3b4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:21.886110 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ae478-51c3-49c0-bdd1-8af73ca3b4d6 None admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:21.886769 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7ae478-51c3-49c0-bdd1-8af73ca3b4d6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:53:21.887071 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7ae478-51c3-49c0-bdd1-8af73ca3b4d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:53:21.888428 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7ae478-51c3-49c0-bdd1-8af73ca3b4d6 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:53:21.897190 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 647/1264] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 18 10:53:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:53:21.903548 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3694af1b-feb4-46a8-a057-79eff22ffa5d None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:53:21.973496 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:53:22.007945 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3694af1b-feb4-46a8-a057-79eff22ffa5d None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:53:22.041787 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ce9d68-29de-4f05-9078-ebe2daaacb8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:53:22.042406 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce9d68-29de-4f05-9078-ebe2daaacb8e None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:22.042688 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce9d68-29de-4f05-9078-ebe2daaacb8e None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:22.042964 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce9d68-29de-4f05-9078-ebe2daaacb8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:22.055116 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ce9d68-29de-4f05-9078-ebe2daaacb8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:53:22.056581 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ce9d68-29de-4f05-9078-ebe2daaacb8e None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:53:22.072458 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-e5ce9d68-29de-4f05-9078-ebe2daaacb8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:53:22.072458 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:53:22.072458 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:53:22.072458 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:53:22.072458 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:53:22.072458 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:53:22.072458 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:53:22.072458 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:53:22.072458 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:53:22.072458 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:53:22.072458 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:53:22.072458 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:53:22.072458 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 10:53:22.072458 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 10:53:22.072458 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 10:53:22.072458 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 10:53:22.073727 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:53:22.073727 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:53:22.073727 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:53:22.073727 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:53:22.073727 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:53:22.073727 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:53:22.073727 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:53:22.073727 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:53:22.073727 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:53:22.073727 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:53:22.073727 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:53:22.073727 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:53:22.073727 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:53:22.073727 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:53:22.073727 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:53:22.073727 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:53:22.073727 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 10:53:22.074806 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 10:53:22.074806 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:53:22.074806 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:53:22.074806 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 618/1265] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:53:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:53:22.079467 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7ae478-51c3-49c0-bdd1-8af73ca3b4d6 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:53:22.159853 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:53:22.179205 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7ae478-51c3-49c0-bdd1-8af73ca3b4d6 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:53:22.212238 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5d8f0e-59eb-448b-b007-28c7ca330345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:53:22.212835 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d8f0e-59eb-448b-b007-28c7ca330345 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:22.213108 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d8f0e-59eb-448b-b007-28c7ca330345 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:22.213376 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d8f0e-59eb-448b-b007-28c7ca330345 None admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:22.214048 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5d8f0e-59eb-448b-b007-28c7ca330345 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:53:22.214340 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5d8f0e-59eb-448b-b007-28c7ca330345 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:53:22.215693 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5d8f0e-59eb-448b-b007-28c7ca330345 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:53:22.227331 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 648/1266] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 18 10:53:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:53:22.233014 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ce9d68-29de-4f05-9078-ebe2daaacb8e None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:53:22.332859 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ce9d68-29de-4f05-9078-ebe2daaacb8e None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:53:22.352097 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:53:22.366736 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3335f8a6-e8ee-4542-ab22-c4b7d936bf77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:53:22.367355 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3335f8a6-e8ee-4542-ab22-c4b7d936bf77 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:22.367634 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3335f8a6-e8ee-4542-ab22-c4b7d936bf77 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:22.367905 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3335f8a6-e8ee-4542-ab22-c4b7d936bf77 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:22.376054 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3335f8a6-e8ee-4542-ab22-c4b7d936bf77 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:53:22.377479 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3335f8a6-e8ee-4542-ab22-c4b7d936bf77 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:53:22.389041 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-3335f8a6-e8ee-4542-ab22-c4b7d936bf77 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 18 10:53:22.389041 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:53:22.389041 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:53:22.389041 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:53:22.389041 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:53:22.389041 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:53:22.389041 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:53:22.389041 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:53:22.389041 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:53:22.389041 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:53:22.389041 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:53:22.389041 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:53:22.389041 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 10:53:22.389041 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 10:53:22.389041 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 10:53:22.389041 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 10:53:22.390218 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:53:22.390218 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:53:22.390218 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 10:53:22.390218 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 10:53:22.390218 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 10:53:22.390218 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 10:53:22.390218 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:53:22.390218 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:53:22.390218 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:53:22.390218 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:53:22.390218 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:53:22.390218 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:53:22.390218 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:53:22.390218 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:53:22.390218 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:53:22.390218 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:53:22.390218 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:53:22.390218 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:53:22.391305 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:53:22.391305 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:53:22.391305 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 10:53:22.391305 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 10:53:22.391305 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 10:53:22.391305 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 10:53:22.391305 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 10:53:22.391305 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 10:53:22.391305 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 18 10:53:22.391305 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:53:22.391305 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 619/1267] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:53:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:53:22.398507 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5d8f0e-59eb-448b-b007-28c7ca330345 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:53:22.497934 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5d8f0e-59eb-448b-b007-28c7ca330345 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:53:22.531333 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753914d3-7ed9-4d1f-ba7e-004d09e53cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:53:22.531925 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753914d3-7ed9-4d1f-ba7e-004d09e53cf9 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:22.532204 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753914d3-7ed9-4d1f-ba7e-004d09e53cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:22.532475 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753914d3-7ed9-4d1f-ba7e-004d09e53cf9 None admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:22.533193 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753914d3-7ed9-4d1f-ba7e-004d09e53cf9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:53:22.533495 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753914d3-7ed9-4d1f-ba7e-004d09e53cf9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:53:22.535809 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753914d3-7ed9-4d1f-ba7e-004d09e53cf9 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:53:22.544381 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:53:22.554030 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 649/1268] 10.222.0.15 () {56 vars in 1143 bytes} [Thu Aug 18 10:53:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:53:22.559798 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3335f8a6-e8ee-4542-ab22-c4b7d936bf77 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:53:22.658172 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3335f8a6-e8ee-4542-ab22-c4b7d936bf77 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:53:22.692178 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823f9663-74b3-4e75-8b6f-e0a608c0660d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:53:22.692775 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f9663-74b3-4e75-8b6f-e0a608c0660d None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:22.693055 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f9663-74b3-4e75-8b6f-e0a608c0660d None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:22.693329 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f9663-74b3-4e75-8b6f-e0a608c0660d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:22.703691 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823f9663-74b3-4e75-8b6f-e0a608c0660d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:53:22.705119 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823f9663-74b3-4e75-8b6f-e0a608c0660d None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:53:22.719184 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-823f9663-74b3-4e75-8b6f-e0a608c0660d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:53:22.719184 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:53:22.719184 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:53:22.719184 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:53:22.719184 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:53:22.719184 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:53:22.719184 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:53:22.719184 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:53:22.719184 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:53:22.719184 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:53:22.719184 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:53:22.719184 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:53:22.719184 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 10:53:22.719184 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 10:53:22.719184 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 10:53:22.719184 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 10:53:22.720232 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:53:22.720232 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:53:22.720232 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:53:22.720232 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:53:22.720232 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:53:22.720232 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:53:22.720232 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:53:22.720232 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:53:22.720232 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:53:22.720232 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:53:22.720232 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:53:22.720232 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:53:22.720232 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:53:22.720232 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:53:22.720232 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:53:22.720232 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:53:22.720232 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 10:53:22.721143 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 10:53:22.721143 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:53:22.721143 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:53:22.721143 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 620/1269] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:53:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:53:22.726763 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753914d3-7ed9-4d1f-ba7e-004d09e53cf9 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:53:22.831666 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753914d3-7ed9-4d1f-ba7e-004d09e53cf9 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:53:22.865048 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c252cc2-2a97-4b74-b02c-69c70d4e71a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:53:22.865677 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c252cc2-2a97-4b74-b02c-69c70d4e71a6 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:22.865954 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c252cc2-2a97-4b74-b02c-69c70d4e71a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:22.866223 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c252cc2-2a97-4b74-b02c-69c70d4e71a6 None admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:22.866855 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c252cc2-2a97-4b74-b02c-69c70d4e71a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:53:22.867153 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c252cc2-2a97-4b74-b02c-69c70d4e71a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:53:22.868511 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c252cc2-2a97-4b74-b02c-69c70d4e71a6 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:53:22.879389 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 650/1270] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 18 10:53:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:53:22.885337 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823f9663-74b3-4e75-8b6f-e0a608c0660d None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:53:22.919932 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:53:22.990041 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823f9663-74b3-4e75-8b6f-e0a608c0660d None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:53:23.023521 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6142611-2c46-46bb-8c35-257511cf8a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:53:23.024148 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6142611-2c46-46bb-8c35-257511cf8a37 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:23.024426 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6142611-2c46-46bb-8c35-257511cf8a37 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:23.024699 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6142611-2c46-46bb-8c35-257511cf8a37 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:23.031514 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6142611-2c46-46bb-8c35-257511cf8a37 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:53:23.032947 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6142611-2c46-46bb-8c35-257511cf8a37 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:53:23.044519 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-b6142611-2c46-46bb-8c35-257511cf8a37 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 10:53:23.044519 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:53:23.044519 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:53:23.044519 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:53:23.044519 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:53:23.044519 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:53:23.044519 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:53:23.044519 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:53:23.044519 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:53:23.044519 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:53:23.044519 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:53:23.044519 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:53:23.044519 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 10:53:23.044519 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 10:53:23.044519 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 10:53:23.045582 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 10:53:23.045582 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:53:23.045582 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:53:23.045582 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:53:23.045582 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:53:23.045582 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:53:23.045582 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:53:23.045582 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:53:23.045582 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:53:23.045582 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:53:23.045582 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:53:23.045582 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:53:23.045582 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:53:23.045582 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:53:23.045582 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:53:23.045582 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:53:23.045582 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:53:23.046699 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 10:53:23.046699 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 10:53:23.046699 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 10:53:23.046699 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 10:53:23.046699 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 10:53:23.046699 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 10:53:23.046699 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 10:53:23.046699 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:53:23.046699 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 621/1271] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 18 10:53:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:53:23.051659 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c252cc2-2a97-4b74-b02c-69c70d4e71a6 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:53:23.109072 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:53:23.151626 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c252cc2-2a97-4b74-b02c-69c70d4e71a6 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:53:23.186935 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd2c985-ed87-4d9c-ace6-d208ebc9b455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:53:23.187542 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd2c985-ed87-4d9c-ace6-d208ebc9b455 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:23.187823 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd2c985-ed87-4d9c-ace6-d208ebc9b455 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:23.188096 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd2c985-ed87-4d9c-ace6-d208ebc9b455 None admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:23.188780 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd2c985-ed87-4d9c-ace6-d208ebc9b455 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:53:23.189086 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd2c985-ed87-4d9c-ace6-d208ebc9b455 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:53:23.191708 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd2c985-ed87-4d9c-ace6-d208ebc9b455 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:53:23.203727 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 651/1272] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Aug 18 10:53:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:53:23.210383 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6142611-2c46-46bb-8c35-257511cf8a37 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:53:23.301741 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:53:23.311613 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6142611-2c46-46bb-8c35-257511cf8a37 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:53:23.345480 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017c2575-ce07-4ba3-ba7b-74d5c229f07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:53:23.346152 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017c2575-ce07-4ba3-ba7b-74d5c229f07b None admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:23.346432 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017c2575-ce07-4ba3-ba7b-74d5c229f07b None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:23.346734 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017c2575-ce07-4ba3-ba7b-74d5c229f07b None admin] PATH_INFO: `/v3/projects/1575e8ebaaab4650995841659b6e631b/users/0f918bcdd83d4d48be3fff5a48c54929/roles/127fdc7ef05b4e0b98a940b334e5fcab` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:23.348630 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017c2575-ce07-4ba3-ba7b-74d5c229f07b None admin] RBAC: Authorizing `identity:create_grant(project_id=1575e8ebaaab4650995841659b6e631b, user_id=0f918bcdd83d4d48be3fff5a48c54929, role_id=127fdc7ef05b4e0b98a940b334e5fcab)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:53:23.350089 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017c2575-ce07-4ba3-ba7b-74d5c229f07b None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:53:23.363655 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 622/1273] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Aug 18 10:53:23 2022] PUT /identity/v3/projects/1575e8ebaaab4650995841659b6e631b/users/0f918bcdd83d4d48be3fff5a48c54929/roles/127fdc7ef05b4e0b98a940b334e5fcab => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 10:53:25.268777 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e3d3b2-96b4-43ac-b332-06ab353ddb99 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:25.269478 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e3d3b2-96b4-43ac-b332-06ab353ddb99 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:25.269478 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e3d3b2-96b4-43ac-b332-06ab353ddb99 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:25.270591 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 652/1274] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:53:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:53:25.284515 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c6c9e3-241a-489c-ba79-c8a6af9cd41e None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:25.285010 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c6c9e3-241a-489c-ba79-c8a6af9cd41e None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:25.285274 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c6c9e3-241a-489c-ba79-c8a6af9cd41e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:25.306315 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-83c6c9e3-241a-489c-ba79-c8a6af9cd41e None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:53:25.307507 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-83c6c9e3-241a-489c-ba79-c8a6af9cd41e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:53:25.374283 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 623/1275] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:53:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 10:53:25.644245 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e3d3b2-96b4-43ac-b332-06ab353ddb99 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:53:25.748122 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e3d3b2-96b4-43ac-b332-06ab353ddb99 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:53:25.767939 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:53:25.798118 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6f7b30-9139-46dd-bf46-43bdf4a940d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:53:25.798892 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f7b30-9139-46dd-bf46-43bdf4a940d7 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:25.799217 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f7b30-9139-46dd-bf46-43bdf4a940d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:25.799728 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f7b30-9139-46dd-bf46-43bdf4a940d7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:25.811570 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6f7b30-9139-46dd-bf46-43bdf4a940d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 10:53:25.816190 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-cf6f7b30-9139-46dd-bf46-43bdf4a940d7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 10:53:25.816190 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:53:25.816190 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:53:25.816190 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:53:25.816190 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:53:25.816190 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:53:25.816190 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:53:25.816190 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:53:25.816190 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:53:25.816190 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:53:25.816190 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:53:25.816190 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:53:25.816190 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 10:53:25.816190 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 10:53:25.816190 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 10:53:25.816190 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 10:53:25.817299 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 10:53:25.817299 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 10:53:25.817299 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 10:53:25.817299 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 10:53:25.817299 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:53:25.817299 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:53:25.817299 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:53:25.817299 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:53:25.817299 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:53:25.817299 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:53:25.817299 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:53:25.817299 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:53:25.817299 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:53:25.817299 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:53:25.817299 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:53:25.817299 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:53:25.818281 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:53:25.818281 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:53:25.818281 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:53:25.818281 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:53:25.818281 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 10:53:25.818281 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 10:53:25.818281 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 10:53:25.818281 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 10:53:25.818281 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 10:53:25.818281 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 10:53:25.818281 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 10:53:25.818281 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:53:25.818281 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 653/1276] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Aug 18 10:53:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:53:25.823406 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c6c9e3-241a-489c-ba79-c8a6af9cd41e None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:53:25.906969 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:53:25.931668 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c6c9e3-241a-489c-ba79-c8a6af9cd41e None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:53:25.968335 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b857bbb-505e-47f2-b3f5-c61e16cc8eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:53:25.968941 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b857bbb-505e-47f2-b3f5-c61e16cc8eeb None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:25.969230 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b857bbb-505e-47f2-b3f5-c61e16cc8eeb None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:25.969496 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b857bbb-505e-47f2-b3f5-c61e16cc8eeb None admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:25.970188 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b857bbb-505e-47f2-b3f5-c61e16cc8eeb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:53:25.970489 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b857bbb-505e-47f2-b3f5-c61e16cc8eeb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:53:25.972607 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b857bbb-505e-47f2-b3f5-c61e16cc8eeb None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:53:25.980611 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 624/1277] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 18 10:53:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:53:25.986443 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6f7b30-9139-46dd-bf46-43bdf4a940d7 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:53:26.088220 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6f7b30-9139-46dd-bf46-43bdf4a940d7 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:53:26.122526 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21845d38-6849-4a34-9b0d-17338897da28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:53:26.123148 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21845d38-6849-4a34-9b0d-17338897da28 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:26.123428 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21845d38-6849-4a34-9b0d-17338897da28 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:26.123699 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21845d38-6849-4a34-9b0d-17338897da28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:26.135004 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21845d38-6849-4a34-9b0d-17338897da28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:53:26.136437 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21845d38-6849-4a34-9b0d-17338897da28 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:53:26.151439 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-21845d38-6849-4a34-9b0d-17338897da28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:53:26.151439 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:53:26.151439 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:53:26.151439 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:53:26.151439 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:53:26.151439 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:53:26.151439 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:53:26.151439 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:53:26.151439 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:53:26.151439 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:53:26.151439 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:53:26.151439 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:53:26.151439 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 10:53:26.151439 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 10:53:26.151439 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 10:53:26.151439 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 10:53:26.152521 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:53:26.152521 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:53:26.152521 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:53:26.152521 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:53:26.152521 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:53:26.152521 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:53:26.152521 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:53:26.152521 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:53:26.152521 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:53:26.152521 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:53:26.152521 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:53:26.152521 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:53:26.152521 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:53:26.152521 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:53:26.152521 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:53:26.152521 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:53:26.152521 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 10:53:26.153816 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 10:53:26.153816 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:53:26.153816 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:53:26.153816 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 654/1278] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:53:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:53:26.158614 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b857bbb-505e-47f2-b3f5-c61e16cc8eeb None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:53:26.258395 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b857bbb-505e-47f2-b3f5-c61e16cc8eeb None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:53:26.292684 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c149b80b-c621-49f7-b479-b6bbdc884db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:53:26.293292 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c149b80b-c621-49f7-b479-b6bbdc884db8 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:26.293580 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c149b80b-c621-49f7-b479-b6bbdc884db8 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:26.293858 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c149b80b-c621-49f7-b479-b6bbdc884db8 None admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:26.294494 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c149b80b-c621-49f7-b479-b6bbdc884db8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:53:26.294798 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c149b80b-c621-49f7-b479-b6bbdc884db8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:53:26.296160 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c149b80b-c621-49f7-b479-b6bbdc884db8 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:53:26.308391 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 625/1279] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 18 10:53:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:53:26.314151 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21845d38-6849-4a34-9b0d-17338897da28 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:53:26.344809 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:53:26.412510 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21845d38-6849-4a34-9b0d-17338897da28 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:53:26.445245 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f402110-3c21-4687-bccd-700755596982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:53:26.445897 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f402110-3c21-4687-bccd-700755596982 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:26.446174 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f402110-3c21-4687-bccd-700755596982 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:26.446444 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f402110-3c21-4687-bccd-700755596982 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:26.453664 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f402110-3c21-4687-bccd-700755596982 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:53:26.455096 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f402110-3c21-4687-bccd-700755596982 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:53:26.466418 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-7f402110-3c21-4687-bccd-700755596982 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 18 10:53:26.466418 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:53:26.466418 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:53:26.466418 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:53:26.466418 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:53:26.466418 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:53:26.466418 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:53:26.466418 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:53:26.466418 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:53:26.466418 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:53:26.466418 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:53:26.466418 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:53:26.466418 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 10:53:26.466418 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 10:53:26.466418 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 10:53:26.466418 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 10:53:26.467558 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:53:26.467558 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:53:26.467558 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 10:53:26.467558 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 10:53:26.467558 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 10:53:26.467558 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 10:53:26.467558 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:53:26.467558 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:53:26.467558 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:53:26.467558 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:53:26.467558 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:53:26.467558 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:53:26.467558 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:53:26.467558 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:53:26.467558 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:53:26.467558 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:53:26.467558 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:53:26.467558 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:53:26.468720 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:53:26.468720 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:53:26.468720 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 10:53:26.468720 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 10:53:26.468720 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 10:53:26.468720 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 10:53:26.468720 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 10:53:26.468720 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 10:53:26.468720 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 18 10:53:26.468720 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:53:26.468720 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 655/1280] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:53:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:53:26.473586 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c149b80b-c621-49f7-b479-b6bbdc884db8 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:53:26.477322 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:53:26.573464 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c149b80b-c621-49f7-b479-b6bbdc884db8 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:53:26.607212 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13593bd4-0f17-4229-8a4b-06b5c75c6157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:53:26.607807 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13593bd4-0f17-4229-8a4b-06b5c75c6157 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:26.608088 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13593bd4-0f17-4229-8a4b-06b5c75c6157 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:26.608361 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13593bd4-0f17-4229-8a4b-06b5c75c6157 None admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:26.609085 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13593bd4-0f17-4229-8a4b-06b5c75c6157 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:53:26.609389 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13593bd4-0f17-4229-8a4b-06b5c75c6157 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:53:26.610846 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13593bd4-0f17-4229-8a4b-06b5c75c6157 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:53:26.629818 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 626/1281] 10.222.0.15 () {56 vars in 1143 bytes} [Thu Aug 18 10:53:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:53:26.635432 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f402110-3c21-4687-bccd-700755596982 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:53:26.724289 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:53:26.734876 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f402110-3c21-4687-bccd-700755596982 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:53:26.774073 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af0a2ca-21ed-4936-826a-1d3ccac7511a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:53:26.774679 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af0a2ca-21ed-4936-826a-1d3ccac7511a None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:26.774959 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af0a2ca-21ed-4936-826a-1d3ccac7511a None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:26.775240 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af0a2ca-21ed-4936-826a-1d3ccac7511a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:26.842507 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af0a2ca-21ed-4936-826a-1d3ccac7511a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:53:26.843942 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af0a2ca-21ed-4936-826a-1d3ccac7511a None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:53:26.931849 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:53:26.942583 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 656/1282] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 18 10:53:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 18 10:53:26.948707 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13593bd4-0f17-4229-8a4b-06b5c75c6157 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:53:27.014626 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:53:27.054144 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13593bd4-0f17-4229-8a4b-06b5c75c6157 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:53:27.088318 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a96289-10ab-45f1-a99e-37413e93950c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:53:27.088944 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a96289-10ab-45f1-a99e-37413e93950c None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:27.089216 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a96289-10ab-45f1-a99e-37413e93950c None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:27.089483 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a96289-10ab-45f1-a99e-37413e93950c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:27.100055 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a96289-10ab-45f1-a99e-37413e93950c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:53:27.101482 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a96289-10ab-45f1-a99e-37413e93950c None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:53:27.116168 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-c0a96289-10ab-45f1-a99e-37413e93950c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:53:27.116168 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:53:27.116168 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:53:27.116168 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:53:27.116168 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:53:27.116168 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:53:27.116168 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:53:27.116168 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:53:27.116168 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:53:27.116168 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:53:27.116168 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:53:27.116168 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:53:27.116168 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 10:53:27.116168 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 10:53:27.116168 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 10:53:27.116168 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 10:53:27.117322 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:53:27.117322 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:53:27.117322 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:53:27.117322 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:53:27.117322 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:53:27.117322 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:53:27.117322 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:53:27.117322 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:53:27.117322 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:53:27.117322 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:53:27.117322 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:53:27.117322 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:53:27.117322 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:53:27.117322 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:53:27.117322 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:53:27.117322 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:53:27.117322 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 10:53:27.118563 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 10:53:27.118563 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 10:53:27.118563 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:53:27.118563 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 627/1283] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:53:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:53:27.124769 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af0a2ca-21ed-4936-826a-1d3ccac7511a None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:53:27.226938 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af0a2ca-21ed-4936-826a-1d3ccac7511a None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:53:27.262068 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c263194-be44-4886-aeed-d6c8a91159be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:53:27.262675 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c263194-be44-4886-aeed-d6c8a91159be None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:27.262956 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c263194-be44-4886-aeed-d6c8a91159be None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:27.263230 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c263194-be44-4886-aeed-d6c8a91159be None admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:27.263877 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c263194-be44-4886-aeed-d6c8a91159be None admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:53:27.264176 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c263194-be44-4886-aeed-d6c8a91159be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:53:27.265673 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c263194-be44-4886-aeed-d6c8a91159be None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:53:27.280205 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 657/1284] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 18 10:53:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:53:27.287211 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a96289-10ab-45f1-a99e-37413e93950c None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:53:27.390669 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a96289-10ab-45f1-a99e-37413e93950c None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:53:27.406461 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:53:27.427649 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cdc6b4-3c4c-44fd-90be-1f85971541fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:53:27.428266 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cdc6b4-3c4c-44fd-90be-1f85971541fc None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:27.428541 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cdc6b4-3c4c-44fd-90be-1f85971541fc None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:27.428813 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cdc6b4-3c4c-44fd-90be-1f85971541fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:27.435564 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cdc6b4-3c4c-44fd-90be-1f85971541fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:53:27.436989 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cdc6b4-3c4c-44fd-90be-1f85971541fc None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:53:27.450459 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application [None req-08cdc6b4-3c4c-44fd-90be-1f85971541fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 10:53:27.450459 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:53:27.450459 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:53:27.450459 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:53:27.450459 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:53:27.450459 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:53:27.450459 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:53:27.450459 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:53:27.450459 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:53:27.450459 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:53:27.450459 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:53:27.450459 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:53:27.450459 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 10:53:27.450459 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 10:53:27.450459 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 10:53:27.451567 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 10:53:27.451567 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:53:27.451567 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:53:27.451567 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:53:27.451567 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:53:27.451567 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:53:27.451567 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:53:27.451567 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:53:27.451567 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application with Lock( Aug 18 10:53:27.451567 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:53:27.451567 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:53:27.451567 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:53:27.451567 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:53:27.451567 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:53:27.451567 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:53:27.451567 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:53:27.451567 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:53:27.452731 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 10:53:27.452731 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 10:53:27.452731 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 10:53:27.452731 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 10:53:27.452731 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 10:53:27.452731 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 10:53:27.452731 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 10:53:27.452731 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: ERROR keystone.server.flask.application Aug 18 10:53:27.452731 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 628/1285] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 18 10:53:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:53:27.458636 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c263194-be44-4886-aeed-d6c8a91159be None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:53:27.507997 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:53:27.557393 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c263194-be44-4886-aeed-d6c8a91159be None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:53:27.589908 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a69fb97-8fb6-4d1b-b8fc-5fa449fe5d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:53:27.590498 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a69fb97-8fb6-4d1b-b8fc-5fa449fe5d40 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:27.590770 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a69fb97-8fb6-4d1b-b8fc-5fa449fe5d40 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:27.591036 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a69fb97-8fb6-4d1b-b8fc-5fa449fe5d40 None admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:27.591708 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a69fb97-8fb6-4d1b-b8fc-5fa449fe5d40 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:53:27.592004 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a69fb97-8fb6-4d1b-b8fc-5fa449fe5d40 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:53:27.593400 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a69fb97-8fb6-4d1b-b8fc-5fa449fe5d40 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:53:27.605607 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 658/1286] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Aug 18 10:53:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:53:27.611721 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cdc6b4-3c4c-44fd-90be-1f85971541fc None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:53:27.710379 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cdc6b4-3c4c-44fd-90be-1f85971541fc None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:53:27.746720 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d9835a-ea2e-41c3-bf91-08c72979d510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:53:27.747323 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d9835a-ea2e-41c3-bf91-08c72979d510 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:27.747602 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d9835a-ea2e-41c3-bf91-08c72979d510 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:27.747876 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d9835a-ea2e-41c3-bf91-08c72979d510 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:27.748607 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d9835a-ea2e-41c3-bf91-08c72979d510 None admin] RBAC: Adding query filter params (role.id=127fdc7ef05b4e0b98a940b334e5fcab, scope.project.id=1575e8ebaaab4650995841659b6e631b, user.id=0f918bcdd83d4d48be3fff5a48c54929) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:53:27.748909 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d9835a-ea2e-41c3-bf91-08c72979d510 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:53:27.750474 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d9835a-ea2e-41c3-bf91-08c72979d510 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:53:27.757187 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 629/1287] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Aug 18 10:53:27 2022] GET /identity/v3/role_assignments?user.id=0f918bcdd83d4d48be3fff5a48c54929&scope.project.id=1575e8ebaaab4650995841659b6e631b&role.id=127fdc7ef05b4e0b98a940b334e5fcab => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:53:29.709222 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d443f91e-5d7c-477a-9878-85ec752078cd None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:29.709891 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d443f91e-5d7c-477a-9878-85ec752078cd None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:29.709891 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d443f91e-5d7c-477a-9878-85ec752078cd None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:29.711169 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 659/1288] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:53:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:53:29.716531 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8728136c-3f5f-4445-b5e1-4bea6cdaad27 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:29.716979 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8728136c-3f5f-4445-b5e1-4bea6cdaad27 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:29.717118 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8728136c-3f5f-4445-b5e1-4bea6cdaad27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:29.738777 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-8728136c-3f5f-4445-b5e1-4bea6cdaad27 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:53:29.739870 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-8728136c-3f5f-4445-b5e1-4bea6cdaad27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:53:29.769864 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:53:29.808220 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 630/1289] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:53:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 10:53:30.091794 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d443f91e-5d7c-477a-9878-85ec752078cd None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:53:30.193502 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d443f91e-5d7c-477a-9878-85ec752078cd None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:53:30.204090 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:53:30.230220 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c746dd-cd72-463c-90f5-6bd0acbc923f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:53:30.230850 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c746dd-cd72-463c-90f5-6bd0acbc923f None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:30.231130 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c746dd-cd72-463c-90f5-6bd0acbc923f None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:30.231406 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c746dd-cd72-463c-90f5-6bd0acbc923f None admin] PATH_INFO: `/v3/services/placement` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:30.231986 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c746dd-cd72-463c-90f5-6bd0acbc923f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:53:30.233352 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c746dd-cd72-463c-90f5-6bd0acbc923f None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:53:30.242352 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-a0c746dd-cd72-463c-90f5-6bd0acbc923f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 10:53:30.242352 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:53:30.242352 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 10:53:30.242352 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 10:53:30.242352 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 10:53:30.242352 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 10:53:30.242352 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 10:53:30.242352 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 10:53:30.242352 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 10:53:30.242352 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:53:30.242352 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 10:53:30.242352 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:53:30.242352 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:53:30.242352 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:53:30.242352 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:53:30.242352 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:53:30.242352 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:53:30.243604 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:53:30.243604 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:53:30.243604 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:53:30.243604 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:53:30.243604 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:53:30.243604 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:53:30.243604 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 10:53:30.243604 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 10:53:30.243604 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 10:53:30.243604 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 10:53:30.243604 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:53:30.243604 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:53:30.243604 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:53:30.243604 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:53:30.243604 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:53:30.243604 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:53:30.244508 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:53:30.244508 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:53:30.244508 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:53:30.244508 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:53:30.244508 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:53:30.244508 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:53:30.244508 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:53:30.244508 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:53:30.244508 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:53:30.244508 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:53:30.244508 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 10:53:30.244508 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 10:53:30.244508 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 10:53:30.244508 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:53:30.244508 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 660/1290] 10.222.0.15 () {56 vars in 1117 bytes} [Thu Aug 18 10:53:30 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:53:30.249357 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8728136c-3f5f-4445-b5e1-4bea6cdaad27 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:53:30.349852 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8728136c-3f5f-4445-b5e1-4bea6cdaad27 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:53:30.386029 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88b9d19-0f27-4d7a-b370-ab6a3b2f6b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:53:30.386642 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b9d19-0f27-4d7a-b370-ab6a3b2f6b56 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:30.386919 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b9d19-0f27-4d7a-b370-ab6a3b2f6b56 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:30.387195 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b9d19-0f27-4d7a-b370-ab6a3b2f6b56 None admin] PATH_INFO: `/v3/services` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:30.387817 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88b9d19-0f27-4d7a-b370-ab6a3b2f6b56 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:53:30.388117 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88b9d19-0f27-4d7a-b370-ab6a3b2f6b56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:53:30.389485 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88b9d19-0f27-4d7a-b370-ab6a3b2f6b56 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:53:30.394304 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 631/1291] 10.222.0.15 () {56 vars in 1116 bytes} [Thu Aug 18 10:53:30 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:53:30.400093 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c746dd-cd72-463c-90f5-6bd0acbc923f None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:53:30.503907 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c746dd-cd72-463c-90f5-6bd0acbc923f None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:53:30.538472 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36d1a17-72c2-4765-b146-2073a662e3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:53:30.539158 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d1a17-72c2-4765-b146-2073a662e3a4 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:30.539354 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d1a17-72c2-4765-b146-2073a662e3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:30.539630 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d1a17-72c2-4765-b146-2073a662e3a4 None admin] PATH_INFO: `/v3/services` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:30.540258 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36d1a17-72c2-4765-b146-2073a662e3a4 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:53:30.540562 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36d1a17-72c2-4765-b146-2073a662e3a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:53:30.541952 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36d1a17-72c2-4765-b146-2073a662e3a4 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:53:30.546269 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 661/1292] 10.222.0.15 () {56 vars in 1116 bytes} [Thu Aug 18 10:53:30 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:53:32.443489 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013159d2-32d9-49ec-be3d-0303f32037ec None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:32.444013 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013159d2-32d9-49ec-be3d-0303f32037ec None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:32.444013 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013159d2-32d9-49ec-be3d-0303f32037ec None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:32.445365 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 632/1293] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:53:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:53:32.450786 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d76ce26-e4a6-4c39-bf37-0c0668f0b647 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:32.451185 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d76ce26-e4a6-4c39-bf37-0c0668f0b647 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:32.451346 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d76ce26-e4a6-4c39-bf37-0c0668f0b647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:32.469913 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-6d76ce26-e4a6-4c39-bf37-0c0668f0b647 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:53:32.471032 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-6d76ce26-e4a6-4c39-bf37-0c0668f0b647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:53:32.499958 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:53:32.538240 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 662/1294] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:53:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 10:53:32.811696 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013159d2-32d9-49ec-be3d-0303f32037ec None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:53:32.844397 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:53:32.919105 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013159d2-32d9-49ec-be3d-0303f32037ec None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:53:32.953483 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2018ef51-cbf2-45d5-8d69-63058d937871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:53:32.954110 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2018ef51-cbf2-45d5-8d69-63058d937871 None admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:32.954392 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2018ef51-cbf2-45d5-8d69-63058d937871 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:32.954670 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2018ef51-cbf2-45d5-8d69-63058d937871 None admin] PATH_INFO: `/v3/services` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:32.955323 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2018ef51-cbf2-45d5-8d69-63058d937871 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:53:32.957737 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2018ef51-cbf2-45d5-8d69-63058d937871 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:53:32.972373 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 633/1295] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Aug 18 10:53:32 2022] POST /identity/v3/services => generated 246 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 10:53:34.874591 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141151a5-ff1c-4955-900d-73347c55ae62 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:34.875118 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141151a5-ff1c-4955-900d-73347c55ae62 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:34.875118 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141151a5-ff1c-4955-900d-73347c55ae62 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:34.876472 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 663/1296] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:53:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:53:34.882459 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd56cc05-5fd1-44e1-ac09-96832078dce1 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:34.882864 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd56cc05-5fd1-44e1-ac09-96832078dce1 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:34.883014 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd56cc05-5fd1-44e1-ac09-96832078dce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:34.905086 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-bd56cc05-5fd1-44e1-ac09-96832078dce1 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:53:34.906328 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-bd56cc05-5fd1-44e1-ac09-96832078dce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:53:34.978629 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 634/1297] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:53:34 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 10:53:35.247107 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141151a5-ff1c-4955-900d-73347c55ae62 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:53:35.346940 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141151a5-ff1c-4955-900d-73347c55ae62 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:53:35.381328 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e87555-4d74-44ec-b142-35bee4cc20ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:53:35.381974 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e87555-4d74-44ec-b142-35bee4cc20ca None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:35.382252 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e87555-4d74-44ec-b142-35bee4cc20ca None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:35.382524 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e87555-4d74-44ec-b142-35bee4cc20ca None admin] PATH_INFO: `/v3/services/placement` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:35.383106 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e87555-4d74-44ec-b142-35bee4cc20ca None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:53:35.384464 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e87555-4d74-44ec-b142-35bee4cc20ca None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:53:35.392841 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-07e87555-4d74-44ec-b142-35bee4cc20ca None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 10:53:35.392841 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:53:35.392841 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 10:53:35.392841 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 10:53:35.392841 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 10:53:35.392841 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 10:53:35.392841 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 10:53:35.392841 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 10:53:35.392841 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 10:53:35.392841 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:53:35.392841 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 10:53:35.392841 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:53:35.392841 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:53:35.392841 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:53:35.392841 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:53:35.392841 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:53:35.392841 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:53:35.394046 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:53:35.394046 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:53:35.394046 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:53:35.394046 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:53:35.394046 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:53:35.394046 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:53:35.394046 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 10:53:35.394046 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 10:53:35.394046 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 10:53:35.394046 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 10:53:35.394046 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:53:35.394046 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:53:35.394046 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:53:35.394046 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:53:35.394046 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:53:35.394046 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:53:35.395214 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:53:35.395214 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:53:35.395214 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:53:35.395214 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:53:35.395214 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:53:35.395214 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:53:35.395214 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:53:35.395214 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:53:35.395214 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:53:35.395214 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:53:35.395214 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 10:53:35.395214 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 10:53:35.395214 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 10:53:35.395214 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:53:35.397721 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 664/1298] 10.222.0.15 () {56 vars in 1117 bytes} [Thu Aug 18 10:53:35 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:53:35.399995 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd56cc05-5fd1-44e1-ac09-96832078dce1 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:53:35.419013 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:53:35.507843 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd56cc05-5fd1-44e1-ac09-96832078dce1 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:53:35.544392 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beee8f5-42be-4852-8012-343c22fb4353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:53:35.544993 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beee8f5-42be-4852-8012-343c22fb4353 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:35.545270 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beee8f5-42be-4852-8012-343c22fb4353 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:35.545559 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beee8f5-42be-4852-8012-343c22fb4353 None admin] PATH_INFO: `/v3/services` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:35.546194 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beee8f5-42be-4852-8012-343c22fb4353 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:53:35.546499 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beee8f5-42be-4852-8012-343c22fb4353 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:53:35.547852 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beee8f5-42be-4852-8012-343c22fb4353 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:53:35.553010 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 635/1299] 10.222.0.15 () {56 vars in 1116 bytes} [Thu Aug 18 10:53:35 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:53:35.559214 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e87555-4d74-44ec-b142-35bee4cc20ca None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:53:35.591275 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:53:35.658844 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e87555-4d74-44ec-b142-35bee4cc20ca None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:53:35.690713 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27bb231-e444-4260-95ea-bd8b597a8d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:53:35.691308 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27bb231-e444-4260-95ea-bd8b597a8d63 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:35.691576 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27bb231-e444-4260-95ea-bd8b597a8d63 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:35.691844 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27bb231-e444-4260-95ea-bd8b597a8d63 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:35.692526 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27bb231-e444-4260-95ea-bd8b597a8d63 None admin] RBAC: Adding query filter params (interface=public, service_id=25e51a006f5c41d6932006af3835deb1, region_id=RegionOne) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:53:35.692839 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27bb231-e444-4260-95ea-bd8b597a8d63 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:53:35.694204 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27bb231-e444-4260-95ea-bd8b597a8d63 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:53:35.698964 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 665/1300] 10.222.0.15 () {56 vars in 1251 bytes} [Thu Aug 18 10:53:35 2022] GET /identity/v3/endpoints?service_id=25e51a006f5c41d6932006af3835deb1&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:53:35.704693 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beee8f5-42be-4852-8012-343c22fb4353 None admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:53:35.811942 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:53:35.832229 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beee8f5-42be-4852-8012-343c22fb4353 None admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:53:35.868684 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b7d096-30ee-4bbc-b90d-b9f83a052d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:53:35.869378 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7d096-30ee-4bbc-b90d-b9f83a052d95 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:35.869605 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7d096-30ee-4bbc-b90d-b9f83a052d95 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:35.869882 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7d096-30ee-4bbc-b90d-b9f83a052d95 None admin] PATH_INFO: `/v3/services` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:35.870490 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b7d096-30ee-4bbc-b90d-b9f83a052d95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:53:35.871864 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b7d096-30ee-4bbc-b90d-b9f83a052d95 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:53:35.879350 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 636/1301] 10.222.0.15 () {56 vars in 1087 bytes} [Thu Aug 18 10:53:35 2022] GET /identity/v3/services => generated 2191 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 10:53:37.753199 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa91516-5a56-4cf6-9983-fcc7c0ebff6b None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:37.753879 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa91516-5a56-4cf6-9983-fcc7c0ebff6b None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:37.753879 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa91516-5a56-4cf6-9983-fcc7c0ebff6b None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:37.755232 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 666/1302] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:53:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:53:37.760301 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f22dc4-d5cf-486d-92af-957f62d507f5 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:37.760685 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f22dc4-d5cf-486d-92af-957f62d507f5 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:37.760841 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f22dc4-d5cf-486d-92af-957f62d507f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:37.778865 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-b1f22dc4-d5cf-486d-92af-957f62d507f5 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:53:37.780037 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-b1f22dc4-d5cf-486d-92af-957f62d507f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:53:37.846948 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 637/1303] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:53:37 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 10:53:38.121293 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa91516-5a56-4cf6-9983-fcc7c0ebff6b None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:53:38.216416 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:53:38.223802 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa91516-5a56-4cf6-9983-fcc7c0ebff6b None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:53:38.257097 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36af619-4b89-4094-bb78-43e607c4b528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:53:38.257741 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36af619-4b89-4094-bb78-43e607c4b528 None admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:38.258024 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36af619-4b89-4094-bb78-43e607c4b528 None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:38.258297 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36af619-4b89-4094-bb78-43e607c4b528 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:38.258875 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36af619-4b89-4094-bb78-43e607c4b528 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:53:38.260239 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36af619-4b89-4094-bb78-43e607c4b528 None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:53:38.269209 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application [None req-c36af619-4b89-4094-bb78-43e607c4b528 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 10:53:38.269209 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:53:38.269209 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 10:53:38.269209 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 10:53:38.269209 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 10:53:38.269209 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 10:53:38.269209 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 10:53:38.269209 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 10:53:38.269209 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 10:53:38.269209 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:53:38.269209 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 10:53:38.269209 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:53:38.269209 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 10:53:38.269209 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 10:53:38.269209 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 10:53:38.269209 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 10:53:38.269209 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 10:53:38.270422 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 10:53:38.270422 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 10:53:38.270422 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 10:53:38.270422 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 10:53:38.270422 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 10:53:38.270422 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 10:53:38.270422 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 10:53:38.270422 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 10:53:38.270422 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 10:53:38.270422 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 10:53:38.270422 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 10:53:38.270422 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 10:53:38.270422 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 10:53:38.270422 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 10:53:38.270422 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 10:53:38.270422 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 10:53:38.271453 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 10:53:38.271453 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application with Lock( Aug 18 10:53:38.271453 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 10:53:38.271453 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self._enter() Aug 18 10:53:38.271453 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 10:53:38.271453 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 10:53:38.271453 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 10:53:38.271453 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application return self.creator() Aug 18 10:53:38.271453 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 10:53:38.271453 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application created_value = creator( Aug 18 10:53:38.271453 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 10:53:38.271453 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 10:53:38.271453 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 10:53:38.271453 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: ERROR keystone.server.flask.application Aug 18 10:53:38.271453 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 667/1304] 10.222.0.15 () {56 vars in 1117 bytes} [Thu Aug 18 10:53:38 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 10:53:38.276744 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f22dc4-d5cf-486d-92af-957f62d507f5 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:53:38.355571 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:53:38.379315 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f22dc4-d5cf-486d-92af-957f62d507f5 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:53:38.416073 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071546ac-7745-4d63-af8a-3a8819ecc174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:53:38.416073 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071546ac-7745-4d63-af8a-3a8819ecc174 None admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:38.416073 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071546ac-7745-4d63-af8a-3a8819ecc174 None admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:38.416073 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071546ac-7745-4d63-af8a-3a8819ecc174 None admin] PATH_INFO: `/v3/services` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:38.416541 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071546ac-7745-4d63-af8a-3a8819ecc174 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:53:38.416541 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071546ac-7745-4d63-af8a-3a8819ecc174 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:53:38.416724 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071546ac-7745-4d63-af8a-3a8819ecc174 None admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:53:38.422021 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 638/1305] 10.222.0.15 () {56 vars in 1116 bytes} [Thu Aug 18 10:53:38 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:53:38.428373 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36af619-4b89-4094-bb78-43e607c4b528 None admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:53:38.527649 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36af619-4b89-4094-bb78-43e607c4b528 None admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:53:38.560642 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0693a57e-1b5f-499c-bf1a-8a47b0c3b05f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:53:38.561245 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693a57e-1b5f-499c-bf1a-8a47b0c3b05f None admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:53:38.561544 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693a57e-1b5f-499c-bf1a-8a47b0c3b05f None admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:53:38.561827 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693a57e-1b5f-499c-bf1a-8a47b0c3b05f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:53:38.562495 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0693a57e-1b5f-499c-bf1a-8a47b0c3b05f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:53:38.563844 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0693a57e-1b5f-499c-bf1a-8a47b0c3b05f None admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:53:38.583060 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 668/1306] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 10:53:38 2022] POST /identity/v3/endpoints => generated 331 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 10:53:48.419261 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=30 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:53:48.578180 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:54:43.303359 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4138af42-2e72-4568-afeb-fea59a298099 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:54:43.303910 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4138af42-2e72-4568-afeb-fea59a298099 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:54:43.303910 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4138af42-2e72-4568-afeb-fea59a298099 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:54:43.309150 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 639/1307] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:54:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:54:43.310590 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b57acc-a3cf-4bf7-8d02-f7f903898a3b None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:54:43.310999 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b57acc-a3cf-4bf7-8d02-f7f903898a3b None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:54:43.311162 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b57acc-a3cf-4bf7-8d02-f7f903898a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:54:43.500381 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-57b57acc-a3cf-4bf7-8d02-f7f903898a3b None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:54:43.501646 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-57b57acc-a3cf-4bf7-8d02-f7f903898a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:54:43.731129 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 669/1308] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:54:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 10:54:44.033313 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf23e67-fa10-4b91-9c98-a7be9dab6c99 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:54:44.034683 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf23e67-fa10-4b91-9c98-a7be9dab6c99 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:54:44.035819 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf23e67-fa10-4b91-9c98-a7be9dab6c99 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:54:44.037773 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 640/1309] 10.222.0.15 () {54 vars in 965 bytes} [Thu Aug 18 10:54:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:54:44.044438 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e469dd66-2f24-41eb-9b28-800466a3270a None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:54:44.044753 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e469dd66-2f24-41eb-9b28-800466a3270a None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:54:44.045009 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e469dd66-2f24-41eb-9b28-800466a3270a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:54:44.156741 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-e469dd66-2f24-41eb-9b28-800466a3270a None None] MFA Rules not processed for user `86c2cd74178f443d9c2398ff8e00cccc`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:54:44.158252 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-e469dd66-2f24-41eb-9b28-800466a3270a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:54:44.183960 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:54:44.263913 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 670/1310] 10.222.0.15 () {58 vars in 1062 bytes} [Thu Aug 18 10:54:44 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 10:54:44.274441 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf23e67-fa10-4b91-9c98-a7be9dab6c99 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:54:44.276349 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-edf23e67-fa10-4b91-9c98-a7be9dab6c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:54:44.421465 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf23e67-fa10-4b91-9c98-a7be9dab6c99 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:54:44.517880 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9447091-3e1e-4d8b-add3-64f407d41ec8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:54:44.518723 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9447091-3e1e-4d8b-add3-64f407d41ec8 service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:54:44.519182 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9447091-3e1e-4d8b-add3-64f407d41ec8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:54:44.519653 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9447091-3e1e-4d8b-add3-64f407d41ec8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:54:44.522438 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-b9447091-3e1e-4d8b-add3-64f407d41ec8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:54:44.608527 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:54:44.700807 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9447091-3e1e-4d8b-add3-64f407d41ec8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:54:44.702986 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9447091-3e1e-4d8b-add3-64f407d41ec8 service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:54:44.731555 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 641/1311] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 10:54:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 10:54:46.990820 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c540079-89c6-4307-a533-0b68cc892e69 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:54:46.991377 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c540079-89c6-4307-a533-0b68cc892e69 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:54:46.991377 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c540079-89c6-4307-a533-0b68cc892e69 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:54:46.992770 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 671/1312] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:54:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:54:46.998666 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb296d6-0ef1-4fc1-a952-12a3fcc16778 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:54:46.999170 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb296d6-0ef1-4fc1-a952-12a3fcc16778 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:54:46.999260 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb296d6-0ef1-4fc1-a952-12a3fcc16778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:54:47.078203 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-8fb296d6-0ef1-4fc1-a952-12a3fcc16778 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:54:47.079423 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-8fb296d6-0ef1-4fc1-a952-12a3fcc16778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:54:47.183882 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 642/1313] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:54:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 10:54:47.475298 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c540079-89c6-4307-a533-0b68cc892e69 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:54:47.476874 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-2c540079-89c6-4307-a533-0b68cc892e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:54:47.580912 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c540079-89c6-4307-a533-0b68cc892e69 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:54:47.652036 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:54:47.654429 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a0fa7c-cfc5-421e-adfa-10cd06e69422 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:54:47.655048 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a0fa7c-cfc5-421e-adfa-10cd06e69422 service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:54:47.655522 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a0fa7c-cfc5-421e-adfa-10cd06e69422 service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:54:47.655956 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a0fa7c-cfc5-421e-adfa-10cd06e69422 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:54:47.657780 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-32a0fa7c-cfc5-421e-adfa-10cd06e69422 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:54:47.775751 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a0fa7c-cfc5-421e-adfa-10cd06e69422 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:54:47.779123 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a0fa7c-cfc5-421e-adfa-10cd06e69422 service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:54:47.803151 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 672/1314] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 10:54:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 10:54:50.050573 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e916f07-782f-425f-8c34-d6e965745397 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:54:50.051143 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e916f07-782f-425f-8c34-d6e965745397 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:54:50.051143 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e916f07-782f-425f-8c34-d6e965745397 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:54:50.052468 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 643/1315] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:54:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:54:50.058070 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca191a3-56cd-4201-a681-fed8bce9418a None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:54:50.058512 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca191a3-56cd-4201-a681-fed8bce9418a None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:54:50.058605 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca191a3-56cd-4201-a681-fed8bce9418a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:54:50.125633 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-6ca191a3-56cd-4201-a681-fed8bce9418a None None] MFA Rules not processed for user `dbca316ef38e45aeb63de5837094e8ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:54:50.126894 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-6ca191a3-56cd-4201-a681-fed8bce9418a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:54:50.182322 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:54:50.232210 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 673/1316] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:54:50 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 10:54:50.560094 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e916f07-782f-425f-8c34-d6e965745397 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:54:50.561681 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-9e916f07-782f-425f-8c34-d6e965745397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:54:50.572402 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:54:50.669627 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e916f07-782f-425f-8c34-d6e965745397 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:54:50.742742 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7bf796-97bb-41e4-ae9d-304e5a5fde69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:54:50.743341 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7bf796-97bb-41e4-ae9d-304e5a5fde69 service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:54:50.743619 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7bf796-97bb-41e4-ae9d-304e5a5fde69 service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:54:50.743890 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7bf796-97bb-41e4-ae9d-304e5a5fde69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:54:50.745494 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-9d7bf796-97bb-41e4-ae9d-304e5a5fde69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:54:50.807896 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:54:50.875684 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7bf796-97bb-41e4-ae9d-304e5a5fde69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:54:50.877116 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7bf796-97bb-41e4-ae9d-304e5a5fde69 service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:54:50.898220 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 644/1317] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 10:54:50 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 10:54:53.406992 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b5d5a9-d2da-449b-93b4-3cec8b9c4037 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:54:53.407592 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b5d5a9-d2da-449b-93b4-3cec8b9c4037 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:54:53.407592 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b5d5a9-d2da-449b-93b4-3cec8b9c4037 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:54:53.409764 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 674/1318] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:54:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:54:53.414977 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fec3c7-1dc7-490b-a020-92e5ead8688f None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:54:53.415411 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fec3c7-1dc7-490b-a020-92e5ead8688f None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:54:53.415514 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fec3c7-1dc7-490b-a020-92e5ead8688f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:54:53.481881 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-22fec3c7-1dc7-490b-a020-92e5ead8688f None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:54:53.483013 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-22fec3c7-1dc7-490b-a020-92e5ead8688f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:54:53.579260 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 645/1319] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:54:53 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 10:54:53.884431 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfbe1b2-cb13-4c37-b153-835a920642e0 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:54:53.884718 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfbe1b2-cb13-4c37-b153-835a920642e0 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:54:53.885000 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfbe1b2-cb13-4c37-b153-835a920642e0 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:54:53.886400 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 675/1320] 10.222.0.15 () {54 vars in 965 bytes} [Thu Aug 18 10:54:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:54:53.892302 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f3adfd-6c7c-4f6e-998d-d0e8dba79726 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:54:53.892590 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f3adfd-6c7c-4f6e-998d-d0e8dba79726 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:54:53.892867 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f3adfd-6c7c-4f6e-998d-d0e8dba79726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:54:53.916207 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:54:53.970745 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-a3f3adfd-6c7c-4f6e-998d-d0e8dba79726 None None] MFA Rules not processed for user `86c2cd74178f443d9c2398ff8e00cccc`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:54:53.972212 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-a3f3adfd-6c7c-4f6e-998d-d0e8dba79726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:54:54.048279 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 646/1321] 10.222.0.15 () {58 vars in 1062 bytes} [Thu Aug 18 10:54:53 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 10:54:54.057720 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfbe1b2-cb13-4c37-b153-835a920642e0 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:54:54.059254 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-8dfbe1b2-cb13-4c37-b153-835a920642e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:54:54.163577 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfbe1b2-cb13-4c37-b153-835a920642e0 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:54:54.235877 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5986fd2f-18b5-4261-b584-e9e0a1ffccd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:54:54.236495 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5986fd2f-18b5-4261-b584-e9e0a1ffccd0 service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:54:54.237303 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5986fd2f-18b5-4261-b584-e9e0a1ffccd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:54:54.237888 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5986fd2f-18b5-4261-b584-e9e0a1ffccd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:54:54.239281 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-5986fd2f-18b5-4261-b584-e9e0a1ffccd0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:54:54.246894 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:54:54.348931 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5986fd2f-18b5-4261-b584-e9e0a1ffccd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:54:54.350402 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5986fd2f-18b5-4261-b584-e9e0a1ffccd0 service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:54:54.370139 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 676/1322] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 10:54:54 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 10:54:57.492694 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e023aed-112b-4c00-a3af-915bfc420b95 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:54:57.493244 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e023aed-112b-4c00-a3af-915bfc420b95 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:54:57.493244 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e023aed-112b-4c00-a3af-915bfc420b95 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:54:57.494641 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 647/1323] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:54:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:54:57.499820 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c8895-8561-4b68-a75f-034bb30a3f78 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:54:57.500239 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c8895-8561-4b68-a75f-034bb30a3f78 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:54:57.500375 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c8895-8561-4b68-a75f-034bb30a3f78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:54:57.567634 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-734c8895-8561-4b68-a75f-034bb30a3f78 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:54:57.568871 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-734c8895-8561-4b68-a75f-034bb30a3f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:54:57.630488 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:54:57.671615 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 677/1324] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:54:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 10:54:57.956104 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e023aed-112b-4c00-a3af-915bfc420b95 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:54:57.957757 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-2e023aed-112b-4c00-a3af-915bfc420b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:54:58.067423 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e023aed-112b-4c00-a3af-915bfc420b95 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:54:58.079710 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:54:58.144422 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2e8dbd-9ba0-48ea-a551-fba042daa886 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:54:58.144924 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e8dbd-9ba0-48ea-a551-fba042daa886 service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:54:58.145205 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e8dbd-9ba0-48ea-a551-fba042daa886 service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:54:58.145479 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e8dbd-9ba0-48ea-a551-fba042daa886 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:54:58.147170 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-0f2e8dbd-9ba0-48ea-a551-fba042daa886 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:54:58.264774 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2e8dbd-9ba0-48ea-a551-fba042daa886 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:54:58.266267 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2e8dbd-9ba0-48ea-a551-fba042daa886 service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:54:58.286333 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 648/1325] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 10:54:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 10:55:00.287398 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cdd73e-1469-41ef-ae1c-86c42ad2e77e None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:55:00.288062 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cdd73e-1469-41ef-ae1c-86c42ad2e77e None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:55:00.288062 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cdd73e-1469-41ef-ae1c-86c42ad2e77e None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:55:00.289289 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 678/1326] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:55:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:55:00.294906 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7784c7e3-5f48-4c3a-aafc-dcd96300acbf None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:55:00.295324 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7784c7e3-5f48-4c3a-aafc-dcd96300acbf None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:55:00.295469 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7784c7e3-5f48-4c3a-aafc-dcd96300acbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:55:00.347718 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:55:00.367327 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-7784c7e3-5f48-4c3a-aafc-dcd96300acbf None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:55:00.368530 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-7784c7e3-5f48-4c3a-aafc-dcd96300acbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:55:00.483534 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 649/1327] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:55:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 10:55:00.797036 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cdd73e-1469-41ef-ae1c-86c42ad2e77e None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:55:00.798638 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-05cdd73e-1469-41ef-ae1c-86c42ad2e77e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:55:00.942021 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cdd73e-1469-41ef-ae1c-86c42ad2e77e None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:55:01.021611 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb12a80b-b553-46e8-b8f8-0c2a80b86604 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:55:01.023456 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb12a80b-b553-46e8-b8f8-0c2a80b86604 service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:55:01.023456 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb12a80b-b553-46e8-b8f8-0c2a80b86604 service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:55:01.023456 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb12a80b-b553-46e8-b8f8-0c2a80b86604 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:55:01.024848 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-eb12a80b-b553-46e8-b8f8-0c2a80b86604 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:55:01.043885 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:55:01.154285 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb12a80b-b553-46e8-b8f8-0c2a80b86604 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:55:01.155723 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb12a80b-b553-46e8-b8f8-0c2a80b86604 service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:55:01.174027 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 679/1328] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 10:55:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 10:55:03.180231 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd16d5d-f48a-4514-a7b3-7577721a34dc None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:55:03.180822 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd16d5d-f48a-4514-a7b3-7577721a34dc None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:55:03.180822 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd16d5d-f48a-4514-a7b3-7577721a34dc None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:55:03.182180 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 650/1329] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:55:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:55:03.188137 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38973fc3-c6be-43fa-93ff-5265071e990f None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:55:03.188694 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38973fc3-c6be-43fa-93ff-5265071e990f None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:55:03.188796 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38973fc3-c6be-43fa-93ff-5265071e990f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:55:03.259184 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-38973fc3-c6be-43fa-93ff-5265071e990f None None] MFA Rules not processed for user `dbca316ef38e45aeb63de5837094e8ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:55:03.260387 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-38973fc3-c6be-43fa-93ff-5265071e990f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:55:03.327168 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:55:03.363709 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 680/1330] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:55:03 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 10:55:03.643699 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd16d5d-f48a-4514-a7b3-7577721a34dc None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:55:03.645218 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-8fd16d5d-f48a-4514-a7b3-7577721a34dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:55:03.758541 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd16d5d-f48a-4514-a7b3-7577721a34dc None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:55:03.779791 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:55:03.837920 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f19e313-a31e-4508-be34-78811d8c4c17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:55:03.838480 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f19e313-a31e-4508-be34-78811d8c4c17 service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:55:03.838764 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f19e313-a31e-4508-be34-78811d8c4c17 service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:55:03.839041 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f19e313-a31e-4508-be34-78811d8c4c17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:55:03.840655 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-9f19e313-a31e-4508-be34-78811d8c4c17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:55:03.956029 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f19e313-a31e-4508-be34-78811d8c4c17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:55:03.957480 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f19e313-a31e-4508-be34-78811d8c4c17 service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:55:03.977408 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 651/1331] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 10:55:03 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 10:55:06.245677 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e76356-7cd6-49bc-8bde-b5a293d2ef04 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:55:06.246218 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e76356-7cd6-49bc-8bde-b5a293d2ef04 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:55:06.246218 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e76356-7cd6-49bc-8bde-b5a293d2ef04 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:55:06.247648 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 681/1332] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:55:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:55:06.254071 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543432a4-d8cd-43e5-a55b-f094b7d06308 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:55:06.254520 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543432a4-d8cd-43e5-a55b-f094b7d06308 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:55:06.254624 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543432a4-d8cd-43e5-a55b-f094b7d06308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:55:06.321718 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:55:06.324611 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-543432a4-d8cd-43e5-a55b-f094b7d06308 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:55:06.326426 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-543432a4-d8cd-43e5-a55b-f094b7d06308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:55:06.426782 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 652/1333] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:55:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 10:55:06.712033 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e76356-7cd6-49bc-8bde-b5a293d2ef04 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:55:06.713620 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-d8e76356-7cd6-49bc-8bde-b5a293d2ef04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:55:06.821184 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e76356-7cd6-49bc-8bde-b5a293d2ef04 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:55:06.894744 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075c9b1c-be32-4784-9240-8685cefe98d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:55:06.895286 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c9b1c-be32-4784-9240-8685cefe98d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:55:06.895569 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c9b1c-be32-4784-9240-8685cefe98d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:55:06.895852 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c9b1c-be32-4784-9240-8685cefe98d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:55:06.897800 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-075c9b1c-be32-4784-9240-8685cefe98d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:55:06.926772 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:55:07.009158 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075c9b1c-be32-4784-9240-8685cefe98d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:55:07.010699 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075c9b1c-be32-4784-9240-8685cefe98d2 service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:55:07.028876 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 682/1334] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 10:55:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 10:55:08.976723 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc165fc-165f-4703-82d2-d6aa84e2f0ed None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:55:08.977297 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc165fc-165f-4703-82d2-d6aa84e2f0ed None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:55:08.977297 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc165fc-165f-4703-82d2-d6aa84e2f0ed None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:55:08.978626 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 653/1335] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:55:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 10:55:08.983927 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abeecb7-173e-49b1-9b6b-e84e9b15c4f4 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:55:08.984369 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abeecb7-173e-49b1-9b6b-e84e9b15c4f4 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:55:08.984474 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abeecb7-173e-49b1-9b6b-e84e9b15c4f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:55:09.050901 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-8abeecb7-173e-49b1-9b6b-e84e9b15c4f4 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:55:09.052116 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-8abeecb7-173e-49b1-9b6b-e84e9b15c4f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:55:09.125717 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:55:09.153207 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 683/1336] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:55:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 10:55:09.437309 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc165fc-165f-4703-82d2-d6aa84e2f0ed None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:55:09.438874 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-ecc165fc-165f-4703-82d2-d6aa84e2f0ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:55:09.543777 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc165fc-165f-4703-82d2-d6aa84e2f0ed None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:55:09.573013 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:55:09.618741 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60e80f9-6f6f-4e94-9dc0-215070cdc7d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:55:09.619345 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e80f9-6f6f-4e94-9dc0-215070cdc7d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:55:09.619620 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e80f9-6f6f-4e94-9dc0-215070cdc7d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:55:09.619889 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e80f9-6f6f-4e94-9dc0-215070cdc7d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:55:09.621547 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-f60e80f9-6f6f-4e94-9dc0-215070cdc7d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:55:09.731310 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60e80f9-6f6f-4e94-9dc0-215070cdc7d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:55:09.732735 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60e80f9-6f6f-4e94-9dc0-215070cdc7d9 service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:55:09.751168 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 654/1337] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 10:55:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 10:55:12.079750 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a7232-9c55-472e-b310-4b95c686dc60 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:55:12.080308 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a7232-9c55-472e-b310-4b95c686dc60 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:55:12.080308 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a7232-9c55-472e-b310-4b95c686dc60 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:55:12.081740 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 684/1338] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:55:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:55:12.087591 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0dacab-b917-479b-b686-67a7fe288f01 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:55:12.088021 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0dacab-b917-479b-b686-67a7fe288f01 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:55:12.088116 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0dacab-b917-479b-b686-67a7fe288f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:55:12.160497 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-ee0dacab-b917-479b-b686-67a7fe288f01 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:55:12.161762 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-ee0dacab-b917-479b-b686-67a7fe288f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:55:12.170168 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:55:12.267766 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 655/1339] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:55:12 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 10:55:12.555196 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605a7232-9c55-472e-b310-4b95c686dc60 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:55:12.556748 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-605a7232-9c55-472e-b310-4b95c686dc60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:55:12.661111 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605a7232-9c55-472e-b310-4b95c686dc60 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:55:12.733803 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de78da4d-ce14-4094-8464-1899f5fc5444 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:55:12.734550 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de78da4d-ce14-4094-8464-1899f5fc5444 service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:55:12.734859 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de78da4d-ce14-4094-8464-1899f5fc5444 service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:55:12.735235 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de78da4d-ce14-4094-8464-1899f5fc5444 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:55:12.737331 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-de78da4d-ce14-4094-8464-1899f5fc5444 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:55:12.778700 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:55:12.855980 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de78da4d-ce14-4094-8464-1899f5fc5444 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:55:12.857322 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de78da4d-ce14-4094-8464-1899f5fc5444 service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:55:12.875880 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 685/1340] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 10:55:12 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 10:55:16.917388 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26742fdf-ad6b-4a1a-8c6d-4b1ecece6025 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:55:16.917962 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26742fdf-ad6b-4a1a-8c6d-4b1ecece6025 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:55:16.917962 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26742fdf-ad6b-4a1a-8c6d-4b1ecece6025 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:55:16.919341 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 656/1341] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:55:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:55:16.924701 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a37535-66af-41df-a0e7-b8c9a49142a8 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:55:16.925104 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a37535-66af-41df-a0e7-b8c9a49142a8 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:55:16.925250 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a37535-66af-41df-a0e7-b8c9a49142a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:55:16.993971 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-d1a37535-66af-41df-a0e7-b8c9a49142a8 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:55:16.995202 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-d1a37535-66af-41df-a0e7-b8c9a49142a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:55:17.085207 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:55:17.098581 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 686/1342] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:55:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 10:55:17.398510 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26742fdf-ad6b-4a1a-8c6d-4b1ecece6025 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:55:17.400033 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-26742fdf-ad6b-4a1a-8c6d-4b1ecece6025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:55:17.509407 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26742fdf-ad6b-4a1a-8c6d-4b1ecece6025 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:55:17.551809 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:55:17.592006 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f2f242-f922-451b-a5c2-ee2239f21cb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:55:17.592620 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f2f242-f922-451b-a5c2-ee2239f21cb4 service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:55:17.592898 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f2f242-f922-451b-a5c2-ee2239f21cb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:55:17.593167 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f2f242-f922-451b-a5c2-ee2239f21cb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:55:17.594807 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-e2f2f242-f922-451b-a5c2-ee2239f21cb4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:55:17.711446 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f2f242-f922-451b-a5c2-ee2239f21cb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:55:17.712802 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f2f242-f922-451b-a5c2-ee2239f21cb4 service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:55:17.731951 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 657/1343] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 10:55:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 10:55:20.308604 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bee7c5-9857-4548-9f89-eeaad20643eb None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:55:20.309161 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bee7c5-9857-4548-9f89-eeaad20643eb None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:55:20.309161 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bee7c5-9857-4548-9f89-eeaad20643eb None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:55:20.310601 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 687/1344] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:55:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:55:20.317035 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561919f9-b53d-4ecb-960e-36cdb47033b1 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:55:20.317635 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561919f9-b53d-4ecb-960e-36cdb47033b1 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:55:20.317741 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561919f9-b53d-4ecb-960e-36cdb47033b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:55:20.387873 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-561919f9-b53d-4ecb-960e-36cdb47033b1 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:55:20.389080 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-561919f9-b53d-4ecb-960e-36cdb47033b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:55:20.407893 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:55:20.496751 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 658/1345] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:55:20 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 10:55:20.788254 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bee7c5-9857-4548-9f89-eeaad20643eb None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:55:20.789996 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-81bee7c5-9857-4548-9f89-eeaad20643eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:55:20.896319 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bee7c5-9857-4548-9f89-eeaad20643eb None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:55:20.980987 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a6b4b4-6363-404e-83d7-5ab2bf88d9db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:55:20.981632 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a6b4b4-6363-404e-83d7-5ab2bf88d9db service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:55:20.981917 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a6b4b4-6363-404e-83d7-5ab2bf88d9db service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:55:20.982194 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a6b4b4-6363-404e-83d7-5ab2bf88d9db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:55:20.983911 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-52a6b4b4-6363-404e-83d7-5ab2bf88d9db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:55:21.029007 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:55:21.100272 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a6b4b4-6363-404e-83d7-5ab2bf88d9db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:55:21.101649 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a6b4b4-6363-404e-83d7-5ab2bf88d9db service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:55:21.120164 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 688/1346] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 10:55:20 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 10:55:25.400938 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a7077-0430-48b1-bba7-227153404ef1 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:55:25.401588 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a7077-0430-48b1-bba7-227153404ef1 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:55:25.401588 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a7077-0430-48b1-bba7-227153404ef1 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:55:25.402923 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 659/1347] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:55:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:55:25.409158 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e152084-366d-4f46-8839-56207bcbf3a2 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:55:25.410237 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e152084-366d-4f46-8839-56207bcbf3a2 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:55:25.410496 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e152084-366d-4f46-8839-56207bcbf3a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:55:25.496243 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-6e152084-366d-4f46-8839-56207bcbf3a2 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:55:25.497484 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-6e152084-366d-4f46-8839-56207bcbf3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:55:25.608663 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:55:25.611588 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 689/1348] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:55:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 10:55:25.903924 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997a7077-0430-48b1-bba7-227153404ef1 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:55:25.905546 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-997a7077-0430-48b1-bba7-227153404ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:55:26.011800 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997a7077-0430-48b1-bba7-227153404ef1 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:55:26.061712 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:55:26.088594 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a498ae-ea21-4e11-a932-d052ea4ee7f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:55:26.089125 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a498ae-ea21-4e11-a932-d052ea4ee7f7 service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:55:26.089397 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a498ae-ea21-4e11-a932-d052ea4ee7f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:55:26.089689 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a498ae-ea21-4e11-a932-d052ea4ee7f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:55:26.091277 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-f0a498ae-ea21-4e11-a932-d052ea4ee7f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:55:26.200944 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a498ae-ea21-4e11-a932-d052ea4ee7f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:55:26.202463 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a498ae-ea21-4e11-a932-d052ea4ee7f7 service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:55:26.221922 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 660/1349] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 10:55:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 10:55:31.199972 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a59a920-b0e0-4749-8a22-ac7f79bf7111 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:55:31.200509 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a59a920-b0e0-4749-8a22-ac7f79bf7111 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:55:31.200509 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a59a920-b0e0-4749-8a22-ac7f79bf7111 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:55:31.202089 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 690/1350] 10.222.0.15 () {54 vars in 921 bytes} [Thu Aug 18 10:55:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:55:31.208793 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d056d5-408c-485d-bda3-25c3033707b3 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:55:31.209265 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d056d5-408c-485d-bda3-25c3033707b3 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:55:31.209265 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d056d5-408c-485d-bda3-25c3033707b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:55:31.322779 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-d6d056d5-408c-485d-bda3-25c3033707b3 None None] MFA Rules not processed for user `0f918bcdd83d4d48be3fff5a48c54929`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:55:31.324287 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-d6d056d5-408c-485d-bda3-25c3033707b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:55:31.371995 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:55:31.525115 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 661/1351] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Aug 18 10:55:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 10:55:35.696292 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04caf639-5eb3-4e60-8e34-a29a2130e9bf None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:55:35.696792 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04caf639-5eb3-4e60-8e34-a29a2130e9bf None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:55:35.696792 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04caf639-5eb3-4e60-8e34-a29a2130e9bf None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:55:35.698314 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 691/1352] 10.222.0.15 () {54 vars in 921 bytes} [Thu Aug 18 10:55:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:55:35.703274 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b8ec1-b82c-45b5-91e5-a169a7f0d74c None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:55:35.703740 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b8ec1-b82c-45b5-91e5-a169a7f0d74c None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:55:35.704032 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b8ec1-b82c-45b5-91e5-a169a7f0d74c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:55:35.787416 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-744b8ec1-b82c-45b5-91e5-a169a7f0d74c None None] MFA Rules not processed for user `0f918bcdd83d4d48be3fff5a48c54929`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:55:35.788683 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-744b8ec1-b82c-45b5-91e5-a169a7f0d74c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:55:35.865452 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:55:35.908115 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 662/1353] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Aug 18 10:55:35 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 10:55:37.427328 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a411f7-e25c-4ea9-80c9-2df86b0bbf2d None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:55:37.427842 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a411f7-e25c-4ea9-80c9-2df86b0bbf2d None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:55:37.427955 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a411f7-e25c-4ea9-80c9-2df86b0bbf2d None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:55:37.429366 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 692/1354] 10.222.0.15 () {54 vars in 921 bytes} [Thu Aug 18 10:55:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:55:37.434558 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91391614-0d4b-4617-bb22-ada79efeae0a None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:55:37.435299 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91391614-0d4b-4617-bb22-ada79efeae0a None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:55:37.435579 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91391614-0d4b-4617-bb22-ada79efeae0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:55:37.518006 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-91391614-0d4b-4617-bb22-ada79efeae0a None None] MFA Rules not processed for user `0f918bcdd83d4d48be3fff5a48c54929`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:55:37.520809 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-91391614-0d4b-4617-bb22-ada79efeae0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:55:37.636190 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 663/1355] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Aug 18 10:55:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 10:55:41.066744 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7499e49d-8271-429b-8fae-49425e54c58e None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:55:41.067394 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7499e49d-8271-429b-8fae-49425e54c58e None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:55:41.067394 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7499e49d-8271-429b-8fae-49425e54c58e None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:55:41.068898 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 693/1356] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:55:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:55:41.074071 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c281ad-b670-4869-8eb9-04fd7bbffb16 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:55:41.074459 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c281ad-b670-4869-8eb9-04fd7bbffb16 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:55:41.074618 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c281ad-b670-4869-8eb9-04fd7bbffb16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:55:41.137304 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:55:41.175947 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-30c281ad-b670-4869-8eb9-04fd7bbffb16 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:55:41.177572 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-30c281ad-b670-4869-8eb9-04fd7bbffb16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:55:41.325495 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 664/1357] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:55:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 10:55:41.642101 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e31711-48c2-4dcf-8dfc-3cd15791a3bf None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:55:41.643196 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e31711-48c2-4dcf-8dfc-3cd15791a3bf None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:55:41.644258 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e31711-48c2-4dcf-8dfc-3cd15791a3bf None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:55:41.646521 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 694/1358] 10.222.0.15 () {54 vars in 962 bytes} [Thu Aug 18 10:55:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:55:41.655069 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3166d324-beee-4e26-9773-7dd1d89f8126 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:55:41.655383 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3166d324-beee-4e26-9773-7dd1d89f8126 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:55:41.655636 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3166d324-beee-4e26-9773-7dd1d89f8126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:55:41.741212 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-3166d324-beee-4e26-9773-7dd1d89f8126 None None] MFA Rules not processed for user `a005d8f0c46d44c7b6f2201a54717b12`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:55:41.742476 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-3166d324-beee-4e26-9773-7dd1d89f8126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:55:41.797997 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:55:41.879023 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 665/1359] 10.222.0.15 () {58 vars in 1059 bytes} [Thu Aug 18 10:55:41 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 10:55:41.886879 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e31711-48c2-4dcf-8dfc-3cd15791a3bf None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:55:41.888646 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-46e31711-48c2-4dcf-8dfc-3cd15791a3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:55:42.048680 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e31711-48c2-4dcf-8dfc-3cd15791a3bf None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:55:42.126905 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:55:42.170387 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6801fdbd-0be0-4fed-b874-f6e1262a0b14 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a005d8f0c46d44c7b6f2201a54717b12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:55:42.171043 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6801fdbd-0be0-4fed-b874-f6e1262a0b14 service nova] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:55:42.171469 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6801fdbd-0be0-4fed-b874-f6e1262a0b14 service nova] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:55:42.171895 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6801fdbd-0be0-4fed-b874-f6e1262a0b14 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:55:42.173715 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-6801fdbd-0be0-4fed-b874-f6e1262a0b14 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:55:42.289383 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6801fdbd-0be0-4fed-b874-f6e1262a0b14 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:55:42.291177 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6801fdbd-0be0-4fed-b874-f6e1262a0b14 service nova] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:55:42.311313 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 695/1360] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 10:55:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 10:55:44.456730 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed21cecd-e9d2-4252-ad21-c72a7d89aa6f None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:55:44.457326 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed21cecd-e9d2-4252-ad21-c72a7d89aa6f None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:55:44.457326 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed21cecd-e9d2-4252-ad21-c72a7d89aa6f None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:55:44.459078 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 666/1361] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:55:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:55:44.464405 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6563afbb-3ae9-4d77-aaf3-724fd4c7e3a6 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:55:44.464868 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6563afbb-3ae9-4d77-aaf3-724fd4c7e3a6 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:55:44.464948 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6563afbb-3ae9-4d77-aaf3-724fd4c7e3a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:55:44.537729 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-6563afbb-3ae9-4d77-aaf3-724fd4c7e3a6 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:55:44.539129 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-6563afbb-3ae9-4d77-aaf3-724fd4c7e3a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:55:44.584403 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:55:44.700911 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 696/1362] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:55:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 10:55:44.987544 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed21cecd-e9d2-4252-ad21-c72a7d89aa6f None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:55:44.989284 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-ed21cecd-e9d2-4252-ad21-c72a7d89aa6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:55:45.166215 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed21cecd-e9d2-4252-ad21-c72a7d89aa6f None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:55:45.179759 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:55:45.364765 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39610fc-50e9-4529-852f-c922ad4a1495 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a005d8f0c46d44c7b6f2201a54717b12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:55:45.365492 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39610fc-50e9-4529-852f-c922ad4a1495 service nova] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:55:45.365913 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39610fc-50e9-4529-852f-c922ad4a1495 service nova] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:55:45.366284 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39610fc-50e9-4529-852f-c922ad4a1495 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:55:45.368042 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-f39610fc-50e9-4529-852f-c922ad4a1495 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:55:45.501580 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39610fc-50e9-4529-852f-c922ad4a1495 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:55:45.504471 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39610fc-50e9-4529-852f-c922ad4a1495 service nova] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:55:45.558055 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 667/1363] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 10:55:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 571 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 10:55:47.944168 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34617890-ae73-4a6c-bb9e-4aa483c5c780 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:55:47.944736 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34617890-ae73-4a6c-bb9e-4aa483c5c780 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:55:47.944865 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34617890-ae73-4a6c-bb9e-4aa483c5c780 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:55:47.946323 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 697/1364] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:55:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:55:47.951926 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c20af-fb2d-49d6-83e8-8943ac4ca19b None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:55:47.952412 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c20af-fb2d-49d6-83e8-8943ac4ca19b None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:55:47.952508 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c20af-fb2d-49d6-83e8-8943ac4ca19b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:55:47.968895 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:55:48.025058 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-c85c20af-fb2d-49d6-83e8-8943ac4ca19b None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:55:48.026394 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-c85c20af-fb2d-49d6-83e8-8943ac4ca19b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:55:48.136954 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 668/1365] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:55:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 10:55:48.437687 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e4f92-07ac-446f-adf5-200625f1266f None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:55:48.438035 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e4f92-07ac-446f-adf5-200625f1266f None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:55:48.438243 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e4f92-07ac-446f-adf5-200625f1266f None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:55:48.439900 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 698/1366] 10.222.0.15 () {54 vars in 962 bytes} [Thu Aug 18 10:55:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:55:48.446115 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a941fac-6015-44c6-9892-b56c9f5319c0 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:55:48.446473 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a941fac-6015-44c6-9892-b56c9f5319c0 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:55:48.446667 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a941fac-6015-44c6-9892-b56c9f5319c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:55:48.534729 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-2a941fac-6015-44c6-9892-b56c9f5319c0 None None] MFA Rules not processed for user `a005d8f0c46d44c7b6f2201a54717b12`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:55:48.536253 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-2a941fac-6015-44c6-9892-b56c9f5319c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:55:48.575227 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:55:48.671815 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 669/1367] 10.222.0.15 () {58 vars in 1059 bytes} [Thu Aug 18 10:55:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 10:55:48.679719 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53e4f92-07ac-446f-adf5-200625f1266f None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:55:48.681196 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-d53e4f92-07ac-446f-adf5-200625f1266f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:55:48.845595 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53e4f92-07ac-446f-adf5-200625f1266f None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:55:48.872547 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:55:48.991735 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3344d55-1fba-4d63-bdf3-6c76ddb4ade1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a005d8f0c46d44c7b6f2201a54717b12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:55:48.992514 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3344d55-1fba-4d63-bdf3-6c76ddb4ade1 service nova] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:55:48.992894 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3344d55-1fba-4d63-bdf3-6c76ddb4ade1 service nova] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:55:48.993370 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3344d55-1fba-4d63-bdf3-6c76ddb4ade1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:55:48.995186 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-a3344d55-1fba-4d63-bdf3-6c76ddb4ade1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:55:49.094617 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3344d55-1fba-4d63-bdf3-6c76ddb4ade1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:55:49.096863 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3344d55-1fba-4d63-bdf3-6c76ddb4ade1 service nova] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:55:49.120215 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 699/1368] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 10:55:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 10:55:49.586847 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c1c744-6043-4a75-a516-cb6e651d993f None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:55:49.587371 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c1c744-6043-4a75-a516-cb6e651d993f None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:55:49.587371 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c1c744-6043-4a75-a516-cb6e651d993f None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:55:49.588815 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 670/1369] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:55:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:55:49.594224 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48063803-9b19-47dc-8da7-5a79b6011300 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:55:49.594515 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48063803-9b19-47dc-8da7-5a79b6011300 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:55:49.594796 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48063803-9b19-47dc-8da7-5a79b6011300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:55:49.640573 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:55:49.685601 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-48063803-9b19-47dc-8da7-5a79b6011300 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:55:49.686817 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-48063803-9b19-47dc-8da7-5a79b6011300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:55:49.797785 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 700/1370] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:55:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 10:55:50.357045 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de7113-f8cf-4178-87a7-757779623291 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:55:50.357329 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de7113-f8cf-4178-87a7-757779623291 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:55:50.357638 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de7113-f8cf-4178-87a7-757779623291 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:55:50.359361 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 671/1371] 10.222.0.15 () {54 vars in 964 bytes} [Thu Aug 18 10:55:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:55:50.364502 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80962d-539d-4ddb-976b-bfa17a413e09 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:55:50.365008 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80962d-539d-4ddb-976b-bfa17a413e09 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:55:50.365189 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80962d-539d-4ddb-976b-bfa17a413e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:55:50.453992 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-aa80962d-539d-4ddb-976b-bfa17a413e09 None None] MFA Rules not processed for user `5b8a09704b9b4ab2bffb813796ec6e77`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:55:50.455650 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-aa80962d-539d-4ddb-976b-bfa17a413e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:55:50.514439 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:55:50.548049 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 701/1372] 10.222.0.15 () {58 vars in 1061 bytes} [Thu Aug 18 10:55:50 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 10:55:50.556104 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de7113-f8cf-4178-87a7-757779623291 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:55:50.557661 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-b9de7113-f8cf-4178-87a7-757779623291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:55:50.679844 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de7113-f8cf-4178-87a7-757779623291 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:55:50.734323 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:55:50.781284 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a2b2d-edab-463f-a6fd-8ef81fa2c7ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b8a09704b9b4ab2bffb813796ec6e77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:55:50.781952 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a2b2d-edab-463f-a6fd-8ef81fa2c7ef service cinder] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:55:50.782295 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a2b2d-edab-463f-a6fd-8ef81fa2c7ef service cinder] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:55:50.782573 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a2b2d-edab-463f-a6fd-8ef81fa2c7ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:55:50.785456 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-5d1a2b2d-edab-463f-a6fd-8ef81fa2c7ef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:55:50.912961 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1a2b2d-edab-463f-a6fd-8ef81fa2c7ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:55:50.914240 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1a2b2d-edab-463f-a6fd-8ef81fa2c7ef service cinder] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:55:50.937555 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 672/1373] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 10:55:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 10:55:51.346573 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095c357-864a-43c4-8e85-db3666d93d92 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:55:51.346862 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095c357-864a-43c4-8e85-db3666d93d92 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:55:51.347139 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095c357-864a-43c4-8e85-db3666d93d92 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:55:51.348510 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 702/1374] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:55:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 10:55:51.353699 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed23a32a-b49e-4343-b151-e4a28f3179c6 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:55:51.353995 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed23a32a-b49e-4343-b151-e4a28f3179c6 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:55:51.354275 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed23a32a-b49e-4343-b151-e4a28f3179c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:55:51.422247 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-ed23a32a-b49e-4343-b151-e4a28f3179c6 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:55:51.423465 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-ed23a32a-b49e-4343-b151-e4a28f3179c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:55:51.446576 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:55:51.531238 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 673/1375] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:55:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 10:55:51.820435 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1095c357-864a-43c4-8e85-db3666d93d92 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:55:51.822108 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-1095c357-864a-43c4-8e85-db3666d93d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:55:51.978982 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1095c357-864a-43c4-8e85-db3666d93d92 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:55:52.033204 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:55:52.095228 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b494e6be-c417-4274-ad3d-5f6bb86d44df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a005d8f0c46d44c7b6f2201a54717b12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:55:52.095758 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b494e6be-c417-4274-ad3d-5f6bb86d44df service nova] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:55:52.096035 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b494e6be-c417-4274-ad3d-5f6bb86d44df service nova] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:55:52.096355 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b494e6be-c417-4274-ad3d-5f6bb86d44df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:55:52.098273 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-b494e6be-c417-4274-ad3d-5f6bb86d44df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:55:52.186951 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b494e6be-c417-4274-ad3d-5f6bb86d44df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:55:52.188559 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b494e6be-c417-4274-ad3d-5f6bb86d44df service nova] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:55:52.208915 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 703/1376] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 10:55:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 10:55:54.186855 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9483b578-173e-4983-bde3-cd27db808b6c None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:55:54.187458 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9483b578-173e-4983-bde3-cd27db808b6c None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:55:54.187458 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9483b578-173e-4983-bde3-cd27db808b6c None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:55:54.188903 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 674/1377] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:55:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:55:54.195983 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b73ded-34f1-46da-bf17-c5656850c30b None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:55:54.196521 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b73ded-34f1-46da-bf17-c5656850c30b None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:55:54.196521 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b73ded-34f1-46da-bf17-c5656850c30b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:55:54.265289 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-64b73ded-34f1-46da-bf17-c5656850c30b None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:55:54.266542 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-64b73ded-34f1-46da-bf17-c5656850c30b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:55:54.274315 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:55:54.367717 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 704/1378] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:55:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 10:55:54.677341 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9483b578-173e-4983-bde3-cd27db808b6c None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:55:54.679377 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-9483b578-173e-4983-bde3-cd27db808b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:55:54.864347 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9483b578-173e-4983-bde3-cd27db808b6c None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:55:54.869256 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:55:54.997145 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf09c8d-2a23-4ded-9c06-ae361d5fe932 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a005d8f0c46d44c7b6f2201a54717b12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:55:54.997785 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf09c8d-2a23-4ded-9c06-ae361d5fe932 service nova] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:55:54.998065 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf09c8d-2a23-4ded-9c06-ae361d5fe932 service nova] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:55:54.998352 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf09c8d-2a23-4ded-9c06-ae361d5fe932 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:55:54.999947 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-edf09c8d-2a23-4ded-9c06-ae361d5fe932 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:55:55.099692 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf09c8d-2a23-4ded-9c06-ae361d5fe932 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:55:55.101999 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf09c8d-2a23-4ded-9c06-ae361d5fe932 service nova] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:55:55.122150 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 675/1379] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 10:55:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 10:55:57.120835 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a053b1-822d-4f9e-85e5-bedd5419cf5b None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:55:57.121359 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a053b1-822d-4f9e-85e5-bedd5419cf5b None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:55:57.121359 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a053b1-822d-4f9e-85e5-bedd5419cf5b None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:55:57.122757 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 705/1380] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:55:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:55:57.128812 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a12ea-62ef-43a8-ac60-0bc6f1c5b66b None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:55:57.129245 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a12ea-62ef-43a8-ac60-0bc6f1c5b66b None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:55:57.129365 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a12ea-62ef-43a8-ac60-0bc6f1c5b66b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:55:57.141245 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:55:57.207071 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-cc7a12ea-62ef-43a8-ac60-0bc6f1c5b66b None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:55:57.208282 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-cc7a12ea-62ef-43a8-ac60-0bc6f1c5b66b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:55:57.322277 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 676/1381] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:55:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 10:55:57.615363 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a053b1-822d-4f9e-85e5-bedd5419cf5b None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:55:57.616890 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-53a053b1-822d-4f9e-85e5-bedd5419cf5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:55:57.777450 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:55:57.791869 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a053b1-822d-4f9e-85e5-bedd5419cf5b None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:55:57.923731 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3b68bd-c464-4f54-beab-c56ed31207f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a005d8f0c46d44c7b6f2201a54717b12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:55:57.924941 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3b68bd-c464-4f54-beab-c56ed31207f2 service nova] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:55:57.925333 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3b68bd-c464-4f54-beab-c56ed31207f2 service nova] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:55:57.925842 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3b68bd-c464-4f54-beab-c56ed31207f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:55:57.927484 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-6b3b68bd-c464-4f54-beab-c56ed31207f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:55:58.041048 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3b68bd-c464-4f54-beab-c56ed31207f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:55:58.042617 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3b68bd-c464-4f54-beab-c56ed31207f2 service nova] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:55:58.054030 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:55:58.064273 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 706/1382] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 10:55:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 10:56:00.416097 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0132a25d-4635-4ba4-afb1-17429f57312f None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:56:00.416627 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0132a25d-4635-4ba4-afb1-17429f57312f None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:56:00.416792 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0132a25d-4635-4ba4-afb1-17429f57312f None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:56:00.418656 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 677/1383] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:56:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:56:00.425132 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a8a328-94b3-4973-ae7a-57fcf088f384 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:56:00.425630 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a8a328-94b3-4973-ae7a-57fcf088f384 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:56:00.425766 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a8a328-94b3-4973-ae7a-57fcf088f384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:56:00.493987 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-44a8a328-94b3-4973-ae7a-57fcf088f384 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:56:00.495204 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-44a8a328-94b3-4973-ae7a-57fcf088f384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:56:00.622768 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 707/1384] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:56:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 10:56:01.015183 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0132a25d-4635-4ba4-afb1-17429f57312f None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:56:01.016849 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-0132a25d-4635-4ba4-afb1-17429f57312f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:56:01.110685 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:56:01.184146 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0132a25d-4635-4ba4-afb1-17429f57312f None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:56:01.314341 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4049b2c8-12d4-43ac-866a-67b0215657cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a005d8f0c46d44c7b6f2201a54717b12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:56:01.315001 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049b2c8-12d4-43ac-866a-67b0215657cb service nova] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:56:01.315288 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049b2c8-12d4-43ac-866a-67b0215657cb service nova] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:56:01.315585 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049b2c8-12d4-43ac-866a-67b0215657cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:56:01.317305 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-4049b2c8-12d4-43ac-866a-67b0215657cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:56:01.371892 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:56:01.424432 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4049b2c8-12d4-43ac-866a-67b0215657cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:56:01.426684 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4049b2c8-12d4-43ac-866a-67b0215657cb service nova] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:56:01.445998 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 678/1385] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 10:56:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 10:56:03.670278 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11df60b2-58ad-4e69-87f3-c11db21de6a4 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:56:03.670951 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11df60b2-58ad-4e69-87f3-c11db21de6a4 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:56:03.670951 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11df60b2-58ad-4e69-87f3-c11db21de6a4 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:56:03.672202 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 708/1386] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:56:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:56:03.678189 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6db542-395b-4059-a6ee-856831c2b2e5 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:56:03.678672 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6db542-395b-4059-a6ee-856831c2b2e5 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:56:03.678842 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6db542-395b-4059-a6ee-856831c2b2e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:56:03.749877 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-5e6db542-395b-4059-a6ee-856831c2b2e5 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:56:03.749877 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-5e6db542-395b-4059-a6ee-856831c2b2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:56:03.851436 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 679/1387] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:56:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 10:56:04.147327 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11df60b2-58ad-4e69-87f3-c11db21de6a4 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:56:04.148934 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-11df60b2-58ad-4e69-87f3-c11db21de6a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:56:04.234694 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:56:04.316220 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11df60b2-58ad-4e69-87f3-c11db21de6a4 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:56:04.440587 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edbc7b9-9138-425c-9b4d-86568a1d1f78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a005d8f0c46d44c7b6f2201a54717b12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:56:04.441213 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edbc7b9-9138-425c-9b4d-86568a1d1f78 service nova] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:56:04.441488 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edbc7b9-9138-425c-9b4d-86568a1d1f78 service nova] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:56:04.441766 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edbc7b9-9138-425c-9b4d-86568a1d1f78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:56:04.443492 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-3edbc7b9-9138-425c-9b4d-86568a1d1f78 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:56:04.484053 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:56:04.545015 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edbc7b9-9138-425c-9b4d-86568a1d1f78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:56:04.546671 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edbc7b9-9138-425c-9b4d-86568a1d1f78 service nova] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:56:04.566502 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 709/1388] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 10:56:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 10:56:06.441594 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc84e28e-d96d-4efe-9cfd-a1049ae5e4da None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:56:06.442238 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc84e28e-d96d-4efe-9cfd-a1049ae5e4da None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:56:06.442238 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc84e28e-d96d-4efe-9cfd-a1049ae5e4da None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:56:06.443670 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 680/1389] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:56:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:56:06.449090 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec12491-ea08-4e3e-97cf-19d148de97ea None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:56:06.449591 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec12491-ea08-4e3e-97cf-19d148de97ea None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:56:06.449705 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec12491-ea08-4e3e-97cf-19d148de97ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:56:06.519909 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-dec12491-ea08-4e3e-97cf-19d148de97ea None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:56:06.521114 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-dec12491-ea08-4e3e-97cf-19d148de97ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:56:06.539871 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e114644-f12c-4bde-9e9a-b1e973bdbc49 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:56:06.540154 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e114644-f12c-4bde-9e9a-b1e973bdbc49 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:56:06.540431 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e114644-f12c-4bde-9e9a-b1e973bdbc49 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:56:06.541833 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 681/1390] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:56:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:56:06.546955 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c0ae90-febd-4f3f-8d3e-2e4824b52739 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:56:06.547239 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c0ae90-febd-4f3f-8d3e-2e4824b52739 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:56:06.547517 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c0ae90-febd-4f3f-8d3e-2e4824b52739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:56:06.585128 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:56:06.621733 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-79c0ae90-febd-4f3f-8d3e-2e4824b52739 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:56:06.623012 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-79c0ae90-febd-4f3f-8d3e-2e4824b52739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:56:06.623920 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 710/1391] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:56:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 10:56:06.724163 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 682/1392] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:56:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 10:56:06.929060 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74adba55-bc8f-4ccc-a755-6aee25d3ab35 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:56:06.929356 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74adba55-bc8f-4ccc-a755-6aee25d3ab35 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:56:06.929673 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74adba55-bc8f-4ccc-a755-6aee25d3ab35 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:56:06.931059 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 711/1393] 10.222.0.15 () {54 vars in 967 bytes} [Thu Aug 18 10:56:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:56:06.936268 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c44a8-cf0c-4a79-bc5c-54157685f346 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:56:06.936557 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c44a8-cf0c-4a79-bc5c-54157685f346 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:56:06.936835 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c44a8-cf0c-4a79-bc5c-54157685f346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:56:07.014611 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74adba55-bc8f-4ccc-a755-6aee25d3ab35 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:56:07.016315 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-74adba55-bc8f-4ccc-a755-6aee25d3ab35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:56:07.017729 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-852c44a8-cf0c-4a79-bc5c-54157685f346 None None] MFA Rules not processed for user `77211d2dcef242c4a7fe2198556d5efc`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:56:07.018927 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-852c44a8-cf0c-4a79-bc5c-54157685f346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:56:07.031344 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:56:07.070133 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:56:07.098847 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 683/1394] 10.222.0.15 () {58 vars in 1064 bytes} [Thu Aug 18 10:56:06 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 10:56:07.106504 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c44a8-cf0c-4a79-bc5c-54157685f346 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:56:07.114231 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c44a8-cf0c-4a79-bc5c-54157685f346 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:56:07.185272 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74adba55-bc8f-4ccc-a755-6aee25d3ab35 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:56:07.199371 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1000915-3e2d-4f10-b668-4dc93d1beb2b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77211d2dcef242c4a7fe2198556d5efc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:56:07.200014 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1000915-3e2d-4f10-b668-4dc93d1beb2b service glance] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:56:07.201802 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1000915-3e2d-4f10-b668-4dc93d1beb2b service glance] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:56:07.202609 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1000915-3e2d-4f10-b668-4dc93d1beb2b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:56:07.206149 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-a1000915-3e2d-4f10-b668-4dc93d1beb2b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:56:07.276468 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:56:07.307444 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a45ae3-82b2-4fa1-bd3d-a9a9351da202 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a005d8f0c46d44c7b6f2201a54717b12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:56:07.308059 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a45ae3-82b2-4fa1-bd3d-a9a9351da202 service nova] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:56:07.308343 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a45ae3-82b2-4fa1-bd3d-a9a9351da202 service nova] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:56:07.308613 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a45ae3-82b2-4fa1-bd3d-a9a9351da202 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:56:07.310308 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-38a45ae3-82b2-4fa1-bd3d-a9a9351da202 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:56:07.332241 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1000915-3e2d-4f10-b668-4dc93d1beb2b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:56:07.333725 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1000915-3e2d-4f10-b668-4dc93d1beb2b service glance] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:56:07.350248 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:56:07.357052 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 684/1395] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 10:56:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 10:56:07.402431 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a45ae3-82b2-4fa1-bd3d-a9a9351da202 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:56:07.404104 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a45ae3-82b2-4fa1-bd3d-a9a9351da202 service nova] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:56:07.424718 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 712/1396] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 10:56:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 10:56:08.143063 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d330c2-7bb9-4cf7-87c5-ad83caccda49 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:56:08.143633 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d330c2-7bb9-4cf7-87c5-ad83caccda49 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:56:08.144017 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d330c2-7bb9-4cf7-87c5-ad83caccda49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:56:08.213763 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-28d330c2-7bb9-4cf7-87c5-ad83caccda49 None None] MFA Rules not processed for user `bcacf809f13043ab90716607160a70db`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:56:08.215000 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-28d330c2-7bb9-4cf7-87c5-ad83caccda49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:56:08.317613 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 685/1397] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Aug 18 10:56:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 10:56:08.369097 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1a522-ed47-44ba-bcf6-7fd85b39d1cd None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:56:08.369855 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1a522-ed47-44ba-bcf6-7fd85b39d1cd None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:56:08.369855 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1a522-ed47-44ba-bcf6-7fd85b39d1cd None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:56:08.371260 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 713/1398] 10.222.0.15 () {54 vars in 943 bytes} [Thu Aug 18 10:56:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:56:08.377705 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcec4b1-f720-46aa-bfbc-2eb261e89b18 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:56:08.377903 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcec4b1-f720-46aa-bfbc-2eb261e89b18 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:56:08.378175 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcec4b1-f720-46aa-bfbc-2eb261e89b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:56:08.461812 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-8fcec4b1-f720-46aa-bfbc-2eb261e89b18 None None] MFA Rules not processed for user `f97e906b1922419d8511ab1c8b9c86e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:56:08.463149 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-8fcec4b1-f720-46aa-bfbc-2eb261e89b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:56:08.493141 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:56:08.575881 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 686/1399] 10.222.0.15 () {58 vars in 1040 bytes} [Thu Aug 18 10:56:08 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 10:56:08.586226 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a1a522-ed47-44ba-bcf6-7fd85b39d1cd None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:56:08.587829 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-d7a1a522-ed47-44ba-bcf6-7fd85b39d1cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:56:08.686342 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:56:08.730410 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a1a522-ed47-44ba-bcf6-7fd85b39d1cd None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:56:08.837052 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af4ca64-a14c-4a1a-80b6-6e5688be68a8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f97e906b1922419d8511ab1c8b9c86e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:56:08.837688 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af4ca64-a14c-4a1a-80b6-6e5688be68a8 service swift] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:56:08.837967 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af4ca64-a14c-4a1a-80b6-6e5688be68a8 service swift] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:56:08.838234 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af4ca64-a14c-4a1a-80b6-6e5688be68a8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:56:08.839891 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-9af4ca64-a14c-4a1a-80b6-6e5688be68a8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:56:08.945461 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af4ca64-a14c-4a1a-80b6-6e5688be68a8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:56:08.947128 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af4ca64-a14c-4a1a-80b6-6e5688be68a8 service swift] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:56:08.950639 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:56:08.956872 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 714/1400] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Aug 18 10:56:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 10:56:09.420304 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874f1a9-d60c-43e5-a0b3-c8f712050e90 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:56:09.420966 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874f1a9-d60c-43e5-a0b3-c8f712050e90 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:56:09.420966 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874f1a9-d60c-43e5-a0b3-c8f712050e90 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:56:09.422365 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 687/1401] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:56:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:56:09.429300 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb366f2-eda1-44ce-aa06-eb506a9397a1 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:56:09.429860 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb366f2-eda1-44ce-aa06-eb506a9397a1 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:56:09.429860 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb366f2-eda1-44ce-aa06-eb506a9397a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:56:09.506757 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-1fb366f2-eda1-44ce-aa06-eb506a9397a1 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:56:09.508391 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-1fb366f2-eda1-44ce-aa06-eb506a9397a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:56:09.616530 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 715/1402] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:56:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 10:56:09.913868 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d874f1a9-d60c-43e5-a0b3-c8f712050e90 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:56:09.915555 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-d874f1a9-d60c-43e5-a0b3-c8f712050e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:56:10.089843 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d874f1a9-d60c-43e5-a0b3-c8f712050e90 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:56:10.093131 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:56:10.229138 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3f97fa-092f-402a-9e6c-299b3c99ae52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a005d8f0c46d44c7b6f2201a54717b12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:56:10.229876 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f97fa-092f-402a-9e6c-299b3c99ae52 service nova] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:56:10.230063 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f97fa-092f-402a-9e6c-299b3c99ae52 service nova] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:56:10.230339 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f97fa-092f-402a-9e6c-299b3c99ae52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:56:10.231999 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-4f3f97fa-092f-402a-9e6c-299b3c99ae52 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:56:10.338904 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3f97fa-092f-402a-9e6c-299b3c99ae52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:56:10.340533 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3f97fa-092f-402a-9e6c-299b3c99ae52 service nova] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:56:10.363556 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 688/1403] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 10:56:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 10:56:12.381947 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9acc36d-4115-4146-9969-b4135c6cbd8a None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:56:12.382531 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9acc36d-4115-4146-9969-b4135c6cbd8a None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:56:12.382531 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9acc36d-4115-4146-9969-b4135c6cbd8a None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:56:12.383831 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 716/1404] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:56:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:56:12.388999 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723991dc-64da-4091-8204-4478a0a993a4 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:56:12.389450 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723991dc-64da-4091-8204-4478a0a993a4 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:56:12.389569 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723991dc-64da-4091-8204-4478a0a993a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:56:12.400962 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:56:12.466332 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-723991dc-64da-4091-8204-4478a0a993a4 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:56:12.467645 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-723991dc-64da-4091-8204-4478a0a993a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:56:12.589789 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 689/1405] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:56:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 10:56:12.876113 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9acc36d-4115-4146-9969-b4135c6cbd8a None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:56:12.877902 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-f9acc36d-4115-4146-9969-b4135c6cbd8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:56:12.971091 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:56:13.061509 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9acc36d-4115-4146-9969-b4135c6cbd8a None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:56:13.206022 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7c3942-b36e-4ca8-afbb-360150222e60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a005d8f0c46d44c7b6f2201a54717b12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:56:13.206365 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c3942-b36e-4ca8-afbb-360150222e60 service nova] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:56:13.206637 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c3942-b36e-4ca8-afbb-360150222e60 service nova] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:56:13.206908 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c3942-b36e-4ca8-afbb-360150222e60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:56:13.208549 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-fc7c3942-b36e-4ca8-afbb-360150222e60 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:56:13.255537 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:56:13.318726 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7c3942-b36e-4ca8-afbb-360150222e60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:56:13.320716 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7c3942-b36e-4ca8-afbb-360150222e60 service nova] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:56:13.340460 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 717/1406] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 10:56:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 10:56:15.400026 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68a89a2-731e-4945-9a51-e28ca74001e4 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:56:15.400605 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68a89a2-731e-4945-9a51-e28ca74001e4 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:56:15.400605 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68a89a2-731e-4945-9a51-e28ca74001e4 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:56:15.401961 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 690/1407] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:56:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:56:15.410151 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cbef5f-698c-43e3-9e6b-cee4a1adaaa9 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:56:15.410151 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cbef5f-698c-43e3-9e6b-cee4a1adaaa9 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:56:15.410151 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cbef5f-698c-43e3-9e6b-cee4a1adaaa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:56:15.487864 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-50cbef5f-698c-43e3-9e6b-cee4a1adaaa9 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:56:15.489109 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-50cbef5f-698c-43e3-9e6b-cee4a1adaaa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:56:15.613578 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 718/1408] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:56:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 10:56:15.924992 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68a89a2-731e-4945-9a51-e28ca74001e4 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:56:15.926568 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-f68a89a2-731e-4945-9a51-e28ca74001e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:56:16.021236 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:56:16.094502 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68a89a2-731e-4945-9a51-e28ca74001e4 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:56:16.240466 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c357e1a5-c00e-4ace-a910-479b63709e4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a005d8f0c46d44c7b6f2201a54717b12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:56:16.241480 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357e1a5-c00e-4ace-a910-479b63709e4d service nova] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:56:16.241790 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357e1a5-c00e-4ace-a910-479b63709e4d service nova] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:56:16.242076 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357e1a5-c00e-4ace-a910-479b63709e4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:56:16.243731 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-c357e1a5-c00e-4ace-a910-479b63709e4d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:56:16.301161 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:56:16.347531 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c357e1a5-c00e-4ace-a910-479b63709e4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:56:16.349135 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c357e1a5-c00e-4ace-a910-479b63709e4d service nova] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:56:16.368857 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 691/1409] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 10:56:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 10:56:25.607541 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=93 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:56:26.366725 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=24 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:56:31.797713 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d2f115-1486-467a-8a27-7a3e4cec902a None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:56:31.799083 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d2f115-1486-467a-8a27-7a3e4cec902a None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:56:31.799083 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d2f115-1486-467a-8a27-7a3e4cec902a None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:56:31.800412 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 719/1410] 10.222.0.15 () {54 vars in 918 bytes} [Thu Aug 18 10:56:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:56:31.805419 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d53696-6256-4da1-9455-79a920f4797b None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:56:31.805910 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d53696-6256-4da1-9455-79a920f4797b None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:56:31.806021 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d53696-6256-4da1-9455-79a920f4797b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:56:31.882898 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-84d53696-6256-4da1-9455-79a920f4797b None None] MFA Rules not processed for user `0f918bcdd83d4d48be3fff5a48c54929`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:56:31.884129 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-84d53696-6256-4da1-9455-79a920f4797b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:56:32.000914 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 692/1411] 10.222.0.15 () {58 vars in 1015 bytes} [Thu Aug 18 10:56:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 10:56:32.015129 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be570bae-c8ea-4256-b2ee-1e808af8bf07 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:56:32.015415 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be570bae-c8ea-4256-b2ee-1e808af8bf07 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:56:32.015693 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be570bae-c8ea-4256-b2ee-1e808af8bf07 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:56:32.017217 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 720/1412] 10.222.0.15 () {54 vars in 918 bytes} [Thu Aug 18 10:56:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:56:32.021733 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca82ead-cbd0-42b0-939f-1c27d4877e7f None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:56:32.022043 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca82ead-cbd0-42b0-939f-1c27d4877e7f None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:56:32.022322 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca82ead-cbd0-42b0-939f-1c27d4877e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:56:32.097771 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:56:32.100876 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-1ca82ead-cbd0-42b0-939f-1c27d4877e7f None None] MFA Rules not processed for user `a005d8f0c46d44c7b6f2201a54717b12`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:56:32.102817 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-1ca82ead-cbd0-42b0-939f-1c27d4877e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:56:32.225781 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 693/1413] 10.222.0.15 () {58 vars in 1015 bytes} [Thu Aug 18 10:56:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 10:56:34.680864 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41912ae1-d8b8-43d1-a35c-d61a205aa1a9 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:56:34.681442 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41912ae1-d8b8-43d1-a35c-d61a205aa1a9 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:56:34.681442 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41912ae1-d8b8-43d1-a35c-d61a205aa1a9 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:56:34.682823 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 721/1414] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 10:56:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:56:34.688405 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f50d3ec-15aa-434b-a752-814c25b0a06e None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:56:34.689390 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f50d3ec-15aa-434b-a752-814c25b0a06e None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:56:34.689610 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f50d3ec-15aa-434b-a752-814c25b0a06e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:56:34.757900 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-8f50d3ec-15aa-434b-a752-814c25b0a06e None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:56:34.759104 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-8f50d3ec-15aa-434b-a752-814c25b0a06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:56:34.815349 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:56:34.858683 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 694/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 10:56:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 10:56:35.150184 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41912ae1-d8b8-43d1-a35c-d61a205aa1a9 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:56:35.151754 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-41912ae1-d8b8-43d1-a35c-d61a205aa1a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:56:35.299133 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41912ae1-d8b8-43d1-a35c-d61a205aa1a9 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:56:35.375594 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:56:35.418561 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850c2224-a545-4d88-858e-190b0f636684 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a005d8f0c46d44c7b6f2201a54717b12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:56:35.419089 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c2224-a545-4d88-858e-190b0f636684 service nova] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:56:35.419371 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c2224-a545-4d88-858e-190b0f636684 service nova] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:56:35.419646 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c2224-a545-4d88-858e-190b0f636684 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:56:35.421265 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-850c2224-a545-4d88-858e-190b0f636684 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:56:35.518023 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850c2224-a545-4d88-858e-190b0f636684 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:56:35.519681 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850c2224-a545-4d88-858e-190b0f636684 service nova] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:56:35.538373 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 722/1416] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 10:56:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 10:56:36.451685 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059bc7e5-f457-4e37-b446-49058a367417 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:56:36.452213 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059bc7e5-f457-4e37-b446-49058a367417 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:56:36.452213 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059bc7e5-f457-4e37-b446-49058a367417 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:56:36.453676 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 695/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 10:56:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:56:36.458935 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14272f-a6bf-4f2b-9a33-e9f222047f28 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:56:36.459392 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14272f-a6bf-4f2b-9a33-e9f222047f28 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:56:36.459492 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14272f-a6bf-4f2b-9a33-e9f222047f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:56:36.539717 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-0f14272f-a6bf-4f2b-9a33-e9f222047f28 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:56:36.540950 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-0f14272f-a6bf-4f2b-9a33-e9f222047f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:56:36.569170 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:56:36.643514 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 723/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 10:56:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 10:56:36.792766 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059bc7e5-f457-4e37-b446-49058a367417 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:56:36.794459 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-059bc7e5-f457-4e37-b446-49058a367417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:56:36.949166 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059bc7e5-f457-4e37-b446-49058a367417 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:56:36.991689 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:56:37.067000 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c5f04c-756b-4acf-9a16-0e65996c7ad3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a005d8f0c46d44c7b6f2201a54717b12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:56:37.067524 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c5f04c-756b-4acf-9a16-0e65996c7ad3 service nova] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:56:37.067804 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c5f04c-756b-4acf-9a16-0e65996c7ad3 service nova] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:56:37.068076 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c5f04c-756b-4acf-9a16-0e65996c7ad3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:56:37.069750 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-74c5f04c-756b-4acf-9a16-0e65996c7ad3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:56:37.161931 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c5f04c-756b-4acf-9a16-0e65996c7ad3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:56:37.163559 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c5f04c-756b-4acf-9a16-0e65996c7ad3 service nova] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:56:37.185260 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 696/1419] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 10:56:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 10:56:38.121889 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c9f48-1745-43be-a59b-bb7e9003f0f2 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:56:38.122427 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c9f48-1745-43be-a59b-bb7e9003f0f2 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:56:38.122427 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c9f48-1745-43be-a59b-bb7e9003f0f2 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:56:38.123800 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 724/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 10:56:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:56:38.129593 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6cd79e-d151-49e9-9000-743b01dd9bbb None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:56:38.130054 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6cd79e-d151-49e9-9000-743b01dd9bbb None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:56:38.130173 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6cd79e-d151-49e9-9000-743b01dd9bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:56:38.186264 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:56:38.209468 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-2e6cd79e-d151-49e9-9000-743b01dd9bbb None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:56:38.210702 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-2e6cd79e-d151-49e9-9000-743b01dd9bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:56:38.310178 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 697/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 10:56:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 10:56:38.461770 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41c9f48-1745-43be-a59b-bb7e9003f0f2 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:56:38.463311 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-b41c9f48-1745-43be-a59b-bb7e9003f0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:56:38.607648 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41c9f48-1745-43be-a59b-bb7e9003f0f2 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:56:38.619912 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:56:38.730628 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bac7dd4-2102-4557-983c-6ac2300b2d2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a005d8f0c46d44c7b6f2201a54717b12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:56:38.731145 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac7dd4-2102-4557-983c-6ac2300b2d2c service nova] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:56:38.731423 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac7dd4-2102-4557-983c-6ac2300b2d2c service nova] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:56:38.731693 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac7dd4-2102-4557-983c-6ac2300b2d2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:56:38.733309 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-3bac7dd4-2102-4557-983c-6ac2300b2d2c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:56:38.824733 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bac7dd4-2102-4557-983c-6ac2300b2d2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:56:38.826351 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bac7dd4-2102-4557-983c-6ac2300b2d2c service nova] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:56:38.845318 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 725/1422] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 10:56:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 10:56:39.723806 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38539355-e7a9-49f8-a5f4-96cd443fe84e None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:56:39.724346 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38539355-e7a9-49f8-a5f4-96cd443fe84e None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:56:39.724346 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38539355-e7a9-49f8-a5f4-96cd443fe84e None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:56:39.725777 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 698/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 10:56:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:56:39.730932 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b3ca6-821d-406d-a4bd-e5a8c91d5899 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:56:39.731372 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b3ca6-821d-406d-a4bd-e5a8c91d5899 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:56:39.731479 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b3ca6-821d-406d-a4bd-e5a8c91d5899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:56:39.758245 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:56:39.820973 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-944b3ca6-821d-406d-a4bd-e5a8c91d5899 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:56:39.822225 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-944b3ca6-821d-406d-a4bd-e5a8c91d5899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:56:39.918329 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 726/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 10:56:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 10:56:40.068373 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38539355-e7a9-49f8-a5f4-96cd443fe84e None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:56:40.069949 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-38539355-e7a9-49f8-a5f4-96cd443fe84e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:56:40.185209 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:56:40.225288 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38539355-e7a9-49f8-a5f4-96cd443fe84e None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:56:40.341090 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02c6ca7-24a2-4063-8941-702a0e0ca25e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a005d8f0c46d44c7b6f2201a54717b12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:56:40.341640 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c6ca7-24a2-4063-8941-702a0e0ca25e service nova] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:56:40.341920 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c6ca7-24a2-4063-8941-702a0e0ca25e service nova] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:56:40.342189 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c6ca7-24a2-4063-8941-702a0e0ca25e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:56:40.343796 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-b02c6ca7-24a2-4063-8941-702a0e0ca25e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:56:40.422172 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:56:40.440856 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02c6ca7-24a2-4063-8941-702a0e0ca25e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:56:40.442525 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02c6ca7-24a2-4063-8941-702a0e0ca25e service nova] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:56:40.461043 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 699/1425] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 10:56:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 10:56:41.334882 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993f26ee-b965-412d-ae1d-16c009e21799 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:56:41.335462 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993f26ee-b965-412d-ae1d-16c009e21799 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:56:41.335462 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993f26ee-b965-412d-ae1d-16c009e21799 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:56:41.336802 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 727/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 10:56:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:56:41.341747 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9936ce1-a284-4366-81ff-b853560a7ae6 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:56:41.342149 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9936ce1-a284-4366-81ff-b853560a7ae6 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:56:41.342300 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9936ce1-a284-4366-81ff-b853560a7ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:56:41.419639 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-d9936ce1-a284-4366-81ff-b853560a7ae6 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:56:41.420847 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-d9936ce1-a284-4366-81ff-b853560a7ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:56:41.522960 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 700/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 10:56:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 10:56:41.674095 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993f26ee-b965-412d-ae1d-16c009e21799 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:56:41.675708 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-993f26ee-b965-412d-ae1d-16c009e21799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:56:41.762898 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:56:41.829186 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993f26ee-b965-412d-ae1d-16c009e21799 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:56:41.945309 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818aa178-38b8-4c0a-a63a-50c60abaa038 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a005d8f0c46d44c7b6f2201a54717b12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:56:41.945947 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818aa178-38b8-4c0a-a63a-50c60abaa038 service nova] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:56:41.946230 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818aa178-38b8-4c0a-a63a-50c60abaa038 service nova] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:56:41.946534 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818aa178-38b8-4c0a-a63a-50c60abaa038 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:56:41.948156 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-818aa178-38b8-4c0a-a63a-50c60abaa038 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:56:41.997789 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:56:42.039291 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818aa178-38b8-4c0a-a63a-50c60abaa038 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:56:42.040912 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818aa178-38b8-4c0a-a63a-50c60abaa038 service nova] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:56:42.059444 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 728/1428] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 10:56:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 10:56:42.900551 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4abc879-abeb-44c8-9fdc-e58eddf871f6 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:56:42.901214 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4abc879-abeb-44c8-9fdc-e58eddf871f6 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:56:42.901214 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4abc879-abeb-44c8-9fdc-e58eddf871f6 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:56:42.902462 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 701/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 10:56:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:56:42.907649 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe3e5fe-6363-4125-ae57-4e11c1d0e01c None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:56:42.908284 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe3e5fe-6363-4125-ae57-4e11c1d0e01c None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:56:42.908284 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe3e5fe-6363-4125-ae57-4e11c1d0e01c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:56:42.986004 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-dbe3e5fe-6363-4125-ae57-4e11c1d0e01c None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:56:42.987223 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-dbe3e5fe-6363-4125-ae57-4e11c1d0e01c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:56:43.091143 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 729/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 10:56:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 10:56:43.245287 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4abc879-abeb-44c8-9fdc-e58eddf871f6 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:56:43.246890 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-e4abc879-abeb-44c8-9fdc-e58eddf871f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:56:43.300469 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:56:43.401426 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4abc879-abeb-44c8-9fdc-e58eddf871f6 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:56:43.516881 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65cd187-d6a4-42cd-b146-d183a0e4b06d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a005d8f0c46d44c7b6f2201a54717b12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:56:43.517484 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65cd187-d6a4-42cd-b146-d183a0e4b06d service nova] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:56:43.517790 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65cd187-d6a4-42cd-b146-d183a0e4b06d service nova] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:56:43.518060 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65cd187-d6a4-42cd-b146-d183a0e4b06d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:56:43.519660 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-a65cd187-d6a4-42cd-b146-d183a0e4b06d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:56:43.526662 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:56:43.614438 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65cd187-d6a4-42cd-b146-d183a0e4b06d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:56:43.616079 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65cd187-d6a4-42cd-b146-d183a0e4b06d service nova] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:56:43.634763 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 702/1431] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 10:56:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 10:56:44.451158 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651afe22-7aa5-486b-859a-da73d787bbc4 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:56:44.451670 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651afe22-7aa5-486b-859a-da73d787bbc4 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:56:44.451783 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651afe22-7aa5-486b-859a-da73d787bbc4 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:56:44.453054 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 730/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 10:56:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:56:44.458936 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f66190-4080-45ea-a6e2-3b13be71169d None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:56:44.459371 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f66190-4080-45ea-a6e2-3b13be71169d None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:56:44.459477 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f66190-4080-45ea-a6e2-3b13be71169d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:56:44.536560 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-f4f66190-4080-45ea-a6e2-3b13be71169d None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:56:44.537778 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-f4f66190-4080-45ea-a6e2-3b13be71169d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:56:44.608027 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:56:44.642933 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 703/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 10:56:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 10:56:44.795864 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651afe22-7aa5-486b-859a-da73d787bbc4 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:56:44.797401 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-651afe22-7aa5-486b-859a-da73d787bbc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:56:44.816306 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:56:44.947047 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651afe22-7aa5-486b-859a-da73d787bbc4 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:56:45.033955 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:56:45.061485 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe1b94b-edc4-4ae9-b1c1-332d301be5a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a005d8f0c46d44c7b6f2201a54717b12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:56:45.062059 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe1b94b-edc4-4ae9-b1c1-332d301be5a5 service nova] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:56:45.062339 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe1b94b-edc4-4ae9-b1c1-332d301be5a5 service nova] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:56:45.062614 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe1b94b-edc4-4ae9-b1c1-332d301be5a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:56:45.065157 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-9fe1b94b-edc4-4ae9-b1c1-332d301be5a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:56:45.152118 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe1b94b-edc4-4ae9-b1c1-332d301be5a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:56:45.153743 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe1b94b-edc4-4ae9-b1c1-332d301be5a5 service nova] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:56:45.172012 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 731/1434] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 10:56:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 10:56:45.999841 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed152a6-cfca-4df8-88ef-3616a1dbaffb None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:56:46.000420 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed152a6-cfca-4df8-88ef-3616a1dbaffb None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:56:46.000420 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed152a6-cfca-4df8-88ef-3616a1dbaffb None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:56:46.001912 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 704/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 10:56:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:56:46.006881 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3208e575-4a89-4324-8627-741b03decbe4 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:56:46.007333 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3208e575-4a89-4324-8627-741b03decbe4 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:56:46.007439 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3208e575-4a89-4324-8627-741b03decbe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:56:46.103181 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-3208e575-4a89-4324-8627-741b03decbe4 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:56:46.104398 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-3208e575-4a89-4324-8627-741b03decbe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:56:46.150979 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:56:46.212632 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 732/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 10:56:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 10:56:46.371156 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed152a6-cfca-4df8-88ef-3616a1dbaffb None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:56:46.372724 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-aed152a6-cfca-4df8-88ef-3616a1dbaffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:56:46.534559 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed152a6-cfca-4df8-88ef-3616a1dbaffb None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:56:46.597435 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:56:46.663935 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e094d25-e78d-46fc-9f99-417177128704 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a005d8f0c46d44c7b6f2201a54717b12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:56:46.664454 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e094d25-e78d-46fc-9f99-417177128704 service nova] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:56:46.664707 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e094d25-e78d-46fc-9f99-417177128704 service nova] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:56:46.664979 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e094d25-e78d-46fc-9f99-417177128704 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:56:46.666627 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-8e094d25-e78d-46fc-9f99-417177128704 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:56:46.767505 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e094d25-e78d-46fc-9f99-417177128704 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:56:46.769297 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e094d25-e78d-46fc-9f99-417177128704 service nova] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:56:46.791529 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 705/1437] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 10:56:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 10:56:47.631877 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6662ff6e-a460-4f16-b542-1d18b65301d0 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:56:47.632442 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6662ff6e-a460-4f16-b542-1d18b65301d0 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:56:47.632442 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6662ff6e-a460-4f16-b542-1d18b65301d0 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:56:47.633832 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 733/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 10:56:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:56:47.638949 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f72bde-2d39-4e08-ab97-07a8a4fa0bfd None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:56:47.639406 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f72bde-2d39-4e08-ab97-07a8a4fa0bfd None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:56:47.639512 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f72bde-2d39-4e08-ab97-07a8a4fa0bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:56:47.720031 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-58f72bde-2d39-4e08-ab97-07a8a4fa0bfd None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:56:47.721233 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-58f72bde-2d39-4e08-ab97-07a8a4fa0bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:56:47.723296 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:56:47.821317 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 706/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 10:56:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 10:56:47.973811 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6662ff6e-a460-4f16-b542-1d18b65301d0 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:56:47.975303 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-6662ff6e-a460-4f16-b542-1d18b65301d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:56:48.126524 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6662ff6e-a460-4f16-b542-1d18b65301d0 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:56:48.153041 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:56:48.241488 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f58755a-e6c3-47c3-8b56-61958c07e5d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a005d8f0c46d44c7b6f2201a54717b12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:56:48.242140 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f58755a-e6c3-47c3-8b56-61958c07e5d6 service nova] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:56:48.242424 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f58755a-e6c3-47c3-8b56-61958c07e5d6 service nova] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:56:48.242699 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f58755a-e6c3-47c3-8b56-61958c07e5d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:56:48.244305 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-9f58755a-e6c3-47c3-8b56-61958c07e5d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:56:48.340495 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f58755a-e6c3-47c3-8b56-61958c07e5d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:56:48.342186 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f58755a-e6c3-47c3-8b56-61958c07e5d6 service nova] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:56:48.362048 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 734/1440] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 10:56:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 10:56:50.246503 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421912ae-64be-4645-8341-e01359f8b720 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:56:50.247202 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421912ae-64be-4645-8341-e01359f8b720 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:56:50.247202 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421912ae-64be-4645-8341-e01359f8b720 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:56:50.248399 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 707/1441] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 10:56:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:56:50.254920 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179ef471-d1d1-44d0-b6d1-182b1ad1696a None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:56:50.255390 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179ef471-d1d1-44d0-b6d1-182b1ad1696a None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:56:50.255486 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179ef471-d1d1-44d0-b6d1-182b1ad1696a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:56:50.296747 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:56:50.323595 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-179ef471-d1d1-44d0-b6d1-182b1ad1696a None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:56:50.324848 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-179ef471-d1d1-44d0-b6d1-182b1ad1696a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:56:50.432907 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 735/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 10:56:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 10:56:50.731877 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421912ae-64be-4645-8341-e01359f8b720 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:56:50.733430 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-421912ae-64be-4645-8341-e01359f8b720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:56:50.842079 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421912ae-64be-4645-8341-e01359f8b720 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:56:50.895017 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:56:50.943488 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db823341-5c44-452d-b0f3-5d63cb9976b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:56:50.944093 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db823341-5c44-452d-b0f3-5d63cb9976b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:56:50.944376 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db823341-5c44-452d-b0f3-5d63cb9976b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:56:50.944649 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db823341-5c44-452d-b0f3-5d63cb9976b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:56:50.946332 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-db823341-5c44-452d-b0f3-5d63cb9976b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:56:51.058277 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db823341-5c44-452d-b0f3-5d63cb9976b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:56:51.059723 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db823341-5c44-452d-b0f3-5d63cb9976b3 service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:56:51.077692 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 708/1443] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 10:56:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 10:56:53.168203 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd8ec9-7d39-4315-8b99-da63d8b43af3 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:56:53.168769 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd8ec9-7d39-4315-8b99-da63d8b43af3 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:56:53.168769 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd8ec9-7d39-4315-8b99-da63d8b43af3 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:56:53.170149 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 736/1444] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 10:56:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:56:53.176329 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af5ddc8-aa81-470e-ae2b-a5b87af0e356 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:56:53.176774 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af5ddc8-aa81-470e-ae2b-a5b87af0e356 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:56:53.176895 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af5ddc8-aa81-470e-ae2b-a5b87af0e356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:56:53.256133 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-7af5ddc8-aa81-470e-ae2b-a5b87af0e356 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:56:53.257360 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-7af5ddc8-aa81-470e-ae2b-a5b87af0e356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:56:53.270598 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:56:53.355816 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 709/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 10:56:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 10:56:53.637148 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccd8ec9-7d39-4315-8b99-da63d8b43af3 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:56:53.638739 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-bccd8ec9-7d39-4315-8b99-da63d8b43af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:56:53.740267 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccd8ec9-7d39-4315-8b99-da63d8b43af3 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:56:53.753247 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:56:53.821679 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cf24c3-e801-462c-a6cb-58be85a8d31b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:56:53.822289 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf24c3-e801-462c-a6cb-58be85a8d31b service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:56:53.822573 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf24c3-e801-462c-a6cb-58be85a8d31b service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:56:53.822851 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf24c3-e801-462c-a6cb-58be85a8d31b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:56:53.824490 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-d6cf24c3-e801-462c-a6cb-58be85a8d31b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:56:53.938075 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cf24c3-e801-462c-a6cb-58be85a8d31b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:56:53.939232 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cf24c3-e801-462c-a6cb-58be85a8d31b service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:56:53.957384 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 737/1446] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 10:56:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 10:56:56.184335 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c50c76-aba2-49a1-b940-7fadf0a6d204 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:56:56.184929 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c50c76-aba2-49a1-b940-7fadf0a6d204 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:56:56.184929 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c50c76-aba2-49a1-b940-7fadf0a6d204 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:56:56.186268 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 710/1447] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 10:56:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:56:56.192987 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceb20f4-7588-4ab9-a8cf-3d7b90aefb49 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:56:56.193421 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceb20f4-7588-4ab9-a8cf-3d7b90aefb49 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:56:56.193590 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceb20f4-7588-4ab9-a8cf-3d7b90aefb49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:56:56.243458 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:56:56.264097 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-7ceb20f4-7588-4ab9-a8cf-3d7b90aefb49 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:56:56.265326 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-7ceb20f4-7588-4ab9-a8cf-3d7b90aefb49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:56:56.363348 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 738/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 10:56:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 10:56:56.664869 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c50c76-aba2-49a1-b940-7fadf0a6d204 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:56:56.666513 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-b9c50c76-aba2-49a1-b940-7fadf0a6d204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:56:56.773215 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c50c76-aba2-49a1-b940-7fadf0a6d204 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:56:56.814394 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:56:56.850472 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfcda13-d066-40cf-a4ae-053b66b21512 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:56:56.851034 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfcda13-d066-40cf-a4ae-053b66b21512 service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:56:56.851336 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfcda13-d066-40cf-a4ae-053b66b21512 service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:56:56.851606 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfcda13-d066-40cf-a4ae-053b66b21512 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:56:56.853209 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-5bfcda13-d066-40cf-a4ae-053b66b21512 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:56:56.972032 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfcda13-d066-40cf-a4ae-053b66b21512 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:56:56.973390 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfcda13-d066-40cf-a4ae-053b66b21512 service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:56:56.992058 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 711/1449] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 10:56:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 10:56:59.111978 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f723a-3780-44d8-8dca-3b8d90661ecb None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:56:59.112554 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f723a-3780-44d8-8dca-3b8d90661ecb None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:56:59.112554 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f723a-3780-44d8-8dca-3b8d90661ecb None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:56:59.113912 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 739/1450] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 10:56:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:56:59.119111 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176665d4-3013-445a-9f8b-25eb305c5fe0 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:56:59.119552 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176665d4-3013-445a-9f8b-25eb305c5fe0 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:56:59.119657 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176665d4-3013-445a-9f8b-25eb305c5fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:56:59.186320 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-176665d4-3013-445a-9f8b-25eb305c5fe0 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:56:59.187556 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-176665d4-3013-445a-9f8b-25eb305c5fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:56:59.209216 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:56:59.288973 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 712/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 10:56:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 10:56:59.573442 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423f723a-3780-44d8-8dca-3b8d90661ecb None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:56:59.575026 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-423f723a-3780-44d8-8dca-3b8d90661ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:56:59.679865 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423f723a-3780-44d8-8dca-3b8d90661ecb None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:56:59.699533 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:56:59.758089 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135839e8-7f12-44d0-9cd6-3806f7c1cece service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:56:59.758701 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135839e8-7f12-44d0-9cd6-3806f7c1cece service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:56:59.758975 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135839e8-7f12-44d0-9cd6-3806f7c1cece service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:56:59.759242 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135839e8-7f12-44d0-9cd6-3806f7c1cece service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:56:59.760860 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-135839e8-7f12-44d0-9cd6-3806f7c1cece service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:56:59.870233 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135839e8-7f12-44d0-9cd6-3806f7c1cece service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:56:59.871662 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135839e8-7f12-44d0-9cd6-3806f7c1cece service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:56:59.889550 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 740/1452] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 10:56:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 10:57:02.054821 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b25933-98e3-4405-a637-ac0fce4b0201 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:57:02.055383 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b25933-98e3-4405-a637-ac0fce4b0201 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:57:02.055383 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b25933-98e3-4405-a637-ac0fce4b0201 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:57:02.056720 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 713/1453] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 10:57:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:57:02.062005 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4117bd1-8bf5-4bc2-91f5-302af19040a8 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:57:02.062448 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4117bd1-8bf5-4bc2-91f5-302af19040a8 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:57:02.062603 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4117bd1-8bf5-4bc2-91f5-302af19040a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:57:02.128164 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:57:02.130887 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-f4117bd1-8bf5-4bc2-91f5-302af19040a8 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:57:02.132663 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-f4117bd1-8bf5-4bc2-91f5-302af19040a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:57:02.230723 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 741/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 10:57:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 10:57:02.514020 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b25933-98e3-4405-a637-ac0fce4b0201 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:57:02.515561 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-54b25933-98e3-4405-a637-ac0fce4b0201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:57:02.625392 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b25933-98e3-4405-a637-ac0fce4b0201 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:57:02.679664 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:57:02.718048 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c68c761-dffc-4915-93c9-2bfe2663f150 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:57:02.719534 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68c761-dffc-4915-93c9-2bfe2663f150 service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:57:02.720003 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68c761-dffc-4915-93c9-2bfe2663f150 service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:57:02.720391 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68c761-dffc-4915-93c9-2bfe2663f150 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:57:02.722239 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-0c68c761-dffc-4915-93c9-2bfe2663f150 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:57:02.860309 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c68c761-dffc-4915-93c9-2bfe2663f150 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:57:02.861736 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c68c761-dffc-4915-93c9-2bfe2663f150 service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:57:02.880951 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 714/1455] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 10:57:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 10:57:04.967839 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e930a-73ed-4c7a-b261-c07c17f74f18 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:57:04.968407 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e930a-73ed-4c7a-b261-c07c17f74f18 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:57:04.968407 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e930a-73ed-4c7a-b261-c07c17f74f18 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:57:04.970538 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 742/1456] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 10:57:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:57:04.975802 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd5962-8cd4-4820-917e-9f951285405f None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:57:04.976213 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd5962-8cd4-4820-917e-9f951285405f None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:57:04.976355 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd5962-8cd4-4820-917e-9f951285405f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:57:05.044049 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-34bd5962-8cd4-4820-917e-9f951285405f None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:57:05.045181 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-34bd5962-8cd4-4820-917e-9f951285405f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:57:05.074903 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:57:05.145240 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 715/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 10:57:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 10:57:05.434003 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7e930a-73ed-4c7a-b261-c07c17f74f18 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:57:05.435560 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-9f7e930a-73ed-4c7a-b261-c07c17f74f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:57:05.544624 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7e930a-73ed-4c7a-b261-c07c17f74f18 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:57:05.574119 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:57:05.626236 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef30025b-536f-4a08-a0b0-085cccbb40c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:57:05.626756 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef30025b-536f-4a08-a0b0-085cccbb40c0 service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:57:05.627125 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef30025b-536f-4a08-a0b0-085cccbb40c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:57:05.627398 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef30025b-536f-4a08-a0b0-085cccbb40c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:57:05.629014 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-ef30025b-536f-4a08-a0b0-085cccbb40c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:57:05.862945 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef30025b-536f-4a08-a0b0-085cccbb40c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:57:05.864382 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef30025b-536f-4a08-a0b0-085cccbb40c0 service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:57:05.882897 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 743/1458] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 10:57:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 10:57:07.843143 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a429263c-4cf3-4d4f-8e6b-eeb0f6de4cb1 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:57:07.843696 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a429263c-4cf3-4d4f-8e6b-eeb0f6de4cb1 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:57:07.843696 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a429263c-4cf3-4d4f-8e6b-eeb0f6de4cb1 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:57:07.845911 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 716/1459] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 10:57:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:57:07.851622 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2470a092-d2ca-4cc6-84e1-97608fe2a7b8 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:57:07.852089 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2470a092-d2ca-4cc6-84e1-97608fe2a7b8 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:57:07.852188 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2470a092-d2ca-4cc6-84e1-97608fe2a7b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:57:07.919635 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-2470a092-d2ca-4cc6-84e1-97608fe2a7b8 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:57:07.920846 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-2470a092-d2ca-4cc6-84e1-97608fe2a7b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:57:07.929271 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:57:08.018814 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 744/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 10:57:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 10:57:08.310818 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a429263c-4cf3-4d4f-8e6b-eeb0f6de4cb1 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:57:08.312369 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-a429263c-4cf3-4d4f-8e6b-eeb0f6de4cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:57:08.419648 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a429263c-4cf3-4d4f-8e6b-eeb0f6de4cb1 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:57:08.479126 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:57:08.499045 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db36b791-30f6-40ef-b398-56c19ba6495b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:57:08.499653 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db36b791-30f6-40ef-b398-56c19ba6495b service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:57:08.499932 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db36b791-30f6-40ef-b398-56c19ba6495b service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:57:08.500199 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db36b791-30f6-40ef-b398-56c19ba6495b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:57:08.501880 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-db36b791-30f6-40ef-b398-56c19ba6495b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:57:08.617902 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db36b791-30f6-40ef-b398-56c19ba6495b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:57:08.619336 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db36b791-30f6-40ef-b398-56c19ba6495b service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:57:08.637774 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 717/1461] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 10:57:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 10:57:10.823229 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ffda39-b224-4850-a4d5-902e5712f52a None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:57:10.823808 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ffda39-b224-4850-a4d5-902e5712f52a None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:57:10.823808 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ffda39-b224-4850-a4d5-902e5712f52a None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:57:10.825121 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 745/1462] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 10:57:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:57:10.831730 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ff4ed1-027c-4eb7-a1d3-d5b6fc1b624c None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:57:10.832153 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ff4ed1-027c-4eb7-a1d3-d5b6fc1b624c None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:57:10.832316 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ff4ed1-027c-4eb7-a1d3-d5b6fc1b624c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:57:10.910211 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-a6ff4ed1-027c-4eb7-a1d3-d5b6fc1b624c None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:57:10.911476 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-a6ff4ed1-027c-4eb7-a1d3-d5b6fc1b624c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:57:10.951973 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:57:11.012236 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 718/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 10:57:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 10:57:11.347336 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ffda39-b224-4850-a4d5-902e5712f52a None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:57:11.348888 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-52ffda39-b224-4850-a4d5-902e5712f52a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:57:11.457152 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ffda39-b224-4850-a4d5-902e5712f52a None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:57:11.495681 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:57:11.535614 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11556d8f-62e2-4c55-af10-821aacce3f61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:57:11.536217 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11556d8f-62e2-4c55-af10-821aacce3f61 service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:57:11.536498 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11556d8f-62e2-4c55-af10-821aacce3f61 service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:57:11.536773 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11556d8f-62e2-4c55-af10-821aacce3f61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:57:11.538413 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-11556d8f-62e2-4c55-af10-821aacce3f61 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:57:11.659011 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11556d8f-62e2-4c55-af10-821aacce3f61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:57:11.660950 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11556d8f-62e2-4c55-af10-821aacce3f61 service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:57:11.680762 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 746/1464] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 10:57:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 10:57:13.646368 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e879044e-d3b2-4389-95b7-413adaf08e58 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:57:13.646939 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e879044e-d3b2-4389-95b7-413adaf08e58 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:57:13.646939 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e879044e-d3b2-4389-95b7-413adaf08e58 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:57:13.648161 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 719/1465] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 10:57:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:57:13.653644 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e648453e-2a6c-4ff9-8c6b-8639ae7100ea None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:57:13.654055 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e648453e-2a6c-4ff9-8c6b-8639ae7100ea None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:57:13.654202 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e648453e-2a6c-4ff9-8c6b-8639ae7100ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:57:13.721066 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-e648453e-2a6c-4ff9-8c6b-8639ae7100ea None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:57:13.722310 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-e648453e-2a6c-4ff9-8c6b-8639ae7100ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:57:13.739943 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:57:13.820918 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 747/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 10:57:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 10:57:14.118335 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e879044e-d3b2-4389-95b7-413adaf08e58 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:57:14.119872 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-e879044e-d3b2-4389-95b7-413adaf08e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:57:14.227325 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e879044e-d3b2-4389-95b7-413adaf08e58 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:57:14.294617 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:57:14.302795 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3363a43d-0861-4e0b-8d05-a990e5639079 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:57:14.303403 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363a43d-0861-4e0b-8d05-a990e5639079 service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:57:14.303682 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363a43d-0861-4e0b-8d05-a990e5639079 service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:57:14.303948 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363a43d-0861-4e0b-8d05-a990e5639079 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:57:14.305641 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-3363a43d-0861-4e0b-8d05-a990e5639079 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:57:14.419718 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3363a43d-0861-4e0b-8d05-a990e5639079 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:57:14.421032 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3363a43d-0861-4e0b-8d05-a990e5639079 service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:57:14.440142 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 720/1467] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 10:57:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 10:57:16.371646 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077adfe2-32a4-4d77-8f2a-5db33adf88c3 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:57:16.372232 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077adfe2-32a4-4d77-8f2a-5db33adf88c3 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:57:16.372336 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077adfe2-32a4-4d77-8f2a-5db33adf88c3 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:57:16.373766 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 748/1468] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 10:57:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:57:16.380009 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26ca8a-bff9-4b5c-9f9d-f40d13fd1bde None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:57:16.380496 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26ca8a-bff9-4b5c-9f9d-f40d13fd1bde None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:57:16.380609 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26ca8a-bff9-4b5c-9f9d-f40d13fd1bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:57:16.448657 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-5d26ca8a-bff9-4b5c-9f9d-f40d13fd1bde None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:57:16.449933 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-5d26ca8a-bff9-4b5c-9f9d-f40d13fd1bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:57:16.499956 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:57:16.549873 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 721/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 10:57:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 10:57:16.833969 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077adfe2-32a4-4d77-8f2a-5db33adf88c3 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:57:16.835533 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-077adfe2-32a4-4d77-8f2a-5db33adf88c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:57:16.947403 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077adfe2-32a4-4d77-8f2a-5db33adf88c3 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:57:16.997745 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:57:17.025460 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890577b1-687b-4372-bead-535b5d37b87e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:57:17.026092 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890577b1-687b-4372-bead-535b5d37b87e service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:57:17.026625 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890577b1-687b-4372-bead-535b5d37b87e service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:57:17.026903 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890577b1-687b-4372-bead-535b5d37b87e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:57:17.028500 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-890577b1-687b-4372-bead-535b5d37b87e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:57:17.137789 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890577b1-687b-4372-bead-535b5d37b87e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:57:17.139140 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890577b1-687b-4372-bead-535b5d37b87e service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:57:17.156850 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 749/1470] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 10:57:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 10:57:26.548088 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=22 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:57:27.154668 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=66 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:57:37.243067 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722342e2-4250-4495-8d1d-70f29bf85d31 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:57:37.243623 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722342e2-4250-4495-8d1d-70f29bf85d31 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:57:37.243623 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722342e2-4250-4495-8d1d-70f29bf85d31 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:57:37.244992 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 722/1471] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:57:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:57:37.250764 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0207ac56-ea34-4e6c-aa42-8387506fb84d None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:57:37.251283 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0207ac56-ea34-4e6c-aa42-8387506fb84d None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:57:37.251283 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0207ac56-ea34-4e6c-aa42-8387506fb84d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:57:37.317105 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-0207ac56-ea34-4e6c-aa42-8387506fb84d None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:57:37.318341 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-0207ac56-ea34-4e6c-aa42-8387506fb84d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:57:37.414100 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 750/1472] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:57:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 10:57:37.711101 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b566b5c-7c15-422b-93fa-e8cc553a30c4 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:57:37.711379 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b566b5c-7c15-422b-93fa-e8cc553a30c4 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:57:37.711653 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b566b5c-7c15-422b-93fa-e8cc553a30c4 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:57:37.713074 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 723/1473] 10.222.0.15 () {54 vars in 967 bytes} [Thu Aug 18 10:57:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:57:37.717812 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aaa72d-e750-40e5-84e1-a2db5569c72a None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:57:37.718098 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aaa72d-e750-40e5-84e1-a2db5569c72a None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:57:37.718367 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aaa72d-e750-40e5-84e1-a2db5569c72a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:57:37.798688 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-e3aaa72d-e750-40e5-84e1-a2db5569c72a None None] MFA Rules not processed for user `77211d2dcef242c4a7fe2198556d5efc`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:57:37.799908 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-e3aaa72d-e750-40e5-84e1-a2db5569c72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:57:37.820800 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:57:37.878788 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 751/1474] 10.222.0.15 () {58 vars in 1064 bytes} [Thu Aug 18 10:57:37 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 10:57:37.886670 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b566b5c-7c15-422b-93fa-e8cc553a30c4 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:57:37.888469 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-6b566b5c-7c15-422b-93fa-e8cc553a30c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:57:37.997474 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b566b5c-7c15-422b-93fa-e8cc553a30c4 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:57:38.074631 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d3405b-a49d-4439-967a-9cdbce4b1497 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77211d2dcef242c4a7fe2198556d5efc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:57:38.075246 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d3405b-a49d-4439-967a-9cdbce4b1497 service glance] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:57:38.075516 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d3405b-a49d-4439-967a-9cdbce4b1497 service glance] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:57:38.075787 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d3405b-a49d-4439-967a-9cdbce4b1497 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:57:38.077399 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-60d3405b-a49d-4439-967a-9cdbce4b1497 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:57:38.134642 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:57:38.191850 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d3405b-a49d-4439-967a-9cdbce4b1497 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:57:38.193313 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d3405b-a49d-4439-967a-9cdbce4b1497 service glance] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:57:38.213677 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 724/1475] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 10:57:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 10:57:40.212933 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9325ff77-9c8b-46b0-88ba-4f9b5a795449 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:57:40.213409 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9325ff77-9c8b-46b0-88ba-4f9b5a795449 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:57:40.213534 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9325ff77-9c8b-46b0-88ba-4f9b5a795449 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:57:40.214870 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 752/1476] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:57:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:57:40.220881 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57dfbc0-5101-44dd-af53-330c98c84506 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:57:40.221388 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57dfbc0-5101-44dd-af53-330c98c84506 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:57:40.221493 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57dfbc0-5101-44dd-af53-330c98c84506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:57:40.289075 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-f57dfbc0-5101-44dd-af53-330c98c84506 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:57:40.290322 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-f57dfbc0-5101-44dd-af53-330c98c84506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:57:40.387519 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 725/1477] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:57:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 10:57:40.666506 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9325ff77-9c8b-46b0-88ba-4f9b5a795449 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:57:40.668049 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-9325ff77-9c8b-46b0-88ba-4f9b5a795449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:57:40.793852 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9325ff77-9c8b-46b0-88ba-4f9b5a795449 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:57:40.842527 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:57:40.888875 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3628fe06-72f5-433a-9ead-9d07be0872ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:57:40.889481 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3628fe06-72f5-433a-9ead-9d07be0872ca admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:57:40.889787 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3628fe06-72f5-433a-9ead-9d07be0872ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:57:40.890058 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3628fe06-72f5-433a-9ead-9d07be0872ca admin admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:57:40.891607 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3628fe06-72f5-433a-9ead-9d07be0872ca admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:57:40.893553 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: WARNING py.warnings [None req-3628fe06-72f5-433a-9ead-9d07be0872ca admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 10:57:40.893553 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: warnings.warn(msg) Aug 18 10:57:40.893553 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: Aug 18 10:57:40.894707 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3628fe06-72f5-433a-9ead-9d07be0872ca admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:57:40.914473 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 753/1478] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 18 10:57:40 2022] GET /identity/v3/projects => generated 2553 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 10:57:42.841973 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8766e2ff-a99d-434c-aac0-8a711449cde4 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:57:42.842526 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8766e2ff-a99d-434c-aac0-8a711449cde4 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:57:42.842526 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8766e2ff-a99d-434c-aac0-8a711449cde4 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:57:42.845132 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 726/1479] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:57:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:57:42.850989 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d757addc-b8cc-4b9f-b3c6-aedf01cee516 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:57:42.851591 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d757addc-b8cc-4b9f-b3c6-aedf01cee516 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:57:42.851591 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d757addc-b8cc-4b9f-b3c6-aedf01cee516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:57:42.917187 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-d757addc-b8cc-4b9f-b3c6-aedf01cee516 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:57:42.918435 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-d757addc-b8cc-4b9f-b3c6-aedf01cee516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:57:43.014596 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 754/1480] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:57:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 10:57:43.306860 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8766e2ff-a99d-434c-aac0-8a711449cde4 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:57:43.308525 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-8766e2ff-a99d-434c-aac0-8a711449cde4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:57:43.319907 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:57:43.464340 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8766e2ff-a99d-434c-aac0-8a711449cde4 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:57:43.546130 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:57:43.580332 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8da4ae-451c-4acf-a4b8-b7325a2f8b41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a005d8f0c46d44c7b6f2201a54717b12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:57:43.580936 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8da4ae-451c-4acf-a4b8-b7325a2f8b41 service nova] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:57:43.581209 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8da4ae-451c-4acf-a4b8-b7325a2f8b41 service nova] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:57:43.581478 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8da4ae-451c-4acf-a4b8-b7325a2f8b41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:57:43.583133 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-2b8da4ae-451c-4acf-a4b8-b7325a2f8b41 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:57:43.677167 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8da4ae-451c-4acf-a4b8-b7325a2f8b41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:57:43.678795 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8da4ae-451c-4acf-a4b8-b7325a2f8b41 service nova] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:57:43.697024 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 727/1481] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 10:57:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 10:57:45.811961 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd53fbbd-f5a0-4d41-b441-2b1c86f44a6b None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:57:45.813121 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd53fbbd-f5a0-4d41-b441-2b1c86f44a6b None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:57:45.813121 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd53fbbd-f5a0-4d41-b441-2b1c86f44a6b None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:57:45.814646 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 755/1482] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:57:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:57:45.819882 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab7c7dd-4ee2-481b-af67-3e7341401f2e None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:57:45.820329 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab7c7dd-4ee2-481b-af67-3e7341401f2e None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:57:45.820449 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab7c7dd-4ee2-481b-af67-3e7341401f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:57:45.889342 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-2ab7c7dd-4ee2-481b-af67-3e7341401f2e None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:57:45.890712 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-2ab7c7dd-4ee2-481b-af67-3e7341401f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:57:45.939843 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:57:45.993758 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 728/1483] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:57:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 10:57:46.285777 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd53fbbd-f5a0-4d41-b441-2b1c86f44a6b None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:57:46.287349 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-bd53fbbd-f5a0-4d41-b441-2b1c86f44a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:57:46.310809 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:57:46.389415 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd53fbbd-f5a0-4d41-b441-2b1c86f44a6b None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:57:46.464101 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce1f463-acc0-4c48-86b2-89db039fa744 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:57:46.464629 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce1f463-acc0-4c48-86b2-89db039fa744 service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:57:46.464903 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce1f463-acc0-4c48-86b2-89db039fa744 service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:57:46.465172 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce1f463-acc0-4c48-86b2-89db039fa744 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:57:46.466813 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-bce1f463-acc0-4c48-86b2-89db039fa744 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:57:46.545783 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:57:46.581907 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce1f463-acc0-4c48-86b2-89db039fa744 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:57:46.583343 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce1f463-acc0-4c48-86b2-89db039fa744 service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:57:46.602354 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 756/1484] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 10:57:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 10:57:48.582610 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e16b3-946e-48f7-992b-f2bd09138257 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:57:48.583177 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e16b3-946e-48f7-992b-f2bd09138257 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:57:48.583517 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e16b3-946e-48f7-992b-f2bd09138257 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:57:48.585808 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 729/1485] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:57:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:57:48.591791 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d6013-3073-4665-89d4-e209c9cde090 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:57:48.592297 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d6013-3073-4665-89d4-e209c9cde090 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:57:48.592569 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d6013-3073-4665-89d4-e209c9cde090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:57:48.681907 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-157d6013-3073-4665-89d4-e209c9cde090 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:57:48.683590 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-157d6013-3073-4665-89d4-e209c9cde090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:57:48.806763 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 757/1486] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:57:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 10:57:49.099992 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985e16b3-946e-48f7-992b-f2bd09138257 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:57:49.101565 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-985e16b3-946e-48f7-992b-f2bd09138257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:57:49.212113 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985e16b3-946e-48f7-992b-f2bd09138257 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:57:49.289878 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:57:49.291757 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873ca622-efd7-4164-901e-f9ac8af99973 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:57:49.292404 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ca622-efd7-4164-901e-f9ac8af99973 service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:57:49.292700 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ca622-efd7-4164-901e-f9ac8af99973 service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:57:49.293205 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ca622-efd7-4164-901e-f9ac8af99973 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:57:49.295462 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-873ca622-efd7-4164-901e-f9ac8af99973 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:57:49.419258 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873ca622-efd7-4164-901e-f9ac8af99973 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:57:49.420730 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873ca622-efd7-4164-901e-f9ac8af99973 service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:57:49.444363 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 730/1487] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 10:57:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 10:57:51.509385 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a3e58-5d49-490d-9409-949459eb16b8 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:57:51.509964 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a3e58-5d49-490d-9409-949459eb16b8 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:57:51.509964 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a3e58-5d49-490d-9409-949459eb16b8 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:57:51.511326 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 758/1488] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:57:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:57:51.516786 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15316ada-4766-4b28-b144-7e19505e263a None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:57:51.517253 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15316ada-4766-4b28-b144-7e19505e263a None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:57:51.517395 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15316ada-4766-4b28-b144-7e19505e263a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:57:51.585973 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-15316ada-4766-4b28-b144-7e19505e263a None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:57:51.587195 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-15316ada-4766-4b28-b144-7e19505e263a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:57:51.644303 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:57:51.693178 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 731/1489] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:57:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 10:57:51.983053 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86a3e58-5d49-490d-9409-949459eb16b8 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:57:51.984650 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-b86a3e58-5d49-490d-9409-949459eb16b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:57:52.024567 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:57:52.094320 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86a3e58-5d49-490d-9409-949459eb16b8 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:57:52.167481 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca62f8-9fac-4d03-8339-558c47cf9fd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:57:52.168084 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca62f8-9fac-4d03-8339-558c47cf9fd4 service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:57:52.168360 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca62f8-9fac-4d03-8339-558c47cf9fd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:57:52.168632 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca62f8-9fac-4d03-8339-558c47cf9fd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:57:52.170265 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-25ca62f8-9fac-4d03-8339-558c47cf9fd4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:57:52.257215 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:57:52.291151 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ca62f8-9fac-4d03-8339-558c47cf9fd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:57:52.293458 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ca62f8-9fac-4d03-8339-558c47cf9fd4 service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:57:52.316443 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 759/1490] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 10:57:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 10:57:54.443254 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e55ef3-28db-41a3-8ae9-4ff3a11b8329 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:57:54.443885 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e55ef3-28db-41a3-8ae9-4ff3a11b8329 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:57:54.443885 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e55ef3-28db-41a3-8ae9-4ff3a11b8329 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:57:54.445138 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 732/1491] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 18 10:57:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:57:54.450448 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db3986-6f31-427d-8721-272d51c5f560 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:57:54.450859 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db3986-6f31-427d-8721-272d51c5f560 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:57:54.451005 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db3986-6f31-427d-8721-272d51c5f560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:57:54.518327 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-27db3986-6f31-427d-8721-272d51c5f560 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:57:54.519528 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-27db3986-6f31-427d-8721-272d51c5f560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:57:54.619837 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 760/1492] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 18 10:57:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 10:57:54.904381 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e55ef3-28db-41a3-8ae9-4ff3a11b8329 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:57:54.906948 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-b9e55ef3-28db-41a3-8ae9-4ff3a11b8329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:57:55.011099 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e55ef3-28db-41a3-8ae9-4ff3a11b8329 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:57:55.084767 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1836ee08-3b1b-49fb-af98-10542dbffc73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:57:55.085372 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1836ee08-3b1b-49fb-af98-10542dbffc73 service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:57:55.085672 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1836ee08-3b1b-49fb-af98-10542dbffc73 service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:57:55.085938 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1836ee08-3b1b-49fb-af98-10542dbffc73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:57:55.087529 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-1836ee08-3b1b-49fb-af98-10542dbffc73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:57:55.096777 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:57:55.197551 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1836ee08-3b1b-49fb-af98-10542dbffc73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:57:55.198926 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1836ee08-3b1b-49fb-af98-10542dbffc73 service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:57:55.219350 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 733/1493] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 10:57:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 10:58:04.617977 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=82 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:58:05.216933 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=50 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:59:07.495080 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25975282-0eab-49e2-b152-16bb192822da None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:59:07.495644 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25975282-0eab-49e2-b152-16bb192822da None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:59:07.495644 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25975282-0eab-49e2-b152-16bb192822da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:59:07.571452 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-25975282-0eab-49e2-b152-16bb192822da None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:59:07.572658 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-25975282-0eab-49e2-b152-16bb192822da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:59:07.669981 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 761/1494] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 10:59:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 10:59:07.678780 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75c272f-a857-40a2-8195-f47d87551ec1 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:59:07.679293 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75c272f-a857-40a2-8195-f47d87551ec1 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:59:07.679398 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75c272f-a857-40a2-8195-f47d87551ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:59:07.756015 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-b75c272f-a857-40a2-8195-f47d87551ec1 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:59:07.757301 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-b75c272f-a857-40a2-8195-f47d87551ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:59:07.865055 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 734/1495] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 10:59:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 10:59:07.869866 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25975282-0eab-49e2-b152-16bb192822da None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:59:07.871083 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-25975282-0eab-49e2-b152-16bb192822da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:59:07.882697 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25975282-0eab-49e2-b152-16bb192822da None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:59:07.946711 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:59:07.980509 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25f9642-cfb0-494b-907f-32d67d58c5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:59:07.981110 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25f9642-cfb0-494b-907f-32d67d58c5f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:59:07.981387 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25f9642-cfb0-494b-907f-32d67d58c5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:59:07.981688 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25f9642-cfb0-494b-907f-32d67d58c5f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:59:07.982326 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25f9642-cfb0-494b-907f-32d67d58c5f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 10:59:07.982622 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25f9642-cfb0-494b-907f-32d67d58c5f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:59:07.983626 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: WARNING py.warnings [None req-a25f9642-cfb0-494b-907f-32d67d58c5f0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 10:59:07.983626 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: warnings.warn(msg) Aug 18 10:59:07.983626 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: Aug 18 10:59:07.985094 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25f9642-cfb0-494b-907f-32d67d58c5f0 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:59:07.996288 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 762/1496] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Aug 18 10:59:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 10:59:08.005234 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75c272f-a857-40a2-8195-f47d87551ec1 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:59:08.014686 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75c272f-a857-40a2-8195-f47d87551ec1 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:59:08.078225 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:59:08.229931 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcef8f67-a350-4c9a-9bcd-0e4504359627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:59:08.230535 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef8f67-a350-4c9a-9bcd-0e4504359627 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:59:08.230807 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef8f67-a350-4c9a-9bcd-0e4504359627 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:59:08.231074 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef8f67-a350-4c9a-9bcd-0e4504359627 admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:59:08.231689 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcef8f67-a350-4c9a-9bcd-0e4504359627 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:59:08.233420 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: WARNING py.warnings [None req-fcef8f67-a350-4c9a-9bcd-0e4504359627 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 10:59:08.233420 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: warnings.warn(msg) Aug 18 10:59:08.233420 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: Aug 18 10:59:08.235416 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcef8f67-a350-4c9a-9bcd-0e4504359627 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:59:08.294041 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 735/1497] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 10:59:08 2022] POST /identity/v3/projects => generated 379 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 10:59:08.298753 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25f9642-cfb0-494b-907f-32d67d58c5f0 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:59:08.300424 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-a25f9642-cfb0-494b-907f-32d67d58c5f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:59:08.336690 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25f9642-cfb0-494b-907f-32d67d58c5f0 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:59:08.434875 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d01c387-2984-4c32-9746-2da353507831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:59:08.435479 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d01c387-2984-4c32-9746-2da353507831 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:59:08.435760 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d01c387-2984-4c32-9746-2da353507831 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:59:08.436032 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d01c387-2984-4c32-9746-2da353507831 admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:59:08.436655 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d01c387-2984-4c32-9746-2da353507831 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:59:08.437761 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: WARNING py.warnings [None req-9d01c387-2984-4c32-9746-2da353507831 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 10:59:08.437761 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: warnings.warn(msg) Aug 18 10:59:08.437761 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: Aug 18 10:59:08.438976 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d01c387-2984-4c32-9746-2da353507831 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:59:08.482589 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 763/1498] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 10:59:08 2022] POST /identity/v3/users => generated 290 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 10:59:08.487687 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcef8f67-a350-4c9a-9bcd-0e4504359627 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:59:08.489214 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-fcef8f67-a350-4c9a-9bcd-0e4504359627 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:59:08.554069 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcef8f67-a350-4c9a-9bcd-0e4504359627 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:59:08.645308 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:59:08.657702 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a16f5c-afaf-4eb4-ae36-83955ebed637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:59:08.658312 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a16f5c-afaf-4eb4-ae36-83955ebed637 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:59:08.658590 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a16f5c-afaf-4eb4-ae36-83955ebed637 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:59:08.658862 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a16f5c-afaf-4eb4-ae36-83955ebed637 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:59:08.659508 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a16f5c-afaf-4eb4-ae36-83955ebed637 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:59:08.660777 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: WARNING py.warnings [None req-88a16f5c-afaf-4eb4-ae36-83955ebed637 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 10:59:08.660777 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: warnings.warn(msg) Aug 18 10:59:08.660777 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: Aug 18 10:59:08.661780 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a16f5c-afaf-4eb4-ae36-83955ebed637 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:59:08.675166 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 736/1499] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 10:59:08 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 10:59:08.679249 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d01c387-2984-4c32-9746-2da353507831 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:59:08.680773 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-9d01c387-2984-4c32-9746-2da353507831 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:59:08.692099 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d01c387-2984-4c32-9746-2da353507831 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:59:08.717768 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:59:08.790141 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7eda3c-af0f-4759-98ee-285ec2226045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:59:08.790747 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7eda3c-af0f-4759-98ee-285ec2226045 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:59:08.791025 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7eda3c-af0f-4759-98ee-285ec2226045 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:59:08.791298 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7eda3c-af0f-4759-98ee-285ec2226045 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:59:08.791936 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7eda3c-af0f-4759-98ee-285ec2226045 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:59:08.792942 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: WARNING py.warnings [None req-1f7eda3c-af0f-4759-98ee-285ec2226045 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 10:59:08.792942 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: warnings.warn(msg) Aug 18 10:59:08.792942 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: Aug 18 10:59:08.793853 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7eda3c-af0f-4759-98ee-285ec2226045 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:59:08.806438 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 764/1500] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 10:59:08 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 10:59:08.810694 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a16f5c-afaf-4eb4-ae36-83955ebed637 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:59:08.812211 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-88a16f5c-afaf-4eb4-ae36-83955ebed637 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:59:08.846097 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a16f5c-afaf-4eb4-ae36-83955ebed637 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:59:08.948168 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64021ebb-f4a5-4b87-8080-f2a5070ead9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:59:08.948825 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64021ebb-f4a5-4b87-8080-f2a5070ead9f admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:59:08.949098 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64021ebb-f4a5-4b87-8080-f2a5070ead9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:59:08.949368 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64021ebb-f4a5-4b87-8080-f2a5070ead9f admin admin] PATH_INFO: `/v3/projects/1e24c693548e491e80f8a75be3f03983/users/6a5238472e384922bc634631d6fa91ca/roles/719e5c62188d4f8a838987d6e72ca8f7` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:59:08.973360 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64021ebb-f4a5-4b87-8080-f2a5070ead9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e24c693548e491e80f8a75be3f03983, user_id=6a5238472e384922bc634631d6fa91ca, role_id=719e5c62188d4f8a838987d6e72ca8f7)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:59:08.974477 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: WARNING py.warnings [None req-64021ebb-f4a5-4b87-8080-f2a5070ead9f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 10:59:08.974477 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: warnings.warn(msg) Aug 18 10:59:08.974477 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: Aug 18 10:59:08.976328 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64021ebb-f4a5-4b87-8080-f2a5070ead9f admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:59:09.005956 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 737/1501] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 10:59:08 2022] PUT /identity/v3/projects/1e24c693548e491e80f8a75be3f03983/users/6a5238472e384922bc634631d6fa91ca/roles/719e5c62188d4f8a838987d6e72ca8f7 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 10:59:09.018635 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2220d58b-7deb-4058-9950-6c9073ff7ecb None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:59:09.018922 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2220d58b-7deb-4058-9950-6c9073ff7ecb None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:59:09.019198 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2220d58b-7deb-4058-9950-6c9073ff7ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:59:09.075585 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-2220d58b-7deb-4058-9950-6c9073ff7ecb None None] MFA Rules not processed for user `6a5238472e384922bc634631d6fa91ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:59:09.076719 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-2220d58b-7deb-4058-9950-6c9073ff7ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:59:09.153342 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 765/1502] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 10:59:09 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 10:59:09.167090 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26de428-13a7-44d1-8bbb-7e5dce3e4b6a None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:59:09.167367 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26de428-13a7-44d1-8bbb-7e5dce3e4b6a None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:59:09.167638 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26de428-13a7-44d1-8bbb-7e5dce3e4b6a None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:59:09.168989 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 738/1503] 10.222.0.15 () {54 vars in 964 bytes} [Thu Aug 18 10:59:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:59:09.174019 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b2c08-cb77-40d8-9e5f-b511cc160673 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:59:09.174305 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b2c08-cb77-40d8-9e5f-b511cc160673 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:59:09.174581 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b2c08-cb77-40d8-9e5f-b511cc160673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:59:09.208550 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:59:09.256211 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-fe1b2c08-cb77-40d8-9e5f-b511cc160673 None None] MFA Rules not processed for user `5b8a09704b9b4ab2bffb813796ec6e77`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:59:09.257422 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-fe1b2c08-cb77-40d8-9e5f-b511cc160673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:59:09.338646 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 766/1504] 10.222.0.15 () {58 vars in 1061 bytes} [Thu Aug 18 10:59:09 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 10:59:09.346276 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26de428-13a7-44d1-8bbb-7e5dce3e4b6a None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:59:09.347782 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-b26de428-13a7-44d1-8bbb-7e5dce3e4b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:59:09.401630 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:59:09.457014 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26de428-13a7-44d1-8bbb-7e5dce3e4b6a None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:59:09.530161 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c91fa0-375e-4791-91dc-1f87cd325d86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b8a09704b9b4ab2bffb813796ec6e77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:59:09.530765 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c91fa0-375e-4791-91dc-1f87cd325d86 service cinder] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:59:09.531051 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c91fa0-375e-4791-91dc-1f87cd325d86 service cinder] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:59:09.531322 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c91fa0-375e-4791-91dc-1f87cd325d86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:59:09.533087 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-b6c91fa0-375e-4791-91dc-1f87cd325d86 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:59:09.632113 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c91fa0-375e-4791-91dc-1f87cd325d86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:59:09.633536 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c91fa0-375e-4791-91dc-1f87cd325d86 service cinder] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:59:09.637271 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:59:09.652537 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 739/1505] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 10:59:09 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 10:59:09.697994 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e84762-0df7-427b-a7a6-08974126971a None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:59:09.698428 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e84762-0df7-427b-a7a6-08974126971a None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:59:09.698536 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e84762-0df7-427b-a7a6-08974126971a None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:59:09.699804 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 767/1506] 10.222.0.15 () {52 vars in 830 bytes} [Thu Aug 18 10:59:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 10:59:09.703996 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c91fa0-375e-4791-91dc-1f87cd325d86 service cinder] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:59:09.705243 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-b6c91fa0-375e-4791-91dc-1f87cd325d86 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:59:09.809811 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c91fa0-375e-4791-91dc-1f87cd325d86 service cinder] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:59:09.915215 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bb5858-1487-406e-9466-0e5e915ad86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:59:09.915879 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb5858-1487-406e-9466-0e5e915ad86a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:59:09.916038 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb5858-1487-406e-9466-0e5e915ad86a admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:59:09.916322 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb5858-1487-406e-9466-0e5e915ad86a admin admin] PATH_INFO: `/v3/users/6a5238472e384922bc634631d6fa91ca` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:59:09.933932 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bb5858-1487-406e-9466-0e5e915ad86a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a5238472e384922bc634631d6fa91ca)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:59:09.934907 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: WARNING py.warnings [None req-e7bb5858-1487-406e-9466-0e5e915ad86a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 10:59:09.934907 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: warnings.warn(msg) Aug 18 10:59:09.934907 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: Aug 18 10:59:09.936119 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bb5858-1487-406e-9466-0e5e915ad86a admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:59:09.946074 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:59:10.006690 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-e7bb5858-1487-406e-9466-0e5e915ad86a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a5238472e384922bc634631d6fa91ca'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 10:59:10.016179 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-e7bb5858-1487-406e-9466-0e5e915ad86a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a5238472e384922bc634631d6fa91ca'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 10:59:10.016825 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-e7bb5858-1487-406e-9466-0e5e915ad86a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a5238472e384922bc634631d6fa91ca'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 10:59:10.017323 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-e7bb5858-1487-406e-9466-0e5e915ad86a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a5238472e384922bc634631d6fa91ca'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 10:59:10.032053 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-e7bb5858-1487-406e-9466-0e5e915ad86a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a5238472e384922bc634631d6fa91ca'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 10:59:10.061216 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 740/1507] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 10:59:09 2022] DELETE /identity/v3/users/6a5238472e384922bc634631d6fa91ca => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 10:59:10.065756 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a041a7-a23a-4e9b-ac14-2d8d4ecd44ff None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:59:10.066035 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a041a7-a23a-4e9b-ac14-2d8d4ecd44ff None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:59:10.066333 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a041a7-a23a-4e9b-ac14-2d8d4ecd44ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:59:10.122401 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-c5a041a7-a23a-4e9b-ac14-2d8d4ecd44ff None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 10:59:10.123608 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-c5a041a7-a23a-4e9b-ac14-2d8d4ecd44ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:59:10.199949 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:59:10.213425 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 768/1508] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 10:59:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 10:59:10.224298 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bb5858-1487-406e-9466-0e5e915ad86a admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:59:10.225595 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-e7bb5858-1487-406e-9466-0e5e915ad86a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:59:10.346546 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bb5858-1487-406e-9466-0e5e915ad86a admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:59:10.409803 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:59:10.432970 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886024be-a251-43da-a76b-906568d6a9b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:59:10.433619 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886024be-a251-43da-a76b-906568d6a9b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:59:10.433903 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886024be-a251-43da-a76b-906568d6a9b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:59:10.434175 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886024be-a251-43da-a76b-906568d6a9b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:59:10.435794 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-886024be-a251-43da-a76b-906568d6a9b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:59:10.550540 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886024be-a251-43da-a76b-906568d6a9b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:59:10.551966 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886024be-a251-43da-a76b-906568d6a9b6 service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:59:10.572122 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 741/1509] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 10:59:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 10:59:10.974868 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a041a7-a23a-4e9b-ac14-2d8d4ecd44ff None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 10:59:10.976117 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-c5a041a7-a23a-4e9b-ac14-2d8d4ecd44ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 10:59:10.988706 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a041a7-a23a-4e9b-ac14-2d8d4ecd44ff None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 10:59:11.090772 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4ca43f-3356-459c-b37d-cc077e7e9d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 10:59:11.091294 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ca43f-3356-459c-b37d-cc077e7e9d44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 10:59:11.091566 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ca43f-3356-459c-b37d-cc077e7e9d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 10:59:11.091835 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ca43f-3356-459c-b37d-cc077e7e9d44 admin admin] PATH_INFO: `/v3/projects/1e24c693548e491e80f8a75be3f03983` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 10:59:11.103161 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4ca43f-3356-459c-b37d-cc077e7e9d44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e24c693548e491e80f8a75be3f03983)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 10:59:11.104910 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: WARNING py.warnings [None req-5d4ca43f-3356-459c-b37d-cc077e7e9d44 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 10:59:11.104910 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: warnings.warn(msg) Aug 18 10:59:11.104910 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: Aug 18 10:59:11.107100 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4ca43f-3356-459c-b37d-cc077e7e9d44 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 10:59:11.171129 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-5d4ca43f-3356-459c-b37d-cc077e7e9d44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e24c693548e491e80f8a75be3f03983', 'request_id': 'req-5d4ca43f-3356-459c-b37d-cc077e7e9d44'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 10:59:11.182865 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-5d4ca43f-3356-459c-b37d-cc077e7e9d44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e24c693548e491e80f8a75be3f03983', 'request_id': 'req-5d4ca43f-3356-459c-b37d-cc077e7e9d44'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 10:59:11.197727 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-5d4ca43f-3356-459c-b37d-cc077e7e9d44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e24c693548e491e80f8a75be3f03983', 'request_id': 'req-5d4ca43f-3356-459c-b37d-cc077e7e9d44'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 10:59:11.226601 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-5d4ca43f-3356-459c-b37d-cc077e7e9d44 admin admin] The token cache is being invalidate because project 1e24c693548e491e80f8a75be3f03983 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 10:59:11.226890 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-5d4ca43f-3356-459c-b37d-cc077e7e9d44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 10:59:11.227429 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-5d4ca43f-3356-459c-b37d-cc077e7e9d44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 10:59:11.228773 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 769/1510] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 10:59:10 2022] DELETE /identity/v3/projects/1e24c693548e491e80f8a75be3f03983 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 10:59:20.568339 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=62 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:59:21.225349 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:00:42.291665 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e15f0d5-4083-4691-98cd-e7e6c18b18ad None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:00:42.292270 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e15f0d5-4083-4691-98cd-e7e6c18b18ad None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:00:42.292270 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e15f0d5-4083-4691-98cd-e7e6c18b18ad None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:00:42.293576 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 742/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 11:00:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:00:42.298614 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610b7289-c4f3-4a0a-b64c-fc0647029022 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:00:42.299082 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610b7289-c4f3-4a0a-b64c-fc0647029022 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:00:42.299206 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610b7289-c4f3-4a0a-b64c-fc0647029022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:00:42.380415 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-610b7289-c4f3-4a0a-b64c-fc0647029022 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:00:42.381671 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-610b7289-c4f3-4a0a-b64c-fc0647029022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:00:42.491540 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 770/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 11:00:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:00:42.647474 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e15f0d5-4083-4691-98cd-e7e6c18b18ad None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:00:42.650425 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-2e15f0d5-4083-4691-98cd-e7e6c18b18ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:00:42.770087 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e15f0d5-4083-4691-98cd-e7e6c18b18ad None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:00:42.776228 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3a476d-08e3-4d37-85b2-44108d3ecbd6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a005d8f0c46d44c7b6f2201a54717b12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:00:42.776836 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a476d-08e3-4d37-85b2-44108d3ecbd6 service nova] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:00:42.777113 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a476d-08e3-4d37-85b2-44108d3ecbd6 service nova] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:00:42.777384 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a476d-08e3-4d37-85b2-44108d3ecbd6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:00:42.785483 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3a476d-08e3-4d37-85b2-44108d3ecbd6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:00:42.787351 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3a476d-08e3-4d37-85b2-44108d3ecbd6 service nova] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:00:42.796834 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 743/1513] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:00:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:00:43.670955 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511bdcb5-8fb3-45d8-b94a-a7567e304201 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:00:43.671528 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511bdcb5-8fb3-45d8-b94a-a7567e304201 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:00:43.671528 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511bdcb5-8fb3-45d8-b94a-a7567e304201 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:00:43.672866 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 771/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 11:00:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:00:43.677945 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff7424f-dfe3-4b48-8f53-f2d79d049e98 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:00:43.678393 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff7424f-dfe3-4b48-8f53-f2d79d049e98 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:00:43.678517 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff7424f-dfe3-4b48-8f53-f2d79d049e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:00:43.698950 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-fff7424f-dfe3-4b48-8f53-f2d79d049e98 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:00:43.700157 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-fff7424f-dfe3-4b48-8f53-f2d79d049e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:00:43.708269 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 744/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 11:00:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:00:43.869104 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511bdcb5-8fb3-45d8-b94a-a7567e304201 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:00:43.884863 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511bdcb5-8fb3-45d8-b94a-a7567e304201 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:00:43.890536 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa1471f-1c94-4cfe-88df-9aaa88c52a83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a005d8f0c46d44c7b6f2201a54717b12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:00:43.891141 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa1471f-1c94-4cfe-88df-9aaa88c52a83 service nova] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:00:43.891423 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa1471f-1c94-4cfe-88df-9aaa88c52a83 service nova] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:00:43.891701 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa1471f-1c94-4cfe-88df-9aaa88c52a83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:00:43.902277 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa1471f-1c94-4cfe-88df-9aaa88c52a83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:00:43.904052 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa1471f-1c94-4cfe-88df-9aaa88c52a83 service nova] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:00:43.915357 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 772/1516] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:00:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:00:44.230969 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba77f7b-1886-4ff9-b58d-93d966a70d4d None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:00:44.231317 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba77f7b-1886-4ff9-b58d-93d966a70d4d None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:00:44.231658 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba77f7b-1886-4ff9-b58d-93d966a70d4d None None] PATH_INFO: `/v3` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:00:44.233014 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 745/1517] 10.222.0.40 () {54 vars in 925 bytes} [Thu Aug 18 11:00:44 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:00:44.239442 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c2651-6e6f-4128-9c52-513459e2e244 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:00:44.239729 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c2651-6e6f-4128-9c52-513459e2e244 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:00:44.240007 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c2651-6e6f-4128-9c52-513459e2e244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:00:44.299369 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-a65c2651-6e6f-4128-9c52-513459e2e244 None None] MFA Rules not processed for user `0f918bcdd83d4d48be3fff5a48c54929`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:00:44.300584 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-a65c2651-6e6f-4128-9c52-513459e2e244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:00:44.316978 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:00:44.375910 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 773/1518] 10.222.0.40 () {58 vars in 1015 bytes} [Thu Aug 18 11:00:44 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:00:48.123323 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6fde59-0478-4e97-9ab7-b3236a1abd4f None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:00:48.123870 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6fde59-0478-4e97-9ab7-b3236a1abd4f None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:00:48.123870 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6fde59-0478-4e97-9ab7-b3236a1abd4f None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:00:48.125079 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 746/1519] 10.222.0.15 () {54 vars in 961 bytes} [Thu Aug 18 11:00:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:00:48.129984 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c931e6-03ff-4a04-98ec-a250b8c116e1 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:00:48.130394 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c931e6-03ff-4a04-98ec-a250b8c116e1 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:00:48.130543 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c931e6-03ff-4a04-98ec-a250b8c116e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:00:48.151442 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-50c931e6-03ff-4a04-98ec-a250b8c116e1 None None] MFA Rules not processed for user `0f918bcdd83d4d48be3fff5a48c54929`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:00:48.152650 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-50c931e6-03ff-4a04-98ec-a250b8c116e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:00:48.161154 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 774/1520] 10.222.0.15 () {58 vars in 1058 bytes} [Thu Aug 18 11:00:48 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:00:48.169160 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6fde59-0478-4e97-9ab7-b3236a1abd4f None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:00:48.182560 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6fde59-0478-4e97-9ab7-b3236a1abd4f None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:00:48.187395 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726b3140-f6a3-41b2-a15a-dae4d15cea2a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f918bcdd83d4d48be3fff5a48c54929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:00:48.188030 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726b3140-f6a3-41b2-a15a-dae4d15cea2a service placement] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:00:48.188304 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726b3140-f6a3-41b2-a15a-dae4d15cea2a service placement] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:00:48.188571 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726b3140-f6a3-41b2-a15a-dae4d15cea2a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:00:48.197343 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726b3140-f6a3-41b2-a15a-dae4d15cea2a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:00:48.198962 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726b3140-f6a3-41b2-a15a-dae4d15cea2a service placement] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:00:48.209006 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 747/1521] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:00:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:00:55.166616 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c12647-b214-412d-a0cf-5ccfe5764a09 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:00:55.167217 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c12647-b214-412d-a0cf-5ccfe5764a09 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:00:55.167217 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c12647-b214-412d-a0cf-5ccfe5764a09 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:00:55.168499 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 775/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 11:00:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:00:55.173375 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1829f75e-5628-401d-b7ee-76658f4edc2a None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:00:55.173871 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1829f75e-5628-401d-b7ee-76658f4edc2a None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:00:55.173981 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1829f75e-5628-401d-b7ee-76658f4edc2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:00:55.193179 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-1829f75e-5628-401d-b7ee-76658f4edc2a None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:00:55.194416 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-1829f75e-5628-401d-b7ee-76658f4edc2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:00:55.202680 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 748/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 11:00:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:00:55.360158 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c12647-b214-412d-a0cf-5ccfe5764a09 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:00:55.374648 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c12647-b214-412d-a0cf-5ccfe5764a09 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:00:55.380021 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91612bb1-2e2d-4b5a-b13f-8542bce68863 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a005d8f0c46d44c7b6f2201a54717b12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:00:55.380611 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91612bb1-2e2d-4b5a-b13f-8542bce68863 service nova] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:00:55.380887 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91612bb1-2e2d-4b5a-b13f-8542bce68863 service nova] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:00:55.381157 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91612bb1-2e2d-4b5a-b13f-8542bce68863 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:00:55.390078 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91612bb1-2e2d-4b5a-b13f-8542bce68863 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:00:55.391700 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91612bb1-2e2d-4b5a-b13f-8542bce68863 service nova] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:00:55.402192 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 776/1524] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:00:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:00:56.223718 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1132e1-195d-4fdc-b2bd-88515dd226e9 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:00:56.224214 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1132e1-195d-4fdc-b2bd-88515dd226e9 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:00:56.224322 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1132e1-195d-4fdc-b2bd-88515dd226e9 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:00:56.225656 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 749/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 11:00:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:00:56.231511 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f8ebf-fa5c-470b-9e52-01315d8954c0 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:00:56.231920 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f8ebf-fa5c-470b-9e52-01315d8954c0 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:00:56.232060 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f8ebf-fa5c-470b-9e52-01315d8954c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:00:56.252449 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-d58f8ebf-fa5c-470b-9e52-01315d8954c0 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:00:56.253747 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-d58f8ebf-fa5c-470b-9e52-01315d8954c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:00:56.262394 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 777/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 11:00:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:00:56.422426 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1132e1-195d-4fdc-b2bd-88515dd226e9 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:00:56.437233 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1132e1-195d-4fdc-b2bd-88515dd226e9 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:00:56.442766 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24432c49-d920-470b-83a6-2069d9457299 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a005d8f0c46d44c7b6f2201a54717b12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:00:56.443397 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24432c49-d920-470b-83a6-2069d9457299 service nova] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:00:56.443672 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24432c49-d920-470b-83a6-2069d9457299 service nova] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:00:56.443941 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24432c49-d920-470b-83a6-2069d9457299 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:00:56.452401 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24432c49-d920-470b-83a6-2069d9457299 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:00:56.454012 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24432c49-d920-470b-83a6-2069d9457299 service nova] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:00:56.463436 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 750/1527] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:00:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:01:00.478772 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b30a5-82e6-45c4-a25d-e09000878826 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:01:00.479337 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b30a5-82e6-45c4-a25d-e09000878826 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:01:00.479337 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b30a5-82e6-45c4-a25d-e09000878826 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:01:00.480579 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 778/1528] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 11:01:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:01:00.485810 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b6a83c-4686-463d-9089-0b307e72c354 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:01:00.486242 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b6a83c-4686-463d-9089-0b307e72c354 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:01:00.486364 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b6a83c-4686-463d-9089-0b307e72c354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:01:00.505685 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-64b6a83c-4686-463d-9089-0b307e72c354 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:01:00.506921 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-64b6a83c-4686-463d-9089-0b307e72c354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:01:00.515435 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 751/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 11:01:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:01:00.805418 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27b30a5-82e6-45c4-a25d-e09000878826 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:01:00.807171 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-f27b30a5-82e6-45c4-a25d-e09000878826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:01:00.888602 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27b30a5-82e6-45c4-a25d-e09000878826 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:01:00.892214 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df41dc43-5faf-4bbf-9fb5-65c6e855c952 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:01:00.892827 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df41dc43-5faf-4bbf-9fb5-65c6e855c952 service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:01:00.893109 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df41dc43-5faf-4bbf-9fb5-65c6e855c952 service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:01:00.893390 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df41dc43-5faf-4bbf-9fb5-65c6e855c952 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:01:00.904137 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df41dc43-5faf-4bbf-9fb5-65c6e855c952 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:01:00.905617 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df41dc43-5faf-4bbf-9fb5-65c6e855c952 service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:01:00.915967 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 779/1530] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:01:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:01:02.892103 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e342bb1-0511-434b-b79f-8c60a55b564c None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:01:02.892685 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e342bb1-0511-434b-b79f-8c60a55b564c None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:01:02.892685 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e342bb1-0511-434b-b79f-8c60a55b564c None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:01:02.894096 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 752/1531] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 11:01:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:01:02.899988 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a97cf99-dfb8-45f4-be84-9d5f983a01c8 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:01:02.900488 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a97cf99-dfb8-45f4-be84-9d5f983a01c8 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:01:02.900583 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a97cf99-dfb8-45f4-be84-9d5f983a01c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:01:02.920802 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-3a97cf99-dfb8-45f4-be84-9d5f983a01c8 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:01:02.922042 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-3a97cf99-dfb8-45f4-be84-9d5f983a01c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:01:02.930836 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 780/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 11:01:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:01:03.218493 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e342bb1-0511-434b-b79f-8c60a55b564c None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:01:03.230607 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e342bb1-0511-434b-b79f-8c60a55b564c None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:01:03.234191 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbecc21-a55f-4505-81f9-4434ee176a86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:01:03.234783 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbecc21-a55f-4505-81f9-4434ee176a86 service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:01:03.235073 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbecc21-a55f-4505-81f9-4434ee176a86 service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:01:03.235341 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbecc21-a55f-4505-81f9-4434ee176a86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:01:03.245303 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbecc21-a55f-4505-81f9-4434ee176a86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:01:03.246793 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbecc21-a55f-4505-81f9-4434ee176a86 service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:01:03.256612 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 753/1533] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:01:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:01:06.631201 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9aa25f-8934-41f0-991c-4f50e9c35b4c None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:01:06.631768 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9aa25f-8934-41f0-991c-4f50e9c35b4c None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:01:06.631768 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9aa25f-8934-41f0-991c-4f50e9c35b4c None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:01:06.633989 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 781/1534] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 11:01:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:01:06.639420 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef882e95-f3e3-474e-bd78-17f4eaaa97de None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:01:06.639920 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef882e95-f3e3-474e-bd78-17f4eaaa97de None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:01:06.640107 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef882e95-f3e3-474e-bd78-17f4eaaa97de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:01:06.660328 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-ef882e95-f3e3-474e-bd78-17f4eaaa97de None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:01:06.661561 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-ef882e95-f3e3-474e-bd78-17f4eaaa97de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:01:06.669667 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 754/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 11:01:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:01:07.219948 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9aa25f-8934-41f0-991c-4f50e9c35b4c None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:01:07.221655 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-ed9aa25f-8934-41f0-991c-4f50e9c35b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:01:07.285090 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:01:07.299617 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9aa25f-8934-41f0-991c-4f50e9c35b4c None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:01:07.303157 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fbb996-d2f6-45d4-8762-b1189aff063f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b8a09704b9b4ab2bffb813796ec6e77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:01:07.303763 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fbb996-d2f6-45d4-8762-b1189aff063f service cinder] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:01:07.304040 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fbb996-d2f6-45d4-8762-b1189aff063f service cinder] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:01:07.304328 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fbb996-d2f6-45d4-8762-b1189aff063f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:01:07.313925 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fbb996-d2f6-45d4-8762-b1189aff063f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:01:07.315412 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fbb996-d2f6-45d4-8762-b1189aff063f service cinder] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:01:07.325642 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 782/1536] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:01:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:01:09.260697 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a49e71-ae82-4de9-9d07-61947c41e7cf None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:01:09.261262 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a49e71-ae82-4de9-9d07-61947c41e7cf None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:01:09.261262 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a49e71-ae82-4de9-9d07-61947c41e7cf None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:01:09.262622 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 755/1537] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 11:01:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:01:09.267875 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ef9eb-a2f5-4c41-b710-1a2d91a32d06 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:01:09.268309 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ef9eb-a2f5-4c41-b710-1a2d91a32d06 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:01:09.268425 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ef9eb-a2f5-4c41-b710-1a2d91a32d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:01:09.288013 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-1c4ef9eb-a2f5-4c41-b710-1a2d91a32d06 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:01:09.289869 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-1c4ef9eb-a2f5-4c41-b710-1a2d91a32d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:01:09.298124 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 783/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 11:01:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:01:09.854575 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a49e71-ae82-4de9-9d07-61947c41e7cf None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:01:09.856362 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-55a49e71-ae82-4de9-9d07-61947c41e7cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:01:09.872052 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a49e71-ae82-4de9-9d07-61947c41e7cf None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:01:09.875828 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeb2de0-d754-40a5-8a56-28745e3b56bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b8a09704b9b4ab2bffb813796ec6e77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:01:09.876460 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb2de0-d754-40a5-8a56-28745e3b56bf service cinder] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:01:09.876738 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb2de0-d754-40a5-8a56-28745e3b56bf service cinder] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:01:09.877011 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb2de0-d754-40a5-8a56-28745e3b56bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:01:09.886998 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeb2de0-d754-40a5-8a56-28745e3b56bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:01:09.888429 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeb2de0-d754-40a5-8a56-28745e3b56bf service cinder] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:01:09.898422 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 756/1539] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:01:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:01:19.282893 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=11 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:01:19.893892 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=89 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:02:34.762788 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ffe0c6-ba8b-4540-9b9b-7fe7974df57b None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:34.763488 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ffe0c6-ba8b-4540-9b9b-7fe7974df57b None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:34.763488 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ffe0c6-ba8b-4540-9b9b-7fe7974df57b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:34.790986 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-36ffe0c6-ba8b-4540-9b9b-7fe7974df57b None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:02:34.792245 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-36ffe0c6-ba8b-4540-9b9b-7fe7974df57b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:34.801096 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 784/1540] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:02:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:02:34.810656 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d982f2a1-675d-4544-a346-65c248443269 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:34.811752 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d982f2a1-675d-4544-a346-65c248443269 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:34.812254 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d982f2a1-675d-4544-a346-65c248443269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:34.814498 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e6d4e-8d33-417f-8ec2-8ddc72d74c38 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:34.814781 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e6d4e-8d33-417f-8ec2-8ddc72d74c38 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:34.815055 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e6d4e-8d33-417f-8ec2-8ddc72d74c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:34.846738 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-907e6d4e-8d33-417f-8ec2-8ddc72d74c38 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:02:34.847710 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-d982f2a1-675d-4544-a346-65c248443269 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:02:34.847975 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-907e6d4e-8d33-417f-8ec2-8ddc72d74c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:34.849467 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-d982f2a1-675d-4544-a346-65c248443269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:34.863408 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 785/1541] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:02:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:02:34.871377 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 757/1542] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:02:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:02:34.876996 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca810b-320e-4973-8e82-9db26b8aff5c None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:34.877588 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca810b-320e-4973-8e82-9db26b8aff5c None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:34.878028 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca810b-320e-4973-8e82-9db26b8aff5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:34.884113 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d982f2a1-675d-4544-a346-65c248443269 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:34.904387 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d982f2a1-675d-4544-a346-65c248443269 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:34.915266 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-9dca810b-320e-4973-8e82-9db26b8aff5c None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:02:34.916184 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1811ee37-847f-40c5-b8da-d0001d75bdec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:34.916923 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1811ee37-847f-40c5-b8da-d0001d75bdec admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:34.917239 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-9dca810b-320e-4973-8e82-9db26b8aff5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:34.917369 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1811ee37-847f-40c5-b8da-d0001d75bdec admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:34.917792 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1811ee37-847f-40c5-b8da-d0001d75bdec admin admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:34.918576 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1811ee37-847f-40c5-b8da-d0001d75bdec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:02:34.919021 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1811ee37-847f-40c5-b8da-d0001d75bdec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:34.920134 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: WARNING py.warnings [None req-1811ee37-847f-40c5-b8da-d0001d75bdec admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:02:34.920134 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: warnings.warn(msg) Aug 18 11:02:34.920134 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: Aug 18 11:02:34.923921 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1811ee37-847f-40c5-b8da-d0001d75bdec admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:34.942815 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 786/1543] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:02:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:02:34.944558 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0dd4ba-6b3c-4644-9d89-9acb5c41f58d None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:34.950525 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 758/1544] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Aug 18 11:02:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:02:34.951899 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9bc8d1-9253-4290-b5b6-57a67e1cdebb None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:34.952184 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9bc8d1-9253-4290-b5b6-57a67e1cdebb None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:34.952462 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9bc8d1-9253-4290-b5b6-57a67e1cdebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:34.953055 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0dd4ba-6b3c-4644-9d89-9acb5c41f58d None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:34.953333 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0dd4ba-6b3c-4644-9d89-9acb5c41f58d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:34.987729 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-af9bc8d1-9253-4290-b5b6-57a67e1cdebb None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:02:34.989408 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-af9bc8d1-9253-4290-b5b6-57a67e1cdebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:35.001103 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-3c0dd4ba-6b3c-4644-9d89-9acb5c41f58d None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:02:35.003172 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-3c0dd4ba-6b3c-4644-9d89-9acb5c41f58d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:35.009874 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 759/1545] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:02:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:02:35.011604 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b8238-e9d7-482d-abe6-f624a14565ab None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:35.012059 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b8238-e9d7-482d-abe6-f624a14565ab None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:35.012513 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b8238-e9d7-482d-abe6-f624a14565ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:35.023264 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 787/1546] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:02:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:02:35.024391 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0dd4ba-6b3c-4644-9d89-9acb5c41f58d None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:35.035285 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0dd4ba-6b3c-4644-9d89-9acb5c41f58d None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:35.038916 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-ce7b8238-e9d7-482d-abe6-f624a14565ab None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:02:35.040151 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-ce7b8238-e9d7-482d-abe6-f624a14565ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:35.040566 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cce049-6232-4b23-81f6-773227b75985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:35.041282 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cce049-6232-4b23-81f6-773227b75985 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:35.041667 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cce049-6232-4b23-81f6-773227b75985 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:35.041949 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cce049-6232-4b23-81f6-773227b75985 admin admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:35.042773 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cce049-6232-4b23-81f6-773227b75985 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:02:35.043304 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cce049-6232-4b23-81f6-773227b75985 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:35.045305 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cce049-6232-4b23-81f6-773227b75985 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:35.049140 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 760/1547] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:02:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:02:35.049992 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7b8238-e9d7-482d-abe6-f624a14565ab None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:35.061262 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7b8238-e9d7-482d-abe6-f624a14565ab None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:35.066411 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0659ab0d-6b1c-4ae3-9fe5-d20705e2b2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:35.067031 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0659ab0d-6b1c-4ae3-9fe5-d20705e2b2b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:35.067312 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0659ab0d-6b1c-4ae3-9fe5-d20705e2b2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:35.067588 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0659ab0d-6b1c-4ae3-9fe5-d20705e2b2b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:35.068376 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 788/1548] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Aug 18 11:02:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:02:35.069196 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0659ab0d-6b1c-4ae3-9fe5-d20705e2b2b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:35.070468 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6691dd-be63-42cc-840a-ba03a21b6c06 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:35.070754 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6691dd-be63-42cc-840a-ba03a21b6c06 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:35.070961 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0659ab0d-6b1c-4ae3-9fe5-d20705e2b2b6 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:35.071085 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6691dd-be63-42cc-840a-ba03a21b6c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:35.106452 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-6b6691dd-be63-42cc-840a-ba03a21b6c06 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:02:35.108231 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-6b6691dd-be63-42cc-840a-ba03a21b6c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:35.117674 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 789/1549] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:02:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:02:35.118764 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a00464-fda3-4778-a451-d60cf37b355e None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:35.119049 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a00464-fda3-4778-a451-d60cf37b355e None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:35.119321 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a00464-fda3-4778-a451-d60cf37b355e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:35.124734 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 761/1550] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:02:35 2022] POST /identity/v3/projects => generated 391 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:02:35.126345 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a2587-c913-4b0d-ac8c-e3e76646eff4 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:35.127322 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a2587-c913-4b0d-ac8c-e3e76646eff4 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:35.127322 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a2587-c913-4b0d-ac8c-e3e76646eff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:35.139417 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-c8a00464-fda3-4778-a451-d60cf37b355e None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:02:35.140670 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-c8a00464-fda3-4778-a451-d60cf37b355e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:35.146622 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-9c3a2587-c913-4b0d-ac8c-e3e76646eff4 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:02:35.147806 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-9c3a2587-c913-4b0d-ac8c-e3e76646eff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:35.210441 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 790/1551] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:02:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:02:35.210441 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1714410c-c4de-4986-a652-ba9b3bb60d08 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:35.210441 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1714410c-c4de-4986-a652-ba9b3bb60d08 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:35.210441 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1714410c-c4de-4986-a652-ba9b3bb60d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:35.221464 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 762/1552] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:02:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:02:35.222803 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3a2587-c913-4b0d-ac8c-e3e76646eff4 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:35.238043 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3a2587-c913-4b0d-ac8c-e3e76646eff4 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:35.242608 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-1714410c-c4de-4986-a652-ba9b3bb60d08 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:02:35.244571 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-1714410c-c4de-4986-a652-ba9b3bb60d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:35.245970 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8631ffe6-62e0-43ec-ac8a-b4d55904510f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:35.246926 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8631ffe6-62e0-43ec-ac8a-b4d55904510f admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:35.247396 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8631ffe6-62e0-43ec-ac8a-b4d55904510f admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:35.247860 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8631ffe6-62e0-43ec-ac8a-b4d55904510f admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:35.248921 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8631ffe6-62e0-43ec-ac8a-b4d55904510f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:35.252379 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8631ffe6-62e0-43ec-ac8a-b4d55904510f admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:35.258103 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 791/1553] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:02:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:02:35.259790 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36564bf-0517-42e6-a098-4f7b954f6de7 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:35.260255 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36564bf-0517-42e6-a098-4f7b954f6de7 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:35.260715 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36564bf-0517-42e6-a098-4f7b954f6de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:35.286098 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-d36564bf-0517-42e6-a098-4f7b954f6de7 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:02:35.288192 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-d36564bf-0517-42e6-a098-4f7b954f6de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:35.291273 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 763/1554] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:02:35 2022] POST /identity/v3/projects => generated 377 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:02:35.292536 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd724043-cbd7-4572-b8c5-64c0a51c77ea None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:35.292824 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd724043-cbd7-4572-b8c5-64c0a51c77ea None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:35.293100 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd724043-cbd7-4572-b8c5-64c0a51c77ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:35.314040 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-fd724043-cbd7-4572-b8c5-64c0a51c77ea None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:02:35.315249 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-fd724043-cbd7-4572-b8c5-64c0a51c77ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:35.352812 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 792/1555] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:02:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:02:35.354378 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b3c2bf-9a29-4052-bfb3-45922314183c None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:35.354865 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b3c2bf-9a29-4052-bfb3-45922314183c None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:35.355152 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b3c2bf-9a29-4052-bfb3-45922314183c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:35.375571 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-79b3c2bf-9a29-4052-bfb3-45922314183c None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:02:35.377645 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-79b3c2bf-9a29-4052-bfb3-45922314183c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:35.380087 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 764/1556] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:02:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:02:35.381826 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd724043-cbd7-4572-b8c5-64c0a51c77ea None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:35.391173 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 793/1557] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:02:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:02:35.392193 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b3c2bf-9a29-4052-bfb3-45922314183c None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:35.397305 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd724043-cbd7-4572-b8c5-64c0a51c77ea None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:35.402548 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d0d01-fffd-4271-9e16-b1e4b2364bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:35.403166 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d0d01-fffd-4271-9e16-b1e4b2364bbe admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:35.403449 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d0d01-fffd-4271-9e16-b1e4b2364bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:35.403721 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d0d01-fffd-4271-9e16-b1e4b2364bbe admin admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:35.404355 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88d0d01-fffd-4271-9e16-b1e4b2364bbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:35.404480 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b3c2bf-9a29-4052-bfb3-45922314183c None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:35.405372 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: WARNING py.warnings [None req-e88d0d01-fffd-4271-9e16-b1e4b2364bbe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:02:35.405372 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: warnings.warn(msg) Aug 18 11:02:35.405372 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: Aug 18 11:02:35.406645 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88d0d01-fffd-4271-9e16-b1e4b2364bbe admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:35.409129 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6e8581-2408-4663-aee9-1c8c95bb7ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:35.409757 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e8581-2408-4663-aee9-1c8c95bb7ac7 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:35.410025 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e8581-2408-4663-aee9-1c8c95bb7ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:35.410295 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e8581-2408-4663-aee9-1c8c95bb7ac7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:35.410936 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6e8581-2408-4663-aee9-1c8c95bb7ac7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:02:35.411258 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6e8581-2408-4663-aee9-1c8c95bb7ac7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:35.412869 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6e8581-2408-4663-aee9-1c8c95bb7ac7 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:35.423759 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:02:35.434152 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 794/1558] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Aug 18 11:02:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:02:35.434152 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6e8581-2408-4663-aee9-1c8c95bb7ac7 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:35.440695 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 765/1559] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:02:35 2022] POST /identity/v3/users => generated 296 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:02:35.441639 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d0d01-fffd-4271-9e16-b1e4b2364bbe admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:35.448427 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6e8581-2408-4663-aee9-1c8c95bb7ac7 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:35.451895 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d0d01-fffd-4271-9e16-b1e4b2364bbe admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:35.453142 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87452e9d-12c5-48e0-8dc2-3b8055f1102d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:35.453779 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87452e9d-12c5-48e0-8dc2-3b8055f1102d admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:35.454055 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87452e9d-12c5-48e0-8dc2-3b8055f1102d admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:35.454324 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87452e9d-12c5-48e0-8dc2-3b8055f1102d admin admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:35.454965 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87452e9d-12c5-48e0-8dc2-3b8055f1102d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:02:35.455261 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87452e9d-12c5-48e0-8dc2-3b8055f1102d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:35.456455 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df333718-67eb-46e5-8aa7-431deff4a110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:35.456852 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87452e9d-12c5-48e0-8dc2-3b8055f1102d admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:35.457043 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df333718-67eb-46e5-8aa7-431deff4a110 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:35.457320 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df333718-67eb-46e5-8aa7-431deff4a110 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:35.457763 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df333718-67eb-46e5-8aa7-431deff4a110 admin admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:35.458391 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df333718-67eb-46e5-8aa7-431deff4a110 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:02:35.458723 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df333718-67eb-46e5-8aa7-431deff4a110 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:35.461079 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df333718-67eb-46e5-8aa7-431deff4a110 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:35.469863 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 795/1560] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Aug 18 11:02:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:02:35.470714 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87452e9d-12c5-48e0-8dc2-3b8055f1102d admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:35.477184 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 766/1561] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Aug 18 11:02:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:02:35.478664 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9523339-9c81-42fc-84d5-4329786330d9 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:35.479148 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9523339-9c81-42fc-84d5-4329786330d9 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:35.479546 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9523339-9c81-42fc-84d5-4329786330d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:35.481538 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87452e9d-12c5-48e0-8dc2-3b8055f1102d admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:35.486644 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4238cd9d-a508-487b-a973-175391cf9494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:35.487267 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4238cd9d-a508-487b-a973-175391cf9494 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:35.487909 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4238cd9d-a508-487b-a973-175391cf9494 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:35.488191 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4238cd9d-a508-487b-a973-175391cf9494 admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:35.488833 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4238cd9d-a508-487b-a973-175391cf9494 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:35.491461 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4238cd9d-a508-487b-a973-175391cf9494 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:35.501586 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-d9523339-9c81-42fc-84d5-4329786330d9 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:02:35.502848 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-d9523339-9c81-42fc-84d5-4329786330d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:35.510260 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:02:35.513886 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 767/1562] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:02:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:02:35.515155 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1031b1ea-42f6-42a8-892e-fa5ba4e79799 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:35.515438 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1031b1ea-42f6-42a8-892e-fa5ba4e79799 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:35.515721 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1031b1ea-42f6-42a8-892e-fa5ba4e79799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:35.523845 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 796/1563] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:02:35 2022] POST /identity/v3/users => generated 289 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:02:35.523845 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4238cd9d-a508-487b-a973-175391cf9494 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:35.534364 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4238cd9d-a508-487b-a973-175391cf9494 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:35.539875 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-1031b1ea-42f6-42a8-892e-fa5ba4e79799 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:02:35.540819 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c1f6f7-18af-4394-be0d-c8a703233099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:35.541496 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-1031b1ea-42f6-42a8-892e-fa5ba4e79799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:35.542274 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c1f6f7-18af-4394-be0d-c8a703233099 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:35.542989 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c1f6f7-18af-4394-be0d-c8a703233099 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:35.542989 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c1f6f7-18af-4394-be0d-c8a703233099 admin admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:35.544231 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c1f6f7-18af-4394-be0d-c8a703233099 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:02:35.544503 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c1f6f7-18af-4394-be0d-c8a703233099 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:35.546304 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c1f6f7-18af-4394-be0d-c8a703233099 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:35.550296 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 768/1564] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:02:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:02:35.551038 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1031b1ea-42f6-42a8-892e-fa5ba4e79799 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:35.567651 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 797/1565] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Aug 18 11:02:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:02:35.567651 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c1f6f7-18af-4394-be0d-c8a703233099 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:35.567958 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1031b1ea-42f6-42a8-892e-fa5ba4e79799 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:35.567958 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a736404-dce2-47fa-9d0b-0c19d6914d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:35.567958 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a736404-dce2-47fa-9d0b-0c19d6914d52 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:35.567958 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a736404-dce2-47fa-9d0b-0c19d6914d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:35.568330 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a736404-dce2-47fa-9d0b-0c19d6914d52 admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:35.569447 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a736404-dce2-47fa-9d0b-0c19d6914d52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:35.571540 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a736404-dce2-47fa-9d0b-0c19d6914d52 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:35.572551 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c1f6f7-18af-4394-be0d-c8a703233099 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:35.577226 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b274ef3-e5f0-4859-b612-471465788dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:35.577853 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b274ef3-e5f0-4859-b612-471465788dc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:35.578133 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b274ef3-e5f0-4859-b612-471465788dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:35.578415 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b274ef3-e5f0-4859-b612-471465788dc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:35.579071 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b274ef3-e5f0-4859-b612-471465788dc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:35.580662 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b274ef3-e5f0-4859-b612-471465788dc5 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:35.591450 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 798/1566] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:02:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:02:35.592393 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b274ef3-e5f0-4859-b612-471465788dc5 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:35.602948 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 769/1567] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:02:35 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:02:35.603203 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b274ef3-e5f0-4859-b612-471465788dc5 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:35.604302 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a736404-dce2-47fa-9d0b-0c19d6914d52 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:35.670484 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d207fdb3-b80a-4305-92d4-211ec8d37220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:35.671165 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a736404-dce2-47fa-9d0b-0c19d6914d52 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:35.672437 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d207fdb3-b80a-4305-92d4-211ec8d37220 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:35.672437 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d207fdb3-b80a-4305-92d4-211ec8d37220 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:35.672437 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d207fdb3-b80a-4305-92d4-211ec8d37220 admin admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:35.672756 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d207fdb3-b80a-4305-92d4-211ec8d37220 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:35.673501 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: WARNING py.warnings [None req-d207fdb3-b80a-4305-92d4-211ec8d37220 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:02:35.673501 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: warnings.warn(msg) Aug 18 11:02:35.673501 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: Aug 18 11:02:35.674764 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d207fdb3-b80a-4305-92d4-211ec8d37220 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:35.675908 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7929e4-730c-4399-918c-473ed435a447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:35.676523 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7929e4-730c-4399-918c-473ed435a447 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:35.676794 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7929e4-730c-4399-918c-473ed435a447 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:35.677153 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7929e4-730c-4399-918c-473ed435a447 admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:35.677748 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7929e4-730c-4399-918c-473ed435a447 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:35.680470 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7929e4-730c-4399-918c-473ed435a447 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:35.709866 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 799/1568] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:02:35 2022] POST /identity/v3/projects => generated 365 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:02:35.709866 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d207fdb3-b80a-4305-92d4-211ec8d37220 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:35.710208 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 770/1569] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:02:35 2022] POST /identity/v3/projects => generated 373 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:02:35.710208 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7929e4-730c-4399-918c-473ed435a447 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:35.779314 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d207fdb3-b80a-4305-92d4-211ec8d37220 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:35.781281 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7929e4-730c-4399-918c-473ed435a447 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:35.784132 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456eab1d-4292-48d8-97fe-6d29072d140b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:35.784745 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456eab1d-4292-48d8-97fe-6d29072d140b admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:35.785029 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456eab1d-4292-48d8-97fe-6d29072d140b admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:35.785307 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456eab1d-4292-48d8-97fe-6d29072d140b admin admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:35.785979 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2054b078-1c92-45c9-886f-3c625e3bac71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:35.786129 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456eab1d-4292-48d8-97fe-6d29072d140b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:02:35.786379 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456eab1d-4292-48d8-97fe-6d29072d140b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:35.786580 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2054b078-1c92-45c9-886f-3c625e3bac71 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:35.786863 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2054b078-1c92-45c9-886f-3c625e3bac71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:35.787160 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2054b078-1c92-45c9-886f-3c625e3bac71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:35.788316 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2054b078-1c92-45c9-886f-3c625e3bac71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:35.788500 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456eab1d-4292-48d8-97fe-6d29072d140b admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:35.789984 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2054b078-1c92-45c9-886f-3c625e3bac71 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:35.800175 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 771/1570] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:02:35 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:02:35.801284 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2054b078-1c92-45c9-886f-3c625e3bac71 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:35.801700 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 800/1571] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Aug 18 11:02:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:02:35.803439 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456eab1d-4292-48d8-97fe-6d29072d140b admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:35.817381 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2054b078-1c92-45c9-886f-3c625e3bac71 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:35.817912 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456eab1d-4292-48d8-97fe-6d29072d140b admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:35.822574 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc69805f-9c55-418f-9cc2-0fe3da330092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:35.822824 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aef6380-749d-4e01-8aa0-2ea5d25ea309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:35.823180 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc69805f-9c55-418f-9cc2-0fe3da330092 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:35.823424 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef6380-749d-4e01-8aa0-2ea5d25ea309 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:35.823542 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc69805f-9c55-418f-9cc2-0fe3da330092 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:35.823700 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef6380-749d-4e01-8aa0-2ea5d25ea309 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:35.823804 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc69805f-9c55-418f-9cc2-0fe3da330092 admin admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:35.823970 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef6380-749d-4e01-8aa0-2ea5d25ea309 admin admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:35.824511 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc69805f-9c55-418f-9cc2-0fe3da330092 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:35.824636 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aef6380-749d-4e01-8aa0-2ea5d25ea309 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:02:35.824923 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aef6380-749d-4e01-8aa0-2ea5d25ea309 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:35.826482 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc69805f-9c55-418f-9cc2-0fe3da330092 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:35.826603 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aef6380-749d-4e01-8aa0-2ea5d25ea309 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:35.839184 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 772/1572] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Aug 18 11:02:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:02:35.840002 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aef6380-749d-4e01-8aa0-2ea5d25ea309 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:35.853602 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aef6380-749d-4e01-8aa0-2ea5d25ea309 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:35.861564 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 801/1573] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:02:35 2022] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:02:35.861732 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799bd075-4431-4498-9616-fb4f44ba7e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:35.861732 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799bd075-4431-4498-9616-fb4f44ba7e34 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:35.861936 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc69805f-9c55-418f-9cc2-0fe3da330092 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:35.862047 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799bd075-4431-4498-9616-fb4f44ba7e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:35.862047 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799bd075-4431-4498-9616-fb4f44ba7e34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:35.862047 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799bd075-4431-4498-9616-fb4f44ba7e34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:35.862047 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799bd075-4431-4498-9616-fb4f44ba7e34 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:35.873841 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 773/1574] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:02:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:02:35.874667 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799bd075-4431-4498-9616-fb4f44ba7e34 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:35.888086 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799bd075-4431-4498-9616-fb4f44ba7e34 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:35.892048 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:02:35.896400 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:02:35.929396 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc69805f-9c55-418f-9cc2-0fe3da330092 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:35.934207 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c203cc-36a8-4ddb-b364-4330652b06db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:35.934818 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c203cc-36a8-4ddb-b364-4330652b06db admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:35.935099 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c203cc-36a8-4ddb-b364-4330652b06db admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:35.935371 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c203cc-36a8-4ddb-b364-4330652b06db admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:35.936003 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c203cc-36a8-4ddb-b364-4330652b06db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:35.938026 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c203cc-36a8-4ddb-b364-4330652b06db admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:35.951826 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddc53b7-2cac-4497-b56a-a36f9b1b262e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:35.952535 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc53b7-2cac-4497-b56a-a36f9b1b262e admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:35.952837 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc53b7-2cac-4497-b56a-a36f9b1b262e admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:35.953136 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc53b7-2cac-4497-b56a-a36f9b1b262e admin admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:35.953950 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddc53b7-2cac-4497-b56a-a36f9b1b262e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:35.955980 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddc53b7-2cac-4497-b56a-a36f9b1b262e admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:35.962101 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 802/1575] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:02:35 2022] POST /identity/v3/users => generated 287 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:02:35.965910 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c203cc-36a8-4ddb-b364-4330652b06db admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:35.978265 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c203cc-36a8-4ddb-b364-4330652b06db admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:35.980608 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 774/1576] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:02:35 2022] POST /identity/v3/users => generated 283 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:02:35.981427 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddc53b7-2cac-4497-b56a-a36f9b1b262e admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:35.985616 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560c3f90-6ca3-4252-8a5f-e16e801db9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:35.986437 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c3f90-6ca3-4252-8a5f-e16e801db9a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:35.986716 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c3f90-6ca3-4252-8a5f-e16e801db9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:35.986986 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c3f90-6ca3-4252-8a5f-e16e801db9a1 admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:35.987620 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560c3f90-6ca3-4252-8a5f-e16e801db9a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:35.989638 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560c3f90-6ca3-4252-8a5f-e16e801db9a1 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:35.992107 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddc53b7-2cac-4497-b56a-a36f9b1b262e admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:35.996652 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37887c8c-7bfe-4776-93e9-8647f2aaa6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:35.997241 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37887c8c-7bfe-4776-93e9-8647f2aaa6c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:35.997540 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37887c8c-7bfe-4776-93e9-8647f2aaa6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:35.997822 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37887c8c-7bfe-4776-93e9-8647f2aaa6c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:35.998456 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37887c8c-7bfe-4776-93e9-8647f2aaa6c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:36.000072 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37887c8c-7bfe-4776-93e9-8647f2aaa6c9 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:36.012566 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 775/1577] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:02:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:02:36.013366 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37887c8c-7bfe-4776-93e9-8647f2aaa6c9 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:36.014482 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 803/1578] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:02:35 2022] POST /identity/v3/users => generated 287 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:02:36.015282 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560c3f90-6ca3-4252-8a5f-e16e801db9a1 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:36.025233 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560c3f90-6ca3-4252-8a5f-e16e801db9a1 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:36.025801 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37887c8c-7bfe-4776-93e9-8647f2aaa6c9 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:36.029955 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6999c401-f91a-4c18-8dfb-f7f4203967fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:36.030380 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72020fe-09eb-4479-844f-45f2c38b6500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:36.030558 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6999c401-f91a-4c18-8dfb-f7f4203967fc admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:36.030841 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6999c401-f91a-4c18-8dfb-f7f4203967fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:36.030996 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72020fe-09eb-4479-844f-45f2c38b6500 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:36.031113 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6999c401-f91a-4c18-8dfb-f7f4203967fc admin admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:36.031275 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72020fe-09eb-4479-844f-45f2c38b6500 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:36.031539 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72020fe-09eb-4479-844f-45f2c38b6500 admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:36.031731 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6999c401-f91a-4c18-8dfb-f7f4203967fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:36.032170 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72020fe-09eb-4479-844f-45f2c38b6500 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:36.033666 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6999c401-f91a-4c18-8dfb-f7f4203967fc admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:36.034697 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72020fe-09eb-4479-844f-45f2c38b6500 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:36.064396 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 776/1579] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:02:36 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:02:36.067801 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 804/1580] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:02:36 2022] POST /identity/v3/projects => generated 387 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:02:36.067965 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72020fe-09eb-4479-844f-45f2c38b6500 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:36.068069 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6999c401-f91a-4c18-8dfb-f7f4203967fc admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:36.131445 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72020fe-09eb-4479-844f-45f2c38b6500 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:36.131763 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6999c401-f91a-4c18-8dfb-f7f4203967fc admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:36.136425 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83818c0-cdfc-4f79-a2a2-538a7ed7b9fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:36.136592 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105e3345-8ef7-47de-96c0-36aae08dc04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:36.137118 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e3345-8ef7-47de-96c0-36aae08dc04e admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:36.137341 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83818c0-cdfc-4f79-a2a2-538a7ed7b9fb admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:36.137474 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e3345-8ef7-47de-96c0-36aae08dc04e admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:36.137699 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e3345-8ef7-47de-96c0-36aae08dc04e admin admin] PATH_INFO: `/v3/projects/ae09c11177204226a2aa5bb600ee575b/users/074cfcc7943349a490b29cd4ae3364cb/roles/719e5c62188d4f8a838987d6e72ca8f7` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:36.137907 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83818c0-cdfc-4f79-a2a2-538a7ed7b9fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:36.138853 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83818c0-cdfc-4f79-a2a2-538a7ed7b9fb admin admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:36.138979 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83818c0-cdfc-4f79-a2a2-538a7ed7b9fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:36.140977 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83818c0-cdfc-4f79-a2a2-538a7ed7b9fb admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:36.155322 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105e3345-8ef7-47de-96c0-36aae08dc04e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae09c11177204226a2aa5bb600ee575b, user_id=074cfcc7943349a490b29cd4ae3364cb, role_id=719e5c62188d4f8a838987d6e72ca8f7)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:36.156473 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: WARNING py.warnings [None req-105e3345-8ef7-47de-96c0-36aae08dc04e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:02:36.156473 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: warnings.warn(msg) Aug 18 11:02:36.156473 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: Aug 18 11:02:36.158605 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105e3345-8ef7-47de-96c0-36aae08dc04e admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:36.163537 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 777/1581] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:02:36 2022] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:02:36.164376 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83818c0-cdfc-4f79-a2a2-538a7ed7b9fb admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:36.174514 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83818c0-cdfc-4f79-a2a2-538a7ed7b9fb admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:36.176249 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 805/1582] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:02:36 2022] PUT /identity/v3/projects/ae09c11177204226a2aa5bb600ee575b/users/074cfcc7943349a490b29cd4ae3364cb/roles/719e5c62188d4f8a838987d6e72ca8f7 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:02:36.177068 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105e3345-8ef7-47de-96c0-36aae08dc04e admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:36.232415 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:02:36.243305 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e676463-3df9-4ec4-97c9-e668c6276ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:36.243914 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e676463-3df9-4ec4-97c9-e668c6276ec8 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:36.244342 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e676463-3df9-4ec4-97c9-e668c6276ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:36.244573 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105e3345-8ef7-47de-96c0-36aae08dc04e admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:36.244712 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e676463-3df9-4ec4-97c9-e668c6276ec8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:36.245256 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e676463-3df9-4ec4-97c9-e668c6276ec8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:36.246894 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e676463-3df9-4ec4-97c9-e668c6276ec8 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:36.249415 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332696ba-65bb-4534-bcf1-e139ab300001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:36.250065 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332696ba-65bb-4534-bcf1-e139ab300001 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:36.250338 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332696ba-65bb-4534-bcf1-e139ab300001 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:36.250603 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332696ba-65bb-4534-bcf1-e139ab300001 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:36.251246 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332696ba-65bb-4534-bcf1-e139ab300001 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:36.252912 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332696ba-65bb-4534-bcf1-e139ab300001 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:36.257368 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 778/1583] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:02:36 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:02:36.258213 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e676463-3df9-4ec4-97c9-e668c6276ec8 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:36.262190 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:02:36.270549 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 806/1584] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:02:36 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:02:36.271120 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e676463-3df9-4ec4-97c9-e668c6276ec8 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:36.271274 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332696ba-65bb-4534-bcf1-e139ab300001 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:36.274833 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258c12a5-b923-4a51-a77c-a06971b6c439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:36.275507 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c12a5-b923-4a51-a77c-a06971b6c439 admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:36.275794 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c12a5-b923-4a51-a77c-a06971b6c439 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:36.276073 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c12a5-b923-4a51-a77c-a06971b6c439 admin admin] PATH_INFO: `/v3/projects/532114507c3e4c8e8d14dd3cfdd65c6a/users/10b548df8cdf40d4879efbd34563385e/roles/719e5c62188d4f8a838987d6e72ca8f7` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:36.281702 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332696ba-65bb-4534-bcf1-e139ab300001 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:36.286314 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b873634-fb9c-4971-b77c-608287afd2ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:36.286964 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b873634-fb9c-4971-b77c-608287afd2ad admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:36.287334 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b873634-fb9c-4971-b77c-608287afd2ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:36.287703 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b873634-fb9c-4971-b77c-608287afd2ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:36.288603 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b873634-fb9c-4971-b77c-608287afd2ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:36.290297 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b873634-fb9c-4971-b77c-608287afd2ad admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:36.292860 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258c12a5-b923-4a51-a77c-a06971b6c439 admin admin] RBAC: Authorizing `identity:create_grant(project_id=532114507c3e4c8e8d14dd3cfdd65c6a, user_id=10b548df8cdf40d4879efbd34563385e, role_id=719e5c62188d4f8a838987d6e72ca8f7)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:36.299686 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258c12a5-b923-4a51-a77c-a06971b6c439 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:36.300833 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 807/1585] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:02:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:02:36.301672 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b873634-fb9c-4971-b77c-608287afd2ad admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:36.312916 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b873634-fb9c-4971-b77c-608287afd2ad admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:36.313282 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 779/1586] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:02:36 2022] PUT /identity/v3/projects/532114507c3e4c8e8d14dd3cfdd65c6a/users/10b548df8cdf40d4879efbd34563385e/roles/719e5c62188d4f8a838987d6e72ca8f7 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:02:36.314917 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258c12a5-b923-4a51-a77c-a06971b6c439 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:36.378823 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c942fd-0540-4962-a1c7-646315e44f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:36.379436 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c942fd-0540-4962-a1c7-646315e44f5d admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:36.379718 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c942fd-0540-4962-a1c7-646315e44f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:36.379993 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c942fd-0540-4962-a1c7-646315e44f5d admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:36.380619 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c942fd-0540-4962-a1c7-646315e44f5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:36.383242 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c942fd-0540-4962-a1c7-646315e44f5d admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:36.384288 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258c12a5-b923-4a51-a77c-a06971b6c439 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:36.388861 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b873762-9660-4b92-aed4-cdcfcb8ac2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:36.389468 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b873762-9660-4b92-aed4-cdcfcb8ac2c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:36.389779 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b873762-9660-4b92-aed4-cdcfcb8ac2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:36.390057 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b873762-9660-4b92-aed4-cdcfcb8ac2c0 admin admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:36.390676 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b873762-9660-4b92-aed4-cdcfcb8ac2c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:36.392586 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b873762-9660-4b92-aed4-cdcfcb8ac2c0 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:36.406262 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 808/1587] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:02:36 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:02:36.407242 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c942fd-0540-4962-a1c7-646315e44f5d admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:36.419504 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 780/1588] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:02:36 2022] POST /identity/v3/users => generated 294 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:02:36.419687 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c942fd-0540-4962-a1c7-646315e44f5d admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:36.419805 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd8453-26ea-4bd4-be1b-8371dfc493ab None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:36.419805 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd8453-26ea-4bd4-be1b-8371dfc493ab None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:36.419805 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd8453-26ea-4bd4-be1b-8371dfc493ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:36.422706 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fd8aaa-7ce5-4f87-9479-19bab17da555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:36.423411 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd8aaa-7ce5-4f87-9479-19bab17da555 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:36.423586 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd8aaa-7ce5-4f87-9479-19bab17da555 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:36.423859 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd8aaa-7ce5-4f87-9479-19bab17da555 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:36.424504 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fd8aaa-7ce5-4f87-9479-19bab17da555 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:36.426124 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fd8aaa-7ce5-4f87-9479-19bab17da555 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:36.438015 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 809/1589] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:02:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:02:36.438832 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-45cd8453-26ea-4bd4-be1b-8371dfc493ab None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:02:36.440059 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-45cd8453-26ea-4bd4-be1b-8371dfc493ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:36.441972 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fd8aaa-7ce5-4f87-9479-19bab17da555 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:36.448604 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 781/1590] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:02:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:02:36.449409 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cd8453-26ea-4bd4-be1b-8371dfc493ab None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:36.453478 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fd8aaa-7ce5-4f87-9479-19bab17da555 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:36.458426 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c2b670-aa1a-4f0f-9a59-8647ec2a2516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:36.458880 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cd8453-26ea-4bd4-be1b-8371dfc493ab None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:36.459138 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c2b670-aa1a-4f0f-9a59-8647ec2a2516 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:36.459605 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c2b670-aa1a-4f0f-9a59-8647ec2a2516 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:36.459806 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c2b670-aa1a-4f0f-9a59-8647ec2a2516 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:36.460455 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c2b670-aa1a-4f0f-9a59-8647ec2a2516 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:36.462420 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c2b670-aa1a-4f0f-9a59-8647ec2a2516 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:36.464766 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef100c3a-72ff-4ea9-b65c-4af364bd81bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:36.465411 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef100c3a-72ff-4ea9-b65c-4af364bd81bd admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:36.465704 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef100c3a-72ff-4ea9-b65c-4af364bd81bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:36.465976 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef100c3a-72ff-4ea9-b65c-4af364bd81bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:36.466620 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef100c3a-72ff-4ea9-b65c-4af364bd81bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:36.468198 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef100c3a-72ff-4ea9-b65c-4af364bd81bd admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:36.478089 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 810/1591] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:02:36 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:02:36.479950 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 782/1592] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:02:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:02:36.480110 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c2b670-aa1a-4f0f-9a59-8647ec2a2516 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:36.480220 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af523681-9e77-463b-bc85-1bdbb34598f2 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:36.480220 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af523681-9e77-463b-bc85-1bdbb34598f2 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:36.480220 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af523681-9e77-463b-bc85-1bdbb34598f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:36.491757 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c2b670-aa1a-4f0f-9a59-8647ec2a2516 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:36.496513 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b51717-66b6-4ac8-ac05-6c6a4009d156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:36.497116 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b51717-66b6-4ac8-ac05-6c6a4009d156 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:36.497396 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b51717-66b6-4ac8-ac05-6c6a4009d156 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:36.497724 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b51717-66b6-4ac8-ac05-6c6a4009d156 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:36.498378 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b51717-66b6-4ac8-ac05-6c6a4009d156 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:36.499221 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-af523681-9e77-463b-bc85-1bdbb34598f2 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:02:36.499976 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b51717-66b6-4ac8-ac05-6c6a4009d156 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:36.500531 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-af523681-9e77-463b-bc85-1bdbb34598f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:36.509084 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 783/1593] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:02:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:02:36.510057 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af523681-9e77-463b-bc85-1bdbb34598f2 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:36.511242 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 811/1594] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:02:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:02:36.511916 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b51717-66b6-4ac8-ac05-6c6a4009d156 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:36.521977 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b51717-66b6-4ac8-ac05-6c6a4009d156 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:36.522629 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af523681-9e77-463b-bc85-1bdbb34598f2 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:36.526717 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26abc96-f477-48f5-88a3-bee2f855bc31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:36.527429 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99abb33d-ee28-4f7f-b7e6-1a4e91a5d4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:36.527585 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26abc96-f477-48f5-88a3-bee2f855bc31 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:36.527725 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26abc96-f477-48f5-88a3-bee2f855bc31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:36.528006 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26abc96-f477-48f5-88a3-bee2f855bc31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:36.528107 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99abb33d-ee28-4f7f-b7e6-1a4e91a5d4c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:36.528294 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99abb33d-ee28-4f7f-b7e6-1a4e91a5d4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:36.528565 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99abb33d-ee28-4f7f-b7e6-1a4e91a5d4c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:36.528665 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26abc96-f477-48f5-88a3-bee2f855bc31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:36.529220 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99abb33d-ee28-4f7f-b7e6-1a4e91a5d4c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:36.530250 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26abc96-f477-48f5-88a3-bee2f855bc31 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:36.530852 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99abb33d-ee28-4f7f-b7e6-1a4e91a5d4c8 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:36.544257 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 784/1595] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:02:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:02:36.544451 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 812/1596] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:02:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:02:36.544537 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99abb33d-ee28-4f7f-b7e6-1a4e91a5d4c8 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:36.544637 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26abc96-f477-48f5-88a3-bee2f855bc31 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:36.546185 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-c26abc96-f477-48f5-88a3-bee2f855bc31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:36.555739 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99abb33d-ee28-4f7f-b7e6-1a4e91a5d4c8 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:36.560532 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d2ead-94df-44ee-a39c-3f041c70f415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:36.561206 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d2ead-94df-44ee-a39c-3f041c70f415 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:36.561499 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d2ead-94df-44ee-a39c-3f041c70f415 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:36.561843 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d2ead-94df-44ee-a39c-3f041c70f415 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:36.562486 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7d2ead-94df-44ee-a39c-3f041c70f415 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:36.564077 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7d2ead-94df-44ee-a39c-3f041c70f415 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:36.575991 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 785/1597] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:02:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:02:36.576789 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d2ead-94df-44ee-a39c-3f041c70f415 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:36.587169 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d2ead-94df-44ee-a39c-3f041c70f415 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:36.592539 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c11231-0bce-443a-b9a9-e9e8c1c87db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:36.593296 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c11231-0bce-443a-b9a9-e9e8c1c87db8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:36.593714 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c11231-0bce-443a-b9a9-e9e8c1c87db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:36.594080 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c11231-0bce-443a-b9a9-e9e8c1c87db8 admin admin] PATH_INFO: `/v3/projects/cf44e44598b542fbb69fe8e8583eaaff/users/2624d3c4da494fd1b7a8b509e90dc4fe/roles/719e5c62188d4f8a838987d6e72ca8f7` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:36.604783 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26abc96-f477-48f5-88a3-bee2f855bc31 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:36.608481 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaef655-5ad5-412a-a68b-261d1c49aabe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:36.609083 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaef655-5ad5-412a-a68b-261d1c49aabe service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:36.609361 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaef655-5ad5-412a-a68b-261d1c49aabe service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:36.609673 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaef655-5ad5-412a-a68b-261d1c49aabe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:36.610089 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c11231-0bce-443a-b9a9-e9e8c1c87db8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf44e44598b542fbb69fe8e8583eaaff, user_id=2624d3c4da494fd1b7a8b509e90dc4fe, role_id=719e5c62188d4f8a838987d6e72ca8f7)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:36.612867 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c11231-0bce-443a-b9a9-e9e8c1c87db8 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:36.620174 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaef655-5ad5-412a-a68b-261d1c49aabe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:36.621822 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaef655-5ad5-412a-a68b-261d1c49aabe service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:36.627226 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 786/1598] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:02:36 2022] PUT /identity/v3/projects/cf44e44598b542fbb69fe8e8583eaaff/users/2624d3c4da494fd1b7a8b509e90dc4fe/roles/719e5c62188d4f8a838987d6e72ca8f7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:02:36.630559 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c11231-0bce-443a-b9a9-e9e8c1c87db8 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:36.632019 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 813/1599] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:02:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:02:36.634424 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaef655-5ad5-412a-a68b-261d1c49aabe service neutron] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:36.645021 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaef655-5ad5-412a-a68b-261d1c49aabe service neutron] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:36.681918 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:02:36.684530 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:02:36.704965 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c11231-0bce-443a-b9a9-e9e8c1c87db8 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:36.710314 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af75f68-e221-44bb-9898-9113479a51ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:36.710986 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af75f68-e221-44bb-9898-9113479a51ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:36.711275 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af75f68-e221-44bb-9898-9113479a51ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:36.711552 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af75f68-e221-44bb-9898-9113479a51ff admin admin] PATH_INFO: `/v3/projects/0ae68b3bd077494880aa040e162fbbab/users/64c7099e57c44727b5c23b5fd492f97e/roles/719e5c62188d4f8a838987d6e72ca8f7` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:36.712739 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac9daa6-7918-412c-b2fa-a9ac78dac87c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:36.713404 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac9daa6-7918-412c-b2fa-a9ac78dac87c admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:36.713718 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac9daa6-7918-412c-b2fa-a9ac78dac87c admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:36.714001 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac9daa6-7918-412c-b2fa-a9ac78dac87c admin admin] PATH_INFO: `/v3/projects/523cb8f17fc9468d86944717135714f4/users/4153b369951f48e1afc6aff02a75f9c2/roles/719e5c62188d4f8a838987d6e72ca8f7` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:36.729918 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af75f68-e221-44bb-9898-9113479a51ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ae68b3bd077494880aa040e162fbbab, user_id=64c7099e57c44727b5c23b5fd492f97e, role_id=719e5c62188d4f8a838987d6e72ca8f7)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:36.732928 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af75f68-e221-44bb-9898-9113479a51ff admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:36.734010 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac9daa6-7918-412c-b2fa-a9ac78dac87c admin admin] RBAC: Authorizing `identity:create_grant(project_id=523cb8f17fc9468d86944717135714f4, user_id=4153b369951f48e1afc6aff02a75f9c2, role_id=719e5c62188d4f8a838987d6e72ca8f7)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:36.736936 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac9daa6-7918-412c-b2fa-a9ac78dac87c admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:36.764081 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 814/1601] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:02:36 2022] PUT /identity/v3/projects/523cb8f17fc9468d86944717135714f4/users/4153b369951f48e1afc6aff02a75f9c2/roles/719e5c62188d4f8a838987d6e72ca8f7 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:02:36.764081 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac9daa6-7918-412c-b2fa-a9ac78dac87c admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:36.764415 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 787/1601] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:02:36 2022] PUT /identity/v3/projects/0ae68b3bd077494880aa040e162fbbab/users/64c7099e57c44727b5c23b5fd492f97e/roles/719e5c62188d4f8a838987d6e72ca8f7 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:02:36.764415 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af75f68-e221-44bb-9898-9113479a51ff admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:36.842105 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac9daa6-7918-412c-b2fa-a9ac78dac87c admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:36.846657 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af75f68-e221-44bb-9898-9113479a51ff admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:36.848012 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2785df2-5820-4f6b-aaaa-9a7edc359b95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:36.848657 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2785df2-5820-4f6b-aaaa-9a7edc359b95 service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:36.848926 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2785df2-5820-4f6b-aaaa-9a7edc359b95 service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:36.849193 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2785df2-5820-4f6b-aaaa-9a7edc359b95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:36.917811 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a2f1ed-18bd-4678-9a9c-30398878ab0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:36.918423 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a2f1ed-18bd-4678-9a9c-30398878ab0f admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:36.918816 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a2f1ed-18bd-4678-9a9c-30398878ab0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:36.919089 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a2f1ed-18bd-4678-9a9c-30398878ab0f admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:36.920299 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a2f1ed-18bd-4678-9a9c-30398878ab0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:36.921656 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a2f1ed-18bd-4678-9a9c-30398878ab0f admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:36.922800 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2785df2-5820-4f6b-aaaa-9a7edc359b95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:36.924822 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2785df2-5820-4f6b-aaaa-9a7edc359b95 service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:36.934796 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 788/1602] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:02:36 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:02:36.935939 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a2f1ed-18bd-4678-9a9c-30398878ab0f admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:36.941014 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 815/1603] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:02:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:02:36.941854 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2785df2-5820-4f6b-aaaa-9a7edc359b95 service neutron] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:36.950135 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a2f1ed-18bd-4678-9a9c-30398878ab0f admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:36.952991 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2785df2-5820-4f6b-aaaa-9a7edc359b95 service neutron] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:36.954964 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfe0152-7291-4f92-843d-e6e25341f993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:36.955627 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfe0152-7291-4f92-843d-e6e25341f993 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:36.955895 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfe0152-7291-4f92-843d-e6e25341f993 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:36.956165 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfe0152-7291-4f92-843d-e6e25341f993 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:36.956807 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfe0152-7291-4f92-843d-e6e25341f993 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:36.958448 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfe0152-7291-4f92-843d-e6e25341f993 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:36.962410 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743b6235-92ff-4dc0-877c-df20f7e7d5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:36.963351 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b6235-92ff-4dc0-877c-df20f7e7d5f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:36.963829 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b6235-92ff-4dc0-877c-df20f7e7d5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:36.964311 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b6235-92ff-4dc0-877c-df20f7e7d5f8 admin admin] PATH_INFO: `/v3/projects/577132f31a0d4c609b927067d45f3105/users/8980e83b77e749339c551bbe54fc40bf/roles/719e5c62188d4f8a838987d6e72ca8f7` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:36.970175 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 789/1604] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:02:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:02:36.971515 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c3c10b-5852-4e98-afa6-cb083548f307 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:36.971801 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c3c10b-5852-4e98-afa6-cb083548f307 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:36.972071 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c3c10b-5852-4e98-afa6-cb083548f307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:36.985198 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743b6235-92ff-4dc0-877c-df20f7e7d5f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=577132f31a0d4c609b927067d45f3105, user_id=8980e83b77e749339c551bbe54fc40bf, role_id=719e5c62188d4f8a838987d6e72ca8f7)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:36.987925 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743b6235-92ff-4dc0-877c-df20f7e7d5f8 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:37.003639 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 816/1605] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:02:36 2022] PUT /identity/v3/projects/577132f31a0d4c609b927067d45f3105/users/8980e83b77e749339c551bbe54fc40bf/roles/719e5c62188d4f8a838987d6e72ca8f7 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:02:37.004900 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6aadbb-8f86-4520-abab-8bd8f53b970c None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:37.005181 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6aadbb-8f86-4520-abab-8bd8f53b970c None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:37.005452 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6aadbb-8f86-4520-abab-8bd8f53b970c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:37.008092 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-69c3c10b-5852-4e98-afa6-cb083548f307 None None] MFA Rules not processed for user `2624d3c4da494fd1b7a8b509e90dc4fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:02:37.009995 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-69c3c10b-5852-4e98-afa6-cb083548f307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:37.078626 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-5b6aadbb-8f86-4520-abab-8bd8f53b970c None None] MFA Rules not processed for user `64c7099e57c44727b5c23b5fd492f97e`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:02:37.079831 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-5b6aadbb-8f86-4520-abab-8bd8f53b970c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:37.093953 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:02:37.143195 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 790/1606] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:02:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:02:37.144317 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26668f3c-65c6-4b75-933b-b68dccd278c2 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:37.144703 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26668f3c-65c6-4b75-933b-b68dccd278c2 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:37.145088 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26668f3c-65c6-4b75-933b-b68dccd278c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:37.162233 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:02:37.190502 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-26668f3c-65c6-4b75-933b-b68dccd278c2 None None] MFA Rules not processed for user `4153b369951f48e1afc6aff02a75f9c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:02:37.192088 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-26668f3c-65c6-4b75-933b-b68dccd278c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:37.247570 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 817/1607] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:02:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:02:37.248668 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6aadbb-8f86-4520-abab-8bd8f53b970c None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:37.304437 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 791/1608] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:02:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:02:37.305425 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26668f3c-65c6-4b75-933b-b68dccd278c2 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:37.392719 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6aadbb-8f86-4520-abab-8bd8f53b970c None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:37.412637 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48487039-70da-4288-9c2f-45575426f398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:37.414224 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48487039-70da-4288-9c2f-45575426f398 admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:37.414224 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48487039-70da-4288-9c2f-45575426f398 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:37.414919 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48487039-70da-4288-9c2f-45575426f398 admin admin] PATH_INFO: `/v3/projects/397eac573c2d473e881b07c87255700c/users/57e117589fc14e4d9d8d8494bddf9c12/roles/719e5c62188d4f8a838987d6e72ca8f7` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:37.416594 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26668f3c-65c6-4b75-933b-b68dccd278c2 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:37.430479 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb3ffee-4bb8-459f-bd42-32ba3d4b3e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:37.431396 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb3ffee-4bb8-459f-bd42-32ba3d4b3e92 admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:37.431811 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb3ffee-4bb8-459f-bd42-32ba3d4b3e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:37.432322 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb3ffee-4bb8-459f-bd42-32ba3d4b3e92 admin admin] PATH_INFO: `/v3/projects/3c723b1181c94699b389f0fc03e19af6/users/7dc5501d59fb4593b405f0e9bd2e49ef/roles/719e5c62188d4f8a838987d6e72ca8f7` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:37.455535 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48487039-70da-4288-9c2f-45575426f398 admin admin] RBAC: Authorizing `identity:create_grant(project_id=397eac573c2d473e881b07c87255700c, user_id=57e117589fc14e4d9d8d8494bddf9c12, role_id=719e5c62188d4f8a838987d6e72ca8f7)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:37.462774 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48487039-70da-4288-9c2f-45575426f398 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:37.472233 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb3ffee-4bb8-459f-bd42-32ba3d4b3e92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c723b1181c94699b389f0fc03e19af6, user_id=7dc5501d59fb4593b405f0e9bd2e49ef, role_id=719e5c62188d4f8a838987d6e72ca8f7)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:37.477877 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb3ffee-4bb8-459f-bd42-32ba3d4b3e92 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:37.498061 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 818/1609] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:02:37 2022] PUT /identity/v3/projects/397eac573c2d473e881b07c87255700c/users/57e117589fc14e4d9d8d8494bddf9c12/roles/719e5c62188d4f8a838987d6e72ca8f7 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:02:37.502515 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e3de79-36de-4dc4-8597-4aeb5e530719 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:37.503066 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e3de79-36de-4dc4-8597-4aeb5e530719 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:37.503543 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e3de79-36de-4dc4-8597-4aeb5e530719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:37.508622 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 792/1610] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:02:37 2022] PUT /identity/v3/projects/3c723b1181c94699b389f0fc03e19af6/users/7dc5501d59fb4593b405f0e9bd2e49ef/roles/719e5c62188d4f8a838987d6e72ca8f7 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:02:37.508622 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb3ffee-4bb8-459f-bd42-32ba3d4b3e92 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:37.558423 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-b9e3de79-36de-4dc4-8597-4aeb5e530719 None None] MFA Rules not processed for user `8980e83b77e749339c551bbe54fc40bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:02:37.560142 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-b9e3de79-36de-4dc4-8597-4aeb5e530719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:37.627329 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb3ffee-4bb8-459f-bd42-32ba3d4b3e92 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:37.636139 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6657d5-917d-4c0b-901a-04bbc0b059b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:37.636800 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6657d5-917d-4c0b-901a-04bbc0b059b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:37.637081 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6657d5-917d-4c0b-901a-04bbc0b059b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:37.637354 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6657d5-917d-4c0b-901a-04bbc0b059b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:37.638022 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6657d5-917d-4c0b-901a-04bbc0b059b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:37.640867 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6657d5-917d-4c0b-901a-04bbc0b059b3 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:37.647741 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:02:37.691624 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 793/1611] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:02:37 2022] POST /identity/v3/projects => generated 371 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:02:37.691624 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6657d5-917d-4c0b-901a-04bbc0b059b3 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:37.696214 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 819/1612] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:02:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:02:37.697550 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe94341-b801-4e3d-b72a-4c3ade5d8d6f None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:37.698589 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe94341-b801-4e3d-b72a-4c3ade5d8d6f None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:37.698876 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe94341-b801-4e3d-b72a-4c3ade5d8d6f None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:37.702475 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 820/1613] 10.222.0.15 () {54 vars in 962 bytes} [Thu Aug 18 11:02:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:02:37.703669 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e534a4-1fa7-440c-8d7a-ee24daa400f2 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:37.705192 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e534a4-1fa7-440c-8d7a-ee24daa400f2 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:37.705508 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e534a4-1fa7-440c-8d7a-ee24daa400f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:37.750854 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-30e534a4-1fa7-440c-8d7a-ee24daa400f2 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:02:37.752869 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-30e534a4-1fa7-440c-8d7a-ee24daa400f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:37.804299 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6657d5-917d-4c0b-901a-04bbc0b059b3 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:37.813831 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7e49ec-44b4-4596-88e1-4fc52ef9f783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:37.814472 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e49ec-44b4-4596-88e1-4fc52ef9f783 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:37.814891 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e49ec-44b4-4596-88e1-4fc52ef9f783 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:37.815168 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e49ec-44b4-4596-88e1-4fc52ef9f783 admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:37.816346 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7e49ec-44b4-4596-88e1-4fc52ef9f783 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:37.819351 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7e49ec-44b4-4596-88e1-4fc52ef9f783 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:37.824669 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:02:37.844261 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 821/1614] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:02:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:02:37.845816 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a20eb-5511-43ff-83f3-601b0c0664be None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:37.846147 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a20eb-5511-43ff-83f3-601b0c0664be None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:37.846418 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a20eb-5511-43ff-83f3-601b0c0664be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:37.870201 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-b34a20eb-5511-43ff-83f3-601b0c0664be None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:02:37.871685 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-b34a20eb-5511-43ff-83f3-601b0c0664be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:37.872842 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 794/1615] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:02:37 2022] POST /identity/v3/projects => generated 365 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:02:37.875410 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7e49ec-44b4-4596-88e1-4fc52ef9f783 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:37.949235 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 822/1616] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:02:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:02:37.954342 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c084a-754a-4f7c-bd1f-9ce8c4e60726 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:37.954612 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c084a-754a-4f7c-bd1f-9ce8c4e60726 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:37.954975 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c084a-754a-4f7c-bd1f-9ce8c4e60726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:38.012011 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-636c084a-754a-4f7c-bd1f-9ce8c4e60726 None None] MFA Rules not processed for user `a005d8f0c46d44c7b6f2201a54717b12`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:02:38.012011 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-636c084a-754a-4f7c-bd1f-9ce8c4e60726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:38.023386 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7e49ec-44b4-4596-88e1-4fc52ef9f783 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:38.028540 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9b5e5a-385d-4a08-9a5a-5d62a5dbb51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:38.029348 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b5e5a-385d-4a08-9a5a-5d62a5dbb51a admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:38.029747 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b5e5a-385d-4a08-9a5a-5d62a5dbb51a admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:38.030114 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b5e5a-385d-4a08-9a5a-5d62a5dbb51a admin admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:38.030846 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9b5e5a-385d-4a08-9a5a-5d62a5dbb51a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:38.033046 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9b5e5a-385d-4a08-9a5a-5d62a5dbb51a admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:38.063371 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 795/1617] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:02:37 2022] POST /identity/v3/users => generated 292 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:02:38.063371 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea72781c-c571-499c-9776-3e00d8dcb036 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:38.063371 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea72781c-c571-499c-9776-3e00d8dcb036 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:38.063748 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea72781c-c571-499c-9776-3e00d8dcb036 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:38.065673 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 796/1618] 10.222.0.15 () {54 vars in 962 bytes} [Thu Aug 18 11:02:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:02:38.066720 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea72781c-c571-499c-9776-3e00d8dcb036 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:38.093638 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 823/1619] 10.222.0.15 () {58 vars in 1059 bytes} [Thu Aug 18 11:02:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:02:38.094670 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636c084a-754a-4f7c-bd1f-9ce8c4e60726 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:38.107675 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636c084a-754a-4f7c-bd1f-9ce8c4e60726 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:38.116294 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab4e4cd-25e0-496a-b39a-390e9963a7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:38.116903 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab4e4cd-25e0-496a-b39a-390e9963a7b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:38.117102 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab4e4cd-25e0-496a-b39a-390e9963a7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:38.117380 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab4e4cd-25e0-496a-b39a-390e9963a7b1 admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:38.118271 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab4e4cd-25e0-496a-b39a-390e9963a7b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:38.121457 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab4e4cd-25e0-496a-b39a-390e9963a7b1 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:38.140004 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea72781c-c571-499c-9776-3e00d8dcb036 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:38.144546 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55812615-651c-4a7d-b412-f80dcf395aac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:38.144933 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55812615-651c-4a7d-b412-f80dcf395aac service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:38.145287 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55812615-651c-4a7d-b412-f80dcf395aac service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:38.145664 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55812615-651c-4a7d-b412-f80dcf395aac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:38.157464 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55812615-651c-4a7d-b412-f80dcf395aac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:38.158954 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55812615-651c-4a7d-b412-f80dcf395aac service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:38.172245 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 824/1620] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:02:38 2022] POST /identity/v3/users => generated 289 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:02:38.172504 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 797/1621] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:02:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:02:38.176463 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55812615-651c-4a7d-b412-f80dcf395aac service neutron] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:38.176598 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab4e4cd-25e0-496a-b39a-390e9963a7b1 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:38.184353 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:02:38.188163 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab4e4cd-25e0-496a-b39a-390e9963a7b1 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:38.191456 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55812615-651c-4a7d-b412-f80dcf395aac service neutron] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:38.193985 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae883653-067a-4e17-90f8-f3b2c737781c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:38.194736 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae883653-067a-4e17-90f8-f3b2c737781c service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:38.195064 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae883653-067a-4e17-90f8-f3b2c737781c service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:38.195390 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae883653-067a-4e17-90f8-f3b2c737781c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:38.200457 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ef3e32-df42-4e21-9bea-06977c0e337f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:38.202283 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ef3e32-df42-4e21-9bea-06977c0e337f admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:38.203849 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ef3e32-df42-4e21-9bea-06977c0e337f admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:38.204675 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ef3e32-df42-4e21-9bea-06977c0e337f admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:38.205969 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ef3e32-df42-4e21-9bea-06977c0e337f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:38.208679 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ef3e32-df42-4e21-9bea-06977c0e337f admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:38.221917 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae883653-067a-4e17-90f8-f3b2c737781c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:38.223477 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae883653-067a-4e17-90f8-f3b2c737781c service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:38.235700 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 798/1622] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:02:38 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:02:38.237176 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11783d19-f5d6-451e-a155-6b90b00dfe02 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:38.237454 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 825/1623] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:02:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:02:38.238350 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11783d19-f5d6-451e-a155-6b90b00dfe02 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:38.238483 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae883653-067a-4e17-90f8-f3b2c737781c service neutron] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:38.238636 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11783d19-f5d6-451e-a155-6b90b00dfe02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:38.253362 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae883653-067a-4e17-90f8-f3b2c737781c service neutron] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:38.263347 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aadfbd-e686-4ae4-92a2-f6038e282e48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a005d8f0c46d44c7b6f2201a54717b12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:38.264376 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aadfbd-e686-4ae4-92a2-f6038e282e48 service nova] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:38.264663 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aadfbd-e686-4ae4-92a2-f6038e282e48 service nova] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:38.264937 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aadfbd-e686-4ae4-92a2-f6038e282e48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:38.283970 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-11783d19-f5d6-451e-a155-6b90b00dfe02 None None] MFA Rules not processed for user `a005d8f0c46d44c7b6f2201a54717b12`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:02:38.288488 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-11783d19-f5d6-451e-a155-6b90b00dfe02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:38.310523 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 799/1624] 10.222.0.15 () {58 vars in 1059 bytes} [Thu Aug 18 11:02:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:02:38.311249 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11783d19-f5d6-451e-a155-6b90b00dfe02 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:38.323167 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:02:38.343580 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11783d19-f5d6-451e-a155-6b90b00dfe02 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:38.355660 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e53e39e-b778-46c1-92bd-cbcae674ff6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:38.356299 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e53e39e-b778-46c1-92bd-cbcae674ff6c admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:38.358271 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e53e39e-b778-46c1-92bd-cbcae674ff6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:38.358568 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e53e39e-b778-46c1-92bd-cbcae674ff6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:38.359397 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aadfbd-e686-4ae4-92a2-f6038e282e48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:38.361279 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aadfbd-e686-4ae4-92a2-f6038e282e48 service nova] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:38.362076 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e53e39e-b778-46c1-92bd-cbcae674ff6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:38.363769 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e53e39e-b778-46c1-92bd-cbcae674ff6c admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:38.373884 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 826/1625] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:02:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:02:38.375227 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aadfbd-e686-4ae4-92a2-f6038e282e48 service nova] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:38.387713 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aadfbd-e686-4ae4-92a2-f6038e282e48 service nova] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:38.389066 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 800/1626] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:02:38 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:02:38.392428 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e53e39e-b778-46c1-92bd-cbcae674ff6c admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:38.397732 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d566e655-6cd9-4f6c-8825-12013547ba60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:38.398430 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d566e655-6cd9-4f6c-8825-12013547ba60 admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:38.398709 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d566e655-6cd9-4f6c-8825-12013547ba60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:38.398985 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d566e655-6cd9-4f6c-8825-12013547ba60 admin admin] PATH_INFO: `/v3/projects/d300134524a847cf8741d77093ec9d02/users/fe236efff9d94c119e7d46adbfd5fe98/roles/127fdc7ef05b4e0b98a940b334e5fcab` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:38.416166 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e53e39e-b778-46c1-92bd-cbcae674ff6c admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:38.431908 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d566e655-6cd9-4f6c-8825-12013547ba60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d300134524a847cf8741d77093ec9d02, user_id=fe236efff9d94c119e7d46adbfd5fe98, role_id=127fdc7ef05b4e0b98a940b334e5fcab)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:38.434969 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d566e655-6cd9-4f6c-8825-12013547ba60 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:38.440863 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59c5697-e9b6-4e64-9d2d-6294e321c5ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a005d8f0c46d44c7b6f2201a54717b12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:38.441647 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c5697-e9b6-4e64-9d2d-6294e321c5ac service nova] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:38.441926 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c5697-e9b6-4e64-9d2d-6294e321c5ac service nova] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:38.442194 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c5697-e9b6-4e64-9d2d-6294e321c5ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:38.469439 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 827/1627] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:02:38 2022] PUT /identity/v3/projects/d300134524a847cf8741d77093ec9d02/users/fe236efff9d94c119e7d46adbfd5fe98/roles/127fdc7ef05b4e0b98a940b334e5fcab => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:02:38.470426 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d566e655-6cd9-4f6c-8825-12013547ba60 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:38.539016 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59c5697-e9b6-4e64-9d2d-6294e321c5ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:38.540896 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59c5697-e9b6-4e64-9d2d-6294e321c5ac service nova] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:38.566972 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 801/1628] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:02:38 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:02:38.568168 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59c5697-e9b6-4e64-9d2d-6294e321c5ac service nova] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:38.596865 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59c5697-e9b6-4e64-9d2d-6294e321c5ac service nova] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:38.643388 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d566e655-6cd9-4f6c-8825-12013547ba60 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:38.666679 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c4f918-1227-4c44-ab1b-cd954148fac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:38.667362 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c4f918-1227-4c44-ab1b-cd954148fac6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:38.667640 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c4f918-1227-4c44-ab1b-cd954148fac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:38.667913 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c4f918-1227-4c44-ab1b-cd954148fac6 admin admin] PATH_INFO: `/v3/projects/1680ce3af8fc4d7895d33982c44a9b0f/users/d6faa81040584266880e42448393ed7e/roles/127fdc7ef05b4e0b98a940b334e5fcab` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:38.723235 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c4f918-1227-4c44-ab1b-cd954148fac6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1680ce3af8fc4d7895d33982c44a9b0f, user_id=d6faa81040584266880e42448393ed7e, role_id=127fdc7ef05b4e0b98a940b334e5fcab)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:38.726756 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c4f918-1227-4c44-ab1b-cd954148fac6 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:38.766278 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a187b1f6-0cf0-47d8-b299-6d0baab787ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:38.766914 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a187b1f6-0cf0-47d8-b299-6d0baab787ae admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:38.767195 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a187b1f6-0cf0-47d8-b299-6d0baab787ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:38.767471 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a187b1f6-0cf0-47d8-b299-6d0baab787ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:38.768279 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a187b1f6-0cf0-47d8-b299-6d0baab787ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:38.768394 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 828/1629] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:02:38 2022] PUT /identity/v3/projects/1680ce3af8fc4d7895d33982c44a9b0f/users/d6faa81040584266880e42448393ed7e/roles/127fdc7ef05b4e0b98a940b334e5fcab => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:02:38.769709 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca112348-1c1f-4438-9bf4-27a7646aa341 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:38.769844 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a187b1f6-0cf0-47d8-b299-6d0baab787ae admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:38.770014 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca112348-1c1f-4438-9bf4-27a7646aa341 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:38.770265 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca112348-1c1f-4438-9bf4-27a7646aa341 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:38.776744 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 829/1630] 10.222.0.15 () {54 vars in 912 bytes} [Thu Aug 18 11:02:38 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:02:38.778105 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca112348-1c1f-4438-9bf4-27a7646aa341 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:38.798430 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 802/1631] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:02:38 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:02:38.805729 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8bba0b-89c3-4964-aee7-77c2dc1538ca None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:38.806041 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8bba0b-89c3-4964-aee7-77c2dc1538ca None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:38.806429 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8bba0b-89c3-4964-aee7-77c2dc1538ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:38.873133 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-af8bba0b-89c3-4964-aee7-77c2dc1538ca None None] MFA Rules not processed for user `a005d8f0c46d44c7b6f2201a54717b12`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:02:38.874385 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-af8bba0b-89c3-4964-aee7-77c2dc1538ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:38.950769 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca112348-1c1f-4438-9bf4-27a7646aa341 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:38.958545 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6245f6-78c5-4ca1-85a4-2f9d015008d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:38.959251 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6245f6-78c5-4ca1-85a4-2f9d015008d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:38.959526 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6245f6-78c5-4ca1-85a4-2f9d015008d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:38.959792 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6245f6-78c5-4ca1-85a4-2f9d015008d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:38.960446 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6245f6-78c5-4ca1-85a4-2f9d015008d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:38.963222 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6245f6-78c5-4ca1-85a4-2f9d015008d9 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:38.985010 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 830/1632] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:02:38 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:02:38.985971 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6245f6-78c5-4ca1-85a4-2f9d015008d9 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:38.999161 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6245f6-78c5-4ca1-85a4-2f9d015008d9 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:39.008023 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4332c44-20f2-4a41-8716-2560f8c60439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:39.008773 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4332c44-20f2-4a41-8716-2560f8c60439 admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:39.009052 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4332c44-20f2-4a41-8716-2560f8c60439 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:39.009370 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4332c44-20f2-4a41-8716-2560f8c60439 admin admin] PATH_INFO: `/v3/projects/d300134524a847cf8741d77093ec9d02/users/fe236efff9d94c119e7d46adbfd5fe98/roles/127fdc7ef05b4e0b98a940b334e5fcab` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:39.012682 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4332c44-20f2-4a41-8716-2560f8c60439 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d300134524a847cf8741d77093ec9d02, user_id=fe236efff9d94c119e7d46adbfd5fe98, role_id=127fdc7ef05b4e0b98a940b334e5fcab)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:39.015992 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4332c44-20f2-4a41-8716-2560f8c60439 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:39.029429 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 803/1633] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Aug 18 11:02:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:02:39.033411 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a72dd9-0191-424b-9720-a071be2884fb None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:39.033772 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a72dd9-0191-424b-9720-a071be2884fb None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:39.036492 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 831/1634] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:02:38 2022] PUT /identity/v3/projects/d300134524a847cf8741d77093ec9d02/users/fe236efff9d94c119e7d46adbfd5fe98/roles/127fdc7ef05b4e0b98a940b334e5fcab => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:02:39.038371 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4332c44-20f2-4a41-8716-2560f8c60439 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:39.056492 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a72dd9-0191-424b-9720-a071be2884fb None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:39.060117 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 804/1635] 10.222.0.15 () {54 vars in 912 bytes} [Thu Aug 18 11:02:39 2022] GET /identity => generated 270 bytes in 29 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:02:39.061747 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1265bd-280f-46a0-aa65-996138b27fe8 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:39.062059 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1265bd-280f-46a0-aa65-996138b27fe8 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:39.062342 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1265bd-280f-46a0-aa65-996138b27fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:39.071376 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:02:39.085266 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:02:39.107033 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-ef1265bd-280f-46a0-aa65-996138b27fe8 None None] MFA Rules not processed for user `fe236efff9d94c119e7d46adbfd5fe98`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:02:39.108753 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-ef1265bd-280f-46a0-aa65-996138b27fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:39.152933 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4332c44-20f2-4a41-8716-2560f8c60439 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:39.160152 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70653022-bcb8-47d1-bb36-10a88bd43a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:39.161153 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70653022-bcb8-47d1-bb36-10a88bd43a7b admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:39.161610 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70653022-bcb8-47d1-bb36-10a88bd43a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:39.162563 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70653022-bcb8-47d1-bb36-10a88bd43a7b admin admin] PATH_INFO: `/v3/projects/1680ce3af8fc4d7895d33982c44a9b0f/users/d6faa81040584266880e42448393ed7e/roles/127fdc7ef05b4e0b98a940b334e5fcab` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:39.166484 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70653022-bcb8-47d1-bb36-10a88bd43a7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1680ce3af8fc4d7895d33982c44a9b0f, user_id=d6faa81040584266880e42448393ed7e, role_id=127fdc7ef05b4e0b98a940b334e5fcab)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:39.171899 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70653022-bcb8-47d1-bb36-10a88bd43a7b admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:39.218431 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 805/1636] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:02:39 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:02:39.222049 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1265bd-280f-46a0-aa65-996138b27fe8 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:39.230706 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 832/1637] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:02:39 2022] PUT /identity/v3/projects/1680ce3af8fc4d7895d33982c44a9b0f/users/d6faa81040584266880e42448393ed7e/roles/127fdc7ef05b4e0b98a940b334e5fcab => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:02:39.232597 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57593e-5988-48b8-905a-1ee3e3b051c4 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:39.237692 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57593e-5988-48b8-905a-1ee3e3b051c4 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:39.238389 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57593e-5988-48b8-905a-1ee3e3b051c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:39.270404 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-4e57593e-5988-48b8-905a-1ee3e3b051c4 None None] MFA Rules not processed for user `a005d8f0c46d44c7b6f2201a54717b12`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:02:39.274073 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-4e57593e-5988-48b8-905a-1ee3e3b051c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:39.322292 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1265bd-280f-46a0-aa65-996138b27fe8 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:39.471540 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 833/1638] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Aug 18 11:02:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:02:39.475425 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e57593e-5988-48b8-905a-1ee3e3b051c4 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:39.479206 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c191bb32-e25f-45fc-8256-d4fb259b2145 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b8a09704b9b4ab2bffb813796ec6e77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:39.479843 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c191bb32-e25f-45fc-8256-d4fb259b2145 service cinder] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:39.481254 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c191bb32-e25f-45fc-8256-d4fb259b2145 service cinder] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:39.481254 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c191bb32-e25f-45fc-8256-d4fb259b2145 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:39.496843 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e57593e-5988-48b8-905a-1ee3e3b051c4 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:39.505078 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd03343-6cfe-4dc3-9b64-74afa4ad1248 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b8a09704b9b4ab2bffb813796ec6e77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:39.506129 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd03343-6cfe-4dc3-9b64-74afa4ad1248 service cinder] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:39.506610 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd03343-6cfe-4dc3-9b64-74afa4ad1248 service cinder] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:39.507035 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c191bb32-e25f-45fc-8256-d4fb259b2145 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:39.507184 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd03343-6cfe-4dc3-9b64-74afa4ad1248 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:39.508715 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c191bb32-e25f-45fc-8256-d4fb259b2145 service cinder] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:39.524574 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 806/1639] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:02:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:02:39.525834 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513077d5-11d8-4cc4-9e3b-a5327bb5497b None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:39.526373 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513077d5-11d8-4cc4-9e3b-a5327bb5497b None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:39.526718 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513077d5-11d8-4cc4-9e3b-a5327bb5497b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:39.652497 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-513077d5-11d8-4cc4-9e3b-a5327bb5497b None None] MFA Rules not processed for user `d6faa81040584266880e42448393ed7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:02:39.652497 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-513077d5-11d8-4cc4-9e3b-a5327bb5497b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:39.676381 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd03343-6cfe-4dc3-9b64-74afa4ad1248 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:39.682459 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd03343-6cfe-4dc3-9b64-74afa4ad1248 service cinder] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:39.701281 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 834/1640] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:02:39 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:02:39.734841 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:02:39.851637 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 807/1641] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:02:39 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:02:39.869959 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd03343-6cfe-4dc3-9b64-74afa4ad1248 service cinder] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:39.882291 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd03343-6cfe-4dc3-9b64-74afa4ad1248 service cinder] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:39.888364 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b020c-e5ed-4237-a9ea-2ac3e6e06441 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b8a09704b9b4ab2bffb813796ec6e77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:39.888992 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b020c-e5ed-4237-a9ea-2ac3e6e06441 service cinder] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:39.889277 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b020c-e5ed-4237-a9ea-2ac3e6e06441 service cinder] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:39.889583 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b020c-e5ed-4237-a9ea-2ac3e6e06441 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:39.909695 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566b020c-e5ed-4237-a9ea-2ac3e6e06441 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:39.914106 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566b020c-e5ed-4237-a9ea-2ac3e6e06441 service cinder] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:39.945198 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 835/1642] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:02:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:02:40.671335 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513077d5-11d8-4cc4-9e3b-a5327bb5497b None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:40.686899 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513077d5-11d8-4cc4-9e3b-a5327bb5497b None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:40.695477 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68ab789-f5a3-49ee-aa75-5baa91dac0e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b8a09704b9b4ab2bffb813796ec6e77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:40.696340 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ab789-f5a3-49ee-aa75-5baa91dac0e3 service cinder] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:40.696767 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ab789-f5a3-49ee-aa75-5baa91dac0e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:40.697185 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ab789-f5a3-49ee-aa75-5baa91dac0e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:40.723212 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68ab789-f5a3-49ee-aa75-5baa91dac0e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:40.725797 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68ab789-f5a3-49ee-aa75-5baa91dac0e3 service cinder] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:40.753307 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 808/1643] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:02:40 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:02:41.977578 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b020c-e5ed-4237-a9ea-2ac3e6e06441 service cinder] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:42.048044 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:02:42.152755 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68ab789-f5a3-49ee-aa75-5baa91dac0e3 service cinder] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:42.153764 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b020c-e5ed-4237-a9ea-2ac3e6e06441 service cinder] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:42.162507 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ab5cda-90e5-47dd-bcf7-c0b7667f57e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:42.164226 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab5cda-90e5-47dd-bcf7-c0b7667f57e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:42.164696 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab5cda-90e5-47dd-bcf7-c0b7667f57e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:42.165193 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab5cda-90e5-47dd-bcf7-c0b7667f57e9 admin admin] PATH_INFO: `/v3/users/64c7099e57c44727b5c23b5fd492f97e` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:42.169039 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ab5cda-90e5-47dd-bcf7-c0b7667f57e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64c7099e57c44727b5c23b5fd492f97e)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:42.170121 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: WARNING py.warnings [None req-95ab5cda-90e5-47dd-bcf7-c0b7667f57e9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:02:42.170121 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: warnings.warn(msg) Aug 18 11:02:42.170121 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: Aug 18 11:02:42.170513 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68ab789-f5a3-49ee-aa75-5baa91dac0e3 service cinder] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:42.171358 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ab5cda-90e5-47dd-bcf7-c0b7667f57e9 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:42.187017 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1aa35c-a3f6-42f1-9f52-2f6f28be1fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:42.189252 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1aa35c-a3f6-42f1-9f52-2f6f28be1fcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:42.190829 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1aa35c-a3f6-42f1-9f52-2f6f28be1fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:42.191501 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1aa35c-a3f6-42f1-9f52-2f6f28be1fcd admin admin] PATH_INFO: `/v3/users/2624d3c4da494fd1b7a8b509e90dc4fe` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:42.195591 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1aa35c-a3f6-42f1-9f52-2f6f28be1fcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=2624d3c4da494fd1b7a8b509e90dc4fe)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:42.210070 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1aa35c-a3f6-42f1-9f52-2f6f28be1fcd admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:42.362137 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-95ab5cda-90e5-47dd-bcf7-c0b7667f57e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64c7099e57c44727b5c23b5fd492f97e'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:02:42.363305 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-95ab5cda-90e5-47dd-bcf7-c0b7667f57e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64c7099e57c44727b5c23b5fd492f97e'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:02:42.389758 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-4c1aa35c-a3f6-42f1-9f52-2f6f28be1fcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2624d3c4da494fd1b7a8b509e90dc4fe'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:02:42.399719 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-95ab5cda-90e5-47dd-bcf7-c0b7667f57e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64c7099e57c44727b5c23b5fd492f97e'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:02:42.408030 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-4c1aa35c-a3f6-42f1-9f52-2f6f28be1fcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2624d3c4da494fd1b7a8b509e90dc4fe'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:02:42.411478 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-4c1aa35c-a3f6-42f1-9f52-2f6f28be1fcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2624d3c4da494fd1b7a8b509e90dc4fe'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:02:42.413808 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-4c1aa35c-a3f6-42f1-9f52-2f6f28be1fcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2624d3c4da494fd1b7a8b509e90dc4fe'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:02:42.449074 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-4c1aa35c-a3f6-42f1-9f52-2f6f28be1fcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2624d3c4da494fd1b7a8b509e90dc4fe'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:02:42.464790 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-95ab5cda-90e5-47dd-bcf7-c0b7667f57e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64c7099e57c44727b5c23b5fd492f97e'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:02:42.481016 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-95ab5cda-90e5-47dd-bcf7-c0b7667f57e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64c7099e57c44727b5c23b5fd492f97e'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:02:42.491762 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 836/1644] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:02:41 2022] DELETE /identity/v3/users/64c7099e57c44727b5c23b5fd492f97e => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:02:42.493606 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca49d2f6-003c-4c6c-9bda-a98b1951f153 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:42.493843 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca49d2f6-003c-4c6c-9bda-a98b1951f153 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:42.494130 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca49d2f6-003c-4c6c-9bda-a98b1951f153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:42.513114 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 809/1645] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:02:42 2022] DELETE /identity/v3/users/2624d3c4da494fd1b7a8b509e90dc4fe => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:02:42.518207 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa7b47-5c87-4029-af21-b78aceddc297 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:42.518827 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa7b47-5c87-4029-af21-b78aceddc297 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:42.519214 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa7b47-5c87-4029-af21-b78aceddc297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:42.533939 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-ca49d2f6-003c-4c6c-9bda-a98b1951f153 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:02:42.535213 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-ca49d2f6-003c-4c6c-9bda-a98b1951f153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:42.567712 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-b1aa7b47-5c87-4029-af21-b78aceddc297 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:02:42.569329 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-b1aa7b47-5c87-4029-af21-b78aceddc297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:42.657267 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 810/1646] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:02:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:02:42.726426 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 837/1647] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:02:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:02:42.770172 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aa7b47-5c87-4029-af21-b78aceddc297 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:42.772183 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca49d2f6-003c-4c6c-9bda-a98b1951f153 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:42.774618 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-ca49d2f6-003c-4c6c-9bda-a98b1951f153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:42.776349 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-b1aa7b47-5c87-4029-af21-b78aceddc297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:42.886830 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:02:42.943192 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aa7b47-5c87-4029-af21-b78aceddc297 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:42.949503 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:02:42.950993 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b188d860-8bfd-41ba-9ba4-6fecf8b2929e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:42.957500 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b188d860-8bfd-41ba-9ba4-6fecf8b2929e service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:42.957868 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b188d860-8bfd-41ba-9ba4-6fecf8b2929e service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:42.958304 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b188d860-8bfd-41ba-9ba4-6fecf8b2929e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:42.983422 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca49d2f6-003c-4c6c-9bda-a98b1951f153 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:42.995072 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dee791c-0b17-4336-bff4-6cbfeb0686a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:42.997251 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dee791c-0b17-4336-bff4-6cbfeb0686a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:42.998319 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dee791c-0b17-4336-bff4-6cbfeb0686a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:42.999078 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dee791c-0b17-4336-bff4-6cbfeb0686a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:43.007882 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b188d860-8bfd-41ba-9ba4-6fecf8b2929e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:43.009393 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b188d860-8bfd-41ba-9ba4-6fecf8b2929e service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:43.040845 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dee791c-0b17-4336-bff4-6cbfeb0686a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:43.042334 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dee791c-0b17-4336-bff4-6cbfeb0686a4 service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:43.054495 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 811/1648] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:02:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:02:43.078087 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 838/1649] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:02:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:02:43.843873 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b188d860-8bfd-41ba-9ba4-6fecf8b2929e service neutron] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:43.845607 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-b188d860-8bfd-41ba-9ba4-6fecf8b2929e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:43.875454 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b188d860-8bfd-41ba-9ba4-6fecf8b2929e service neutron] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:43.885941 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa99c64-16f4-40fb-bde1-97b521da0eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:43.886731 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa99c64-16f4-40fb-bde1-97b521da0eac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:43.887093 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa99c64-16f4-40fb-bde1-97b521da0eac admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:43.887442 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa99c64-16f4-40fb-bde1-97b521da0eac admin admin] PATH_INFO: `/v3/users/4153b369951f48e1afc6aff02a75f9c2` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:43.888748 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa99c64-16f4-40fb-bde1-97b521da0eac admin admin] RBAC: Authorizing `identity:delete_user(user_id=4153b369951f48e1afc6aff02a75f9c2)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:43.890813 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa99c64-16f4-40fb-bde1-97b521da0eac admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:44.029602 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-0fa99c64-16f4-40fb-bde1-97b521da0eac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4153b369951f48e1afc6aff02a75f9c2'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:02:44.045082 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-0fa99c64-16f4-40fb-bde1-97b521da0eac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4153b369951f48e1afc6aff02a75f9c2'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:02:44.045890 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-0fa99c64-16f4-40fb-bde1-97b521da0eac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4153b369951f48e1afc6aff02a75f9c2'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:02:44.046955 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-0fa99c64-16f4-40fb-bde1-97b521da0eac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4153b369951f48e1afc6aff02a75f9c2'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:02:44.061335 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-0fa99c64-16f4-40fb-bde1-97b521da0eac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4153b369951f48e1afc6aff02a75f9c2'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:02:44.104346 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 812/1650] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:02:43 2022] DELETE /identity/v3/users/4153b369951f48e1afc6aff02a75f9c2 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:02:44.108377 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed35fed-2be0-45b9-a6cb-bce15f29a475 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:44.108844 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed35fed-2be0-45b9-a6cb-bce15f29a475 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:44.108916 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed35fed-2be0-45b9-a6cb-bce15f29a475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:44.150376 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-0ed35fed-2be0-45b9-a6cb-bce15f29a475 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:02:44.151658 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-0ed35fed-2be0-45b9-a6cb-bce15f29a475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:44.300707 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 839/1651] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:02:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:02:44.358653 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa99c64-16f4-40fb-bde1-97b521da0eac admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:44.360121 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-0fa99c64-16f4-40fb-bde1-97b521da0eac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:44.605915 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa99c64-16f4-40fb-bde1-97b521da0eac admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:44.610965 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9c1cdb-f214-4e41-bc21-19d80da6a669 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:44.612288 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9c1cdb-f214-4e41-bc21-19d80da6a669 service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:44.612551 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9c1cdb-f214-4e41-bc21-19d80da6a669 service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:44.612849 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9c1cdb-f214-4e41-bc21-19d80da6a669 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:44.634567 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9c1cdb-f214-4e41-bc21-19d80da6a669 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:44.637827 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9c1cdb-f214-4e41-bc21-19d80da6a669 service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:44.645165 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed35fed-2be0-45b9-a6cb-bce15f29a475 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:44.647924 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-0ed35fed-2be0-45b9-a6cb-bce15f29a475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:44.664095 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 813/1652] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:02:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:02:44.670451 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed35fed-2be0-45b9-a6cb-bce15f29a475 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:44.680507 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f6ab5e-4632-47a1-ad57-a0bd42504e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:44.682042 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f6ab5e-4632-47a1-ad57-a0bd42504e0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:44.682730 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f6ab5e-4632-47a1-ad57-a0bd42504e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:44.683117 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f6ab5e-4632-47a1-ad57-a0bd42504e0f admin admin] PATH_INFO: `/v3/projects/0ae68b3bd077494880aa040e162fbbab` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:44.685149 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f6ab5e-4632-47a1-ad57-a0bd42504e0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ae68b3bd077494880aa040e162fbbab)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:44.690925 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f6ab5e-4632-47a1-ad57-a0bd42504e0f admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:44.796835 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-18f6ab5e-4632-47a1-ad57-a0bd42504e0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ae68b3bd077494880aa040e162fbbab', 'request_id': 'req-18f6ab5e-4632-47a1-ad57-a0bd42504e0f'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:02:44.809778 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-18f6ab5e-4632-47a1-ad57-a0bd42504e0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ae68b3bd077494880aa040e162fbbab', 'request_id': 'req-18f6ab5e-4632-47a1-ad57-a0bd42504e0f'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:02:44.822976 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-18f6ab5e-4632-47a1-ad57-a0bd42504e0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ae68b3bd077494880aa040e162fbbab', 'request_id': 'req-18f6ab5e-4632-47a1-ad57-a0bd42504e0f'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:02:44.842699 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-18f6ab5e-4632-47a1-ad57-a0bd42504e0f admin admin] The token cache is being invalidate because project 0ae68b3bd077494880aa040e162fbbab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:02:44.843003 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-18f6ab5e-4632-47a1-ad57-a0bd42504e0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:02:44.843871 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-18f6ab5e-4632-47a1-ad57-a0bd42504e0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:02:44.851229 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9c1cdb-f214-4e41-bc21-19d80da6a669 service neutron] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:44.863891 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 840/1653] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:02:44 2022] DELETE /identity/v3/projects/0ae68b3bd077494880aa040e162fbbab => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:02:44.868571 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9c1cdb-f214-4e41-bc21-19d80da6a669 service neutron] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:44.944604 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:02:44.970424 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e537aea6-9e35-4abd-b36e-8955f629d407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:44.971139 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e537aea6-9e35-4abd-b36e-8955f629d407 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:44.971488 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e537aea6-9e35-4abd-b36e-8955f629d407 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:44.972186 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e537aea6-9e35-4abd-b36e-8955f629d407 admin admin] PATH_INFO: `/v3/users/d6faa81040584266880e42448393ed7e` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:44.973454 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e537aea6-9e35-4abd-b36e-8955f629d407 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6faa81040584266880e42448393ed7e)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:44.977885 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e537aea6-9e35-4abd-b36e-8955f629d407 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:45.122981 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-e537aea6-9e35-4abd-b36e-8955f629d407 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6faa81040584266880e42448393ed7e'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:02:45.135745 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-e537aea6-9e35-4abd-b36e-8955f629d407 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6faa81040584266880e42448393ed7e'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:02:45.136667 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-e537aea6-9e35-4abd-b36e-8955f629d407 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6faa81040584266880e42448393ed7e'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:02:45.137291 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-e537aea6-9e35-4abd-b36e-8955f629d407 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6faa81040584266880e42448393ed7e'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:02:45.149748 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-e537aea6-9e35-4abd-b36e-8955f629d407 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6faa81040584266880e42448393ed7e'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:02:45.159472 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f6ab5e-4632-47a1-ad57-a0bd42504e0f admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:45.162839 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-18f6ab5e-4632-47a1-ad57-a0bd42504e0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:45.195339 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f6ab5e-4632-47a1-ad57-a0bd42504e0f admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:45.220173 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eca230-00f4-49a2-bd30-668fe3ab6f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:45.223925 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eca230-00f4-49a2-bd30-668fe3ab6f5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:45.225484 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eca230-00f4-49a2-bd30-668fe3ab6f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:45.226131 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eca230-00f4-49a2-bd30-668fe3ab6f5d admin admin] PATH_INFO: `/v3/projects/cf44e44598b542fbb69fe8e8583eaaff` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:45.229983 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 814/1654] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:02:44 2022] DELETE /identity/v3/users/d6faa81040584266880e42448393ed7e => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:02:45.234232 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eca230-00f4-49a2-bd30-668fe3ab6f5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf44e44598b542fbb69fe8e8583eaaff)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:45.237375 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eca230-00f4-49a2-bd30-668fe3ab6f5d admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:45.351068 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-61eca230-00f4-49a2-bd30-668fe3ab6f5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf44e44598b542fbb69fe8e8583eaaff', 'request_id': 'req-61eca230-00f4-49a2-bd30-668fe3ab6f5d'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:02:45.372096 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-61eca230-00f4-49a2-bd30-668fe3ab6f5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf44e44598b542fbb69fe8e8583eaaff', 'request_id': 'req-61eca230-00f4-49a2-bd30-668fe3ab6f5d'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:02:45.384790 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-61eca230-00f4-49a2-bd30-668fe3ab6f5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf44e44598b542fbb69fe8e8583eaaff', 'request_id': 'req-61eca230-00f4-49a2-bd30-668fe3ab6f5d'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:02:45.389665 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:02:45.415829 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-61eca230-00f4-49a2-bd30-668fe3ab6f5d admin admin] The token cache is being invalidate because project cf44e44598b542fbb69fe8e8583eaaff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:02:45.416091 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-61eca230-00f4-49a2-bd30-668fe3ab6f5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:02:45.416857 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-61eca230-00f4-49a2-bd30-668fe3ab6f5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:02:45.418689 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 841/1655] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:02:45 2022] DELETE /identity/v3/projects/cf44e44598b542fbb69fe8e8583eaaff => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:02:45.423600 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e537aea6-9e35-4abd-b36e-8955f629d407 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:45.423938 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-e537aea6-9e35-4abd-b36e-8955f629d407 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:45.606270 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e537aea6-9e35-4abd-b36e-8955f629d407 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:45.694968 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b32470-0fe3-4378-8b27-64049e5fc545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:45.695857 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b32470-0fe3-4378-8b27-64049e5fc545 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:45.696135 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b32470-0fe3-4378-8b27-64049e5fc545 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:45.696497 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b32470-0fe3-4378-8b27-64049e5fc545 admin admin] PATH_INFO: `/v3/users/fe236efff9d94c119e7d46adbfd5fe98` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:45.699206 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b32470-0fe3-4378-8b27-64049e5fc545 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe236efff9d94c119e7d46adbfd5fe98)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:45.703365 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b32470-0fe3-4378-8b27-64049e5fc545 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:45.765349 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:02:45.861977 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-c7b32470-0fe3-4378-8b27-64049e5fc545 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe236efff9d94c119e7d46adbfd5fe98'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:02:45.883814 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-c7b32470-0fe3-4378-8b27-64049e5fc545 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe236efff9d94c119e7d46adbfd5fe98'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:02:45.884459 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-c7b32470-0fe3-4378-8b27-64049e5fc545 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe236efff9d94c119e7d46adbfd5fe98'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:02:45.885183 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-c7b32470-0fe3-4378-8b27-64049e5fc545 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe236efff9d94c119e7d46adbfd5fe98'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:02:45.908132 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-c7b32470-0fe3-4378-8b27-64049e5fc545 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe236efff9d94c119e7d46adbfd5fe98'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:02:45.980973 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 815/1656] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:02:45 2022] DELETE /identity/v3/users/fe236efff9d94c119e7d46adbfd5fe98 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:02:47.185449 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eca230-00f4-49a2-bd30-668fe3ab6f5d admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:47.187747 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-61eca230-00f4-49a2-bd30-668fe3ab6f5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:47.236596 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eca230-00f4-49a2-bd30-668fe3ab6f5d admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:47.339464 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2366e7f0-13ed-406c-9858-eb604f7f23f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:47.340914 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2366e7f0-13ed-406c-9858-eb604f7f23f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:47.341360 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2366e7f0-13ed-406c-9858-eb604f7f23f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:47.341810 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2366e7f0-13ed-406c-9858-eb604f7f23f2 admin admin] PATH_INFO: `/v3/projects/1680ce3af8fc4d7895d33982c44a9b0f` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:47.343232 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2366e7f0-13ed-406c-9858-eb604f7f23f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1680ce3af8fc4d7895d33982c44a9b0f)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:47.345385 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2366e7f0-13ed-406c-9858-eb604f7f23f2 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:47.363226 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b32470-0fe3-4378-8b27-64049e5fc545 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:47.366102 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-c7b32470-0fe3-4378-8b27-64049e5fc545 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:47.384143 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b32470-0fe3-4378-8b27-64049e5fc545 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:47.393493 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615a6ed4-571a-4ffe-a10a-48e790f8a3ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:47.394382 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a6ed4-571a-4ffe-a10a-48e790f8a3ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:47.394815 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a6ed4-571a-4ffe-a10a-48e790f8a3ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:47.395241 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a6ed4-571a-4ffe-a10a-48e790f8a3ef admin admin] PATH_INFO: `/v3/projects/523cb8f17fc9468d86944717135714f4` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:47.398777 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615a6ed4-571a-4ffe-a10a-48e790f8a3ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=523cb8f17fc9468d86944717135714f4)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:47.400567 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: WARNING py.warnings [None req-615a6ed4-571a-4ffe-a10a-48e790f8a3ef admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:02:47.400567 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: warnings.warn(msg) Aug 18 11:02:47.400567 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: Aug 18 11:02:47.402681 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615a6ed4-571a-4ffe-a10a-48e790f8a3ef admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:47.477578 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-2366e7f0-13ed-406c-9858-eb604f7f23f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1680ce3af8fc4d7895d33982c44a9b0f', 'request_id': 'req-2366e7f0-13ed-406c-9858-eb604f7f23f2'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:02:47.494055 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-2366e7f0-13ed-406c-9858-eb604f7f23f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1680ce3af8fc4d7895d33982c44a9b0f', 'request_id': 'req-2366e7f0-13ed-406c-9858-eb604f7f23f2'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:02:47.503034 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-2366e7f0-13ed-406c-9858-eb604f7f23f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1680ce3af8fc4d7895d33982c44a9b0f', 'request_id': 'req-2366e7f0-13ed-406c-9858-eb604f7f23f2'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:02:47.517367 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-615a6ed4-571a-4ffe-a10a-48e790f8a3ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '523cb8f17fc9468d86944717135714f4', 'request_id': 'req-615a6ed4-571a-4ffe-a10a-48e790f8a3ef'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:02:47.527631 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-615a6ed4-571a-4ffe-a10a-48e790f8a3ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '523cb8f17fc9468d86944717135714f4', 'request_id': 'req-615a6ed4-571a-4ffe-a10a-48e790f8a3ef'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:02:47.529226 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-2366e7f0-13ed-406c-9858-eb604f7f23f2 admin admin] The token cache is being invalidate because project 1680ce3af8fc4d7895d33982c44a9b0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:02:47.529563 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-2366e7f0-13ed-406c-9858-eb604f7f23f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:02:47.531789 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-2366e7f0-13ed-406c-9858-eb604f7f23f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:02:47.541332 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 842/1657] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:02:47 2022] DELETE /identity/v3/projects/1680ce3af8fc4d7895d33982c44a9b0f => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:02:47.542980 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2953e6c3-bbe9-4716-b083-6774e7436aba None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:47.543272 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2953e6c3-bbe9-4716-b083-6774e7436aba None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:47.543557 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2953e6c3-bbe9-4716-b083-6774e7436aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:47.550946 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-615a6ed4-571a-4ffe-a10a-48e790f8a3ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '523cb8f17fc9468d86944717135714f4', 'request_id': 'req-615a6ed4-571a-4ffe-a10a-48e790f8a3ef'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:02:47.582335 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-615a6ed4-571a-4ffe-a10a-48e790f8a3ef admin admin] The token cache is being invalidate because project 523cb8f17fc9468d86944717135714f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:02:47.585180 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-615a6ed4-571a-4ffe-a10a-48e790f8a3ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:02:47.586219 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-615a6ed4-571a-4ffe-a10a-48e790f8a3ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:02:47.591977 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-2953e6c3-bbe9-4716-b083-6774e7436aba None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:02:47.592422 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-2953e6c3-bbe9-4716-b083-6774e7436aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:47.593539 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 816/1658] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:02:47 2022] DELETE /identity/v3/projects/523cb8f17fc9468d86944717135714f4 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:02:47.595291 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1572493-41f6-43af-9423-812b3c101993 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:47.595812 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1572493-41f6-43af-9423-812b3c101993 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:47.596364 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1572493-41f6-43af-9423-812b3c101993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:47.628550 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-c1572493-41f6-43af-9423-812b3c101993 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:02:47.631275 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-c1572493-41f6-43af-9423-812b3c101993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:47.675571 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 843/1659] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:02:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:02:47.677329 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e859e-0eaf-4732-927b-317d5546756e None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:47.678214 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e859e-0eaf-4732-927b-317d5546756e None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:47.678498 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e859e-0eaf-4732-927b-317d5546756e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:47.720472 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-bd2e859e-0eaf-4732-927b-317d5546756e None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:02:47.725782 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-bd2e859e-0eaf-4732-927b-317d5546756e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:47.744845 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 844/1660] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:02:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:02:47.747008 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2e859e-0eaf-4732-927b-317d5546756e None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:47.757927 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 817/1661] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:02:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:02:47.767552 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eaae3b-d960-4866-af08-7b14a259cda6 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:47.767758 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eaae3b-d960-4866-af08-7b14a259cda6 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:47.768306 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eaae3b-d960-4866-af08-7b14a259cda6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:47.774798 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2e859e-0eaf-4732-927b-317d5546756e None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:47.795312 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b13933-bde0-4823-af70-f982254818e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:47.796210 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b13933-bde0-4823-af70-f982254818e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:47.799238 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b13933-bde0-4823-af70-f982254818e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:47.800113 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b13933-bde0-4823-af70-f982254818e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:47.801011 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b13933-bde0-4823-af70-f982254818e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:02:47.803669 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b13933-bde0-4823-af70-f982254818e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:47.806400 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b13933-bde0-4823-af70-f982254818e8 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:47.824433 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-83eaae3b-d960-4866-af08-7b14a259cda6 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:02:47.825841 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-83eaae3b-d960-4866-af08-7b14a259cda6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:47.855511 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 845/1662] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Aug 18 11:02:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:02:47.858928 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b13933-bde0-4823-af70-f982254818e8 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:47.867169 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 818/1663] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:02:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:02:47.868748 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:02:47.873164 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eaae3b-d960-4866-af08-7b14a259cda6 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:47.889550 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b13933-bde0-4823-af70-f982254818e8 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:47.898126 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec47a848-617d-4cd1-9a03-4bf381914a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:47.899101 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec47a848-617d-4cd1-9a03-4bf381914a82 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:47.899533 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec47a848-617d-4cd1-9a03-4bf381914a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:47.899950 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec47a848-617d-4cd1-9a03-4bf381914a82 admin admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:47.900877 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec47a848-617d-4cd1-9a03-4bf381914a82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:47.904016 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec47a848-617d-4cd1-9a03-4bf381914a82 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:47.918638 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eaae3b-d960-4866-af08-7b14a259cda6 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:47.931848 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cd259f-5521-4e6b-9be0-476dc0ea66e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:47.932696 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cd259f-5521-4e6b-9be0-476dc0ea66e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:47.933026 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cd259f-5521-4e6b-9be0-476dc0ea66e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:47.933311 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cd259f-5521-4e6b-9be0-476dc0ea66e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:47.935267 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cd259f-5521-4e6b-9be0-476dc0ea66e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:02:47.935605 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cd259f-5521-4e6b-9be0-476dc0ea66e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:47.940303 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cd259f-5521-4e6b-9be0-476dc0ea66e1 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:47.962082 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 846/1664] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:02:47 2022] POST /identity/v3/projects => generated 355 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:02:47.966711 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec47a848-617d-4cd1-9a03-4bf381914a82 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:47.979234 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:02:47.996866 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 819/1665] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Aug 18 11:02:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:02:47.999685 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cd259f-5521-4e6b-9be0-476dc0ea66e1 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:48.028953 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cd259f-5521-4e6b-9be0-476dc0ea66e1 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:48.192445 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec47a848-617d-4cd1-9a03-4bf381914a82 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:48.220532 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0938f29f-caa4-4550-bcb5-beea07341ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:48.222231 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0938f29f-caa4-4550-bcb5-beea07341ad2 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:48.222725 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0938f29f-caa4-4550-bcb5-beea07341ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:48.223219 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0938f29f-caa4-4550-bcb5-beea07341ad2 admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:48.224342 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0938f29f-caa4-4550-bcb5-beea07341ad2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:48.231725 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0938f29f-caa4-4550-bcb5-beea07341ad2 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:48.250597 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201fd5d6-eb08-4a48-bb57-3e2c04011911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:48.251981 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201fd5d6-eb08-4a48-bb57-3e2c04011911 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:48.252852 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201fd5d6-eb08-4a48-bb57-3e2c04011911 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:48.253183 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201fd5d6-eb08-4a48-bb57-3e2c04011911 admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:48.254214 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201fd5d6-eb08-4a48-bb57-3e2c04011911 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:48.258371 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201fd5d6-eb08-4a48-bb57-3e2c04011911 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:48.310444 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 847/1666] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:02:47 2022] POST /identity/v3/users => generated 278 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:02:48.311762 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0938f29f-caa4-4550-bcb5-beea07341ad2 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:48.339203 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 820/1667] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:02:47 2022] POST /identity/v3/projects => generated 375 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 11:02:48.343286 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201fd5d6-eb08-4a48-bb57-3e2c04011911 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:48.352243 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0938f29f-caa4-4550-bcb5-beea07341ad2 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:48.493861 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201fd5d6-eb08-4a48-bb57-3e2c04011911 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:48.502702 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30a2743-667e-457d-9657-db78b6f61fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:48.503344 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a2743-667e-457d-9657-db78b6f61fe3 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:48.503628 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a2743-667e-457d-9657-db78b6f61fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:48.503909 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a2743-667e-457d-9657-db78b6f61fe3 admin admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:48.504595 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30a2743-667e-457d-9657-db78b6f61fe3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:48.509922 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d358d49f-fe2c-40c4-924a-b329a7ae7bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:48.510873 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d358d49f-fe2c-40c4-924a-b329a7ae7bb5 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:48.511286 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d358d49f-fe2c-40c4-924a-b329a7ae7bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:48.511679 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d358d49f-fe2c-40c4-924a-b329a7ae7bb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:48.512484 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d358d49f-fe2c-40c4-924a-b329a7ae7bb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:48.514350 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d358d49f-fe2c-40c4-924a-b329a7ae7bb5 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:48.518583 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30a2743-667e-457d-9657-db78b6f61fe3 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:48.565315 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 848/1668] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:02:48 2022] GET /identity/v3/roles => generated 1420 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:02:48.566647 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d358d49f-fe2c-40c4-924a-b329a7ae7bb5 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:48.574843 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 821/1669] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:02:48 2022] POST /identity/v3/users => generated 288 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 11:02:48.584425 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30a2743-667e-457d-9657-db78b6f61fe3 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:48.596561 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d358d49f-fe2c-40c4-924a-b329a7ae7bb5 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:48.607974 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93b6575-d780-4e5b-b1c6-99b58d2b8cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:48.608727 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b6575-d780-4e5b-b1c6-99b58d2b8cbe admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:48.609158 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b6575-d780-4e5b-b1c6-99b58d2b8cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:48.609657 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b6575-d780-4e5b-b1c6-99b58d2b8cbe admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:48.610606 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93b6575-d780-4e5b-b1c6-99b58d2b8cbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:48.612379 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93b6575-d780-4e5b-b1c6-99b58d2b8cbe admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:48.621721 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30a2743-667e-457d-9657-db78b6f61fe3 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:48.636372 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6285f66-13f2-444e-ae8c-587df7cb0877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:48.637032 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6285f66-13f2-444e-ae8c-587df7cb0877 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:48.637319 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6285f66-13f2-444e-ae8c-587df7cb0877 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:48.637636 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6285f66-13f2-444e-ae8c-587df7cb0877 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:48.638307 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6285f66-13f2-444e-ae8c-587df7cb0877 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:48.640152 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6285f66-13f2-444e-ae8c-587df7cb0877 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:48.658856 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 849/1670] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:02:48 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:02:48.660952 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93b6575-d780-4e5b-b1c6-99b58d2b8cbe admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:48.667944 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 822/1671] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:02:48 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:02:48.670603 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6285f66-13f2-444e-ae8c-587df7cb0877 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:48.691877 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93b6575-d780-4e5b-b1c6-99b58d2b8cbe admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:48.692128 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6285f66-13f2-444e-ae8c-587df7cb0877 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:48.707226 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa19df5d-d80f-4cb5-813e-cc92d653ce17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:48.707735 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605082f8-2a45-425e-a19b-dfbffcc2245b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:48.707861 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa19df5d-d80f-4cb5-813e-cc92d653ce17 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:48.708041 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa19df5d-d80f-4cb5-813e-cc92d653ce17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:48.708319 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa19df5d-d80f-4cb5-813e-cc92d653ce17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:48.708992 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605082f8-2a45-425e-a19b-dfbffcc2245b admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:48.709226 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa19df5d-d80f-4cb5-813e-cc92d653ce17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:48.709602 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605082f8-2a45-425e-a19b-dfbffcc2245b admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:48.710062 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605082f8-2a45-425e-a19b-dfbffcc2245b admin admin] PATH_INFO: `/v3/projects/0aa16bfcb70448c2b0bdfb30c120fa97/users/696d1305d948460d876ad41ebda6e794/roles/719e5c62188d4f8a838987d6e72ca8f7` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:48.713698 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa19df5d-d80f-4cb5-813e-cc92d653ce17 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:48.746119 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 823/1672] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:02:48 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:02:48.748381 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605082f8-2a45-425e-a19b-dfbffcc2245b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0aa16bfcb70448c2b0bdfb30c120fa97, user_id=696d1305d948460d876ad41ebda6e794, role_id=719e5c62188d4f8a838987d6e72ca8f7)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:48.750046 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa19df5d-d80f-4cb5-813e-cc92d653ce17 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:48.766315 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605082f8-2a45-425e-a19b-dfbffcc2245b admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:48.768393 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa19df5d-d80f-4cb5-813e-cc92d653ce17 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:48.786219 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b34b02d-febd-4345-85c4-fc22393d7f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:48.787098 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b34b02d-febd-4345-85c4-fc22393d7f5e admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:48.787473 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b34b02d-febd-4345-85c4-fc22393d7f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:48.788045 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b34b02d-febd-4345-85c4-fc22393d7f5e admin admin] PATH_INFO: `/v3/projects/83c296e31a604c23b028c480c90270b4/users/7cedc379cbe243bebeafa336bd078da7/roles/719e5c62188d4f8a838987d6e72ca8f7` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:48.806400 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 850/1673] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:02:48 2022] PUT /identity/v3/projects/0aa16bfcb70448c2b0bdfb30c120fa97/users/696d1305d948460d876ad41ebda6e794/roles/719e5c62188d4f8a838987d6e72ca8f7 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:02:48.808323 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe16c481-8312-4f42-834b-0e1ab72378e6 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:48.808769 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe16c481-8312-4f42-834b-0e1ab72378e6 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:48.809195 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe16c481-8312-4f42-834b-0e1ab72378e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:48.837491 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b34b02d-febd-4345-85c4-fc22393d7f5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=83c296e31a604c23b028c480c90270b4, user_id=7cedc379cbe243bebeafa336bd078da7, role_id=719e5c62188d4f8a838987d6e72ca8f7)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:48.846079 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b34b02d-febd-4345-85c4-fc22393d7f5e admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:48.877239 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 824/1674] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:02:48 2022] PUT /identity/v3/projects/83c296e31a604c23b028c480c90270b4/users/7cedc379cbe243bebeafa336bd078da7/roles/719e5c62188d4f8a838987d6e72ca8f7 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:02:48.888893 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf76f22e-b123-4852-a0da-3ffcac99bcf5 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:48.889311 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf76f22e-b123-4852-a0da-3ffcac99bcf5 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:48.889674 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf76f22e-b123-4852-a0da-3ffcac99bcf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:48.937191 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-fe16c481-8312-4f42-834b-0e1ab72378e6 None None] MFA Rules not processed for user `696d1305d948460d876ad41ebda6e794`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:02:48.938585 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-fe16c481-8312-4f42-834b-0e1ab72378e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:48.958633 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-bf76f22e-b123-4852-a0da-3ffcac99bcf5 None None] MFA Rules not processed for user `7cedc379cbe243bebeafa336bd078da7`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:02:48.966239 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-bf76f22e-b123-4852-a0da-3ffcac99bcf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:49.002320 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:02:49.005473 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:02:49.127535 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 825/1675] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:02:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:02:49.140772 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf76f22e-b123-4852-a0da-3ffcac99bcf5 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:49.142098 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-bf76f22e-b123-4852-a0da-3ffcac99bcf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:49.150358 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 851/1676] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:02:48 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:02:49.158543 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe16c481-8312-4f42-834b-0e1ab72378e6 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:49.377405 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf76f22e-b123-4852-a0da-3ffcac99bcf5 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:49.379818 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe16c481-8312-4f42-834b-0e1ab72378e6 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:49.406214 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65936ed8-ff9d-4980-862e-2a3d9a1d349d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:49.407079 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65936ed8-ff9d-4980-862e-2a3d9a1d349d admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:49.407238 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c067c2e3-432d-479f-85bb-6eb3fce2301c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a005d8f0c46d44c7b6f2201a54717b12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:49.407798 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65936ed8-ff9d-4980-862e-2a3d9a1d349d admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:49.407911 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c067c2e3-432d-479f-85bb-6eb3fce2301c service nova] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:49.408296 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65936ed8-ff9d-4980-862e-2a3d9a1d349d admin admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:49.408411 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c067c2e3-432d-479f-85bb-6eb3fce2301c service nova] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:49.408836 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c067c2e3-432d-479f-85bb-6eb3fce2301c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:49.409417 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65936ed8-ff9d-4980-862e-2a3d9a1d349d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:49.413115 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65936ed8-ff9d-4980-862e-2a3d9a1d349d admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:49.430309 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c067c2e3-432d-479f-85bb-6eb3fce2301c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:49.442567 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c067c2e3-432d-479f-85bb-6eb3fce2301c service nova] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:49.501459 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 826/1677] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:02:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 11:02:49.503149 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c067c2e3-432d-479f-85bb-6eb3fce2301c service nova] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:49.514605 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-c067c2e3-432d-479f-85bb-6eb3fce2301c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:49.520387 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 852/1678] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:02:49 2022] POST /identity/v3/projects => generated 355 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:02:49.536495 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65936ed8-ff9d-4980-862e-2a3d9a1d349d admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:49.563722 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c067c2e3-432d-479f-85bb-6eb3fce2301c service nova] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:49.816950 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65936ed8-ff9d-4980-862e-2a3d9a1d349d admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:49.828932 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970ebd9e-5649-44a6-808f-75c7635e46bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:49.829879 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ebd9e-5649-44a6-808f-75c7635e46bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:49.830340 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ebd9e-5649-44a6-808f-75c7635e46bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:49.839484 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a85ae50-afce-4e41-aca4-0086cb4862c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:49.840623 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a85ae50-afce-4e41-aca4-0086cb4862c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:49.840953 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a85ae50-afce-4e41-aca4-0086cb4862c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:49.841242 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a85ae50-afce-4e41-aca4-0086cb4862c5 admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:49.841923 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a85ae50-afce-4e41-aca4-0086cb4862c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:49.844950 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a85ae50-afce-4e41-aca4-0086cb4862c5 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:49.846008 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ebd9e-5649-44a6-808f-75c7635e46bd admin admin] PATH_INFO: `/v3/projects/d300134524a847cf8741d77093ec9d02` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:49.853979 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970ebd9e-5649-44a6-808f-75c7635e46bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=d300134524a847cf8741d77093ec9d02)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:49.856078 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970ebd9e-5649-44a6-808f-75c7635e46bd admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:49.945557 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 853/1679] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:02:49 2022] POST /identity/v3/users => generated 284 bytes in 418 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:02:49.945999 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a85ae50-afce-4e41-aca4-0086cb4862c5 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:49.987113 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-4a85ae50-afce-4e41-aca4-0086cb4862c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:50.023915 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a85ae50-afce-4e41-aca4-0086cb4862c5 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:50.048740 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:02:50.056699 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-970ebd9e-5649-44a6-808f-75c7635e46bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd300134524a847cf8741d77093ec9d02', 'request_id': 'req-970ebd9e-5649-44a6-808f-75c7635e46bd'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:02:50.083261 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-970ebd9e-5649-44a6-808f-75c7635e46bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd300134524a847cf8741d77093ec9d02', 'request_id': 'req-970ebd9e-5649-44a6-808f-75c7635e46bd'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:02:50.096853 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-970ebd9e-5649-44a6-808f-75c7635e46bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd300134524a847cf8741d77093ec9d02', 'request_id': 'req-970ebd9e-5649-44a6-808f-75c7635e46bd'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:02:50.122624 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-970ebd9e-5649-44a6-808f-75c7635e46bd admin admin] The token cache is being invalidate because project d300134524a847cf8741d77093ec9d02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:02:50.122946 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-970ebd9e-5649-44a6-808f-75c7635e46bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:02:50.125912 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:02:50.126736 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-970ebd9e-5649-44a6-808f-75c7635e46bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:02:50.129176 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 827/1680] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:02:49 2022] DELETE /identity/v3/projects/d300134524a847cf8741d77093ec9d02 => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:02:50.131274 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727a6535-6a0a-4b91-99d7-6b3ecbcd5c9b None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:50.131603 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727a6535-6a0a-4b91-99d7-6b3ecbcd5c9b None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:50.132033 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727a6535-6a0a-4b91-99d7-6b3ecbcd5c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:50.201150 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4781db1-6843-42a2-839e-5ccee766ca84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:50.202036 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4781db1-6843-42a2-839e-5ccee766ca84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:50.202625 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4781db1-6843-42a2-839e-5ccee766ca84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:50.203036 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4781db1-6843-42a2-839e-5ccee766ca84 admin admin] PATH_INFO: `/v3/users/8980e83b77e749339c551bbe54fc40bf` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:50.205259 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4781db1-6843-42a2-839e-5ccee766ca84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8980e83b77e749339c551bbe54fc40bf)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:50.213633 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-727a6535-6a0a-4b91-99d7-6b3ecbcd5c9b None None] MFA Rules not processed for user `074cfcc7943349a490b29cd4ae3364cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:02:50.215117 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-727a6535-6a0a-4b91-99d7-6b3ecbcd5c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:50.216270 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4781db1-6843-42a2-839e-5ccee766ca84 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:50.332185 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-d4781db1-6843-42a2-839e-5ccee766ca84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8980e83b77e749339c551bbe54fc40bf'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:02:50.332903 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-d4781db1-6843-42a2-839e-5ccee766ca84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8980e83b77e749339c551bbe54fc40bf'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:02:50.347631 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 828/1681] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:02:50 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:02:50.349073 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727a6535-6a0a-4b91-99d7-6b3ecbcd5c9b None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:50.350643 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-d4781db1-6843-42a2-839e-5ccee766ca84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8980e83b77e749339c551bbe54fc40bf'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:02:50.351606 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-727a6535-6a0a-4b91-99d7-6b3ecbcd5c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:50.373425 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-d4781db1-6843-42a2-839e-5ccee766ca84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8980e83b77e749339c551bbe54fc40bf'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:02:50.374879 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727a6535-6a0a-4b91-99d7-6b3ecbcd5c9b None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:50.386296 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bd729b-9407-4148-9fdb-9cf3a3508fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:50.387366 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd729b-9407-4148-9fdb-9cf3a3508fce admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:50.387749 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd729b-9407-4148-9fdb-9cf3a3508fce admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:50.388232 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd729b-9407-4148-9fdb-9cf3a3508fce admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:50.388445 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-d4781db1-6843-42a2-839e-5ccee766ca84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8980e83b77e749339c551bbe54fc40bf'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:02:50.389492 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bd729b-9407-4148-9fdb-9cf3a3508fce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:50.409992 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 854/1682] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:02:49 2022] DELETE /identity/v3/users/8980e83b77e749339c551bbe54fc40bf => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:02:50.409992 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4781db1-6843-42a2-839e-5ccee766ca84 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:50.410254 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bd729b-9407-4148-9fdb-9cf3a3508fce admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:50.410326 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-d4781db1-6843-42a2-839e-5ccee766ca84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:50.434110 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 829/1683] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:02:50 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:02:50.445800 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f178e64-5757-4bc3-a51c-17ea9719de5b None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:50.446098 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f178e64-5757-4bc3-a51c-17ea9719de5b None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:50.447078 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f178e64-5757-4bc3-a51c-17ea9719de5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:50.496343 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-2f178e64-5757-4bc3-a51c-17ea9719de5b None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:02:50.502716 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-2f178e64-5757-4bc3-a51c-17ea9719de5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:50.580346 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4781db1-6843-42a2-839e-5ccee766ca84 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:50.596103 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2995d7-553c-4fde-b56b-18f6fead92f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:50.597026 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2995d7-553c-4fde-b56b-18f6fead92f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:50.597475 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2995d7-553c-4fde-b56b-18f6fead92f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:50.597949 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2995d7-553c-4fde-b56b-18f6fead92f2 admin admin] PATH_INFO: `/v3/users/7cedc379cbe243bebeafa336bd078da7` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:50.599551 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2995d7-553c-4fde-b56b-18f6fead92f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cedc379cbe243bebeafa336bd078da7)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:50.602890 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2995d7-553c-4fde-b56b-18f6fead92f2 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:50.686978 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 830/1684] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:02:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:02:50.686978 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b3ef1b-3bff-430b-bf8c-14da0fa90820 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:50.686978 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b3ef1b-3bff-430b-bf8c-14da0fa90820 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:50.686978 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b3ef1b-3bff-430b-bf8c-14da0fa90820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:50.704406 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-eb2995d7-553c-4fde-b56b-18f6fead92f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cedc379cbe243bebeafa336bd078da7'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:02:50.705382 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-eb2995d7-553c-4fde-b56b-18f6fead92f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cedc379cbe243bebeafa336bd078da7'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:02:50.720207 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-eb2995d7-553c-4fde-b56b-18f6fead92f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cedc379cbe243bebeafa336bd078da7'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:02:50.727471 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:02:50.745268 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-f5b3ef1b-3bff-430b-bf8c-14da0fa90820 None None] MFA Rules not processed for user `074cfcc7943349a490b29cd4ae3364cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:02:50.749186 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-f5b3ef1b-3bff-430b-bf8c-14da0fa90820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:50.755036 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-eb2995d7-553c-4fde-b56b-18f6fead92f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cedc379cbe243bebeafa336bd078da7'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:02:50.775271 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-eb2995d7-553c-4fde-b56b-18f6fead92f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cedc379cbe243bebeafa336bd078da7'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:02:50.806302 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 855/1685] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:02:50 2022] DELETE /identity/v3/users/7cedc379cbe243bebeafa336bd078da7 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:02:50.807949 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e816f0c6-1cb3-4147-89a8-10db830cfd0f None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:50.808239 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e816f0c6-1cb3-4147-89a8-10db830cfd0f None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:50.808517 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e816f0c6-1cb3-4147-89a8-10db830cfd0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:50.860138 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-e816f0c6-1cb3-4147-89a8-10db830cfd0f None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:02:50.863412 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-e816f0c6-1cb3-4147-89a8-10db830cfd0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:50.979504 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:02:51.018431 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 831/1686] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:02:50 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:02:51.018431 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b3ef1b-3bff-430b-bf8c-14da0fa90820 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:51.022814 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-f5b3ef1b-3bff-430b-bf8c-14da0fa90820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:51.027092 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 856/1687] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:02:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:02:51.029180 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48b4b7-cfbf-4223-9674-e022abfdea2b None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:51.029696 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48b4b7-cfbf-4223-9674-e022abfdea2b None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:51.029807 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48b4b7-cfbf-4223-9674-e022abfdea2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:51.056383 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b3ef1b-3bff-430b-bf8c-14da0fa90820 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:51.078157 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-cd48b4b7-cfbf-4223-9674-e022abfdea2b None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:02:51.079409 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-cd48b4b7-cfbf-4223-9674-e022abfdea2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:51.082356 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf55d89-6403-4d68-96a6-3b8afa6aa42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:51.083057 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf55d89-6403-4d68-96a6-3b8afa6aa42f admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:51.083342 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf55d89-6403-4d68-96a6-3b8afa6aa42f admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:51.083621 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf55d89-6403-4d68-96a6-3b8afa6aa42f admin admin] PATH_INFO: `/v3/projects/fd03c0233d8f4d3eb7963b37877b7fbd/users/61ae887498014989af26c138858fb472/roles/127fdc7ef05b4e0b98a940b334e5fcab` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:51.101554 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 857/1688] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:02:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:02:51.106582 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31069236-8a55-45ce-9f40-581d4bf602eb None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:51.106868 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31069236-8a55-45ce-9f40-581d4bf602eb None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:51.107146 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31069236-8a55-45ce-9f40-581d4bf602eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:51.121659 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf55d89-6403-4d68-96a6-3b8afa6aa42f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd03c0233d8f4d3eb7963b37877b7fbd, user_id=61ae887498014989af26c138858fb472, role_id=127fdc7ef05b4e0b98a940b334e5fcab)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:51.124731 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf55d89-6403-4d68-96a6-3b8afa6aa42f admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:51.146954 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-31069236-8a55-45ce-9f40-581d4bf602eb None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:02:51.153239 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-31069236-8a55-45ce-9f40-581d4bf602eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:51.183251 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 832/1689] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:02:51 2022] PUT /identity/v3/projects/fd03c0233d8f4d3eb7963b37877b7fbd/users/61ae887498014989af26c138858fb472/roles/127fdc7ef05b4e0b98a940b334e5fcab => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:02:51.183251 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf55d89-6403-4d68-96a6-3b8afa6aa42f admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:51.185896 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-dbf55d89-6403-4d68-96a6-3b8afa6aa42f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:51.292498 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 858/1690] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:02:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:02:51.296861 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31069236-8a55-45ce-9f40-581d4bf602eb None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:51.315190 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31069236-8a55-45ce-9f40-581d4bf602eb None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:51.329305 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b046267-34dc-49e8-806d-e308c416bd56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:51.330265 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b046267-34dc-49e8-806d-e308c416bd56 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:51.330720 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b046267-34dc-49e8-806d-e308c416bd56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:51.331193 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b046267-34dc-49e8-806d-e308c416bd56 admin admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:51.332033 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b046267-34dc-49e8-806d-e308c416bd56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:02:51.332517 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b046267-34dc-49e8-806d-e308c416bd56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:51.334905 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b046267-34dc-49e8-806d-e308c416bd56 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:51.366205 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 859/1691] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Aug 18 11:02:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:02:51.368013 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b046267-34dc-49e8-806d-e308c416bd56 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:51.375224 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-2b046267-34dc-49e8-806d-e308c416bd56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:51.430906 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf55d89-6403-4d68-96a6-3b8afa6aa42f admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:51.437214 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa1eb67-16b5-47b9-a332-feca7a5e5cc6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a005d8f0c46d44c7b6f2201a54717b12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:51.437842 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa1eb67-16b5-47b9-a332-feca7a5e5cc6 service nova] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:51.438126 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa1eb67-16b5-47b9-a332-feca7a5e5cc6 service nova] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:51.438437 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa1eb67-16b5-47b9-a332-feca7a5e5cc6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:51.451179 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-4aa1eb67-16b5-47b9-a332-feca7a5e5cc6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:51.505785 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b046267-34dc-49e8-806d-e308c416bd56 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:51.517425 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cace839-3471-4ce6-bab9-c363d7ef5b18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:51.518353 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cace839-3471-4ce6-bab9-c363d7ef5b18 service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:51.518812 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cace839-3471-4ce6-bab9-c363d7ef5b18 service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:51.519257 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cace839-3471-4ce6-bab9-c363d7ef5b18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:51.540288 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cace839-3471-4ce6-bab9-c363d7ef5b18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:51.542640 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cace839-3471-4ce6-bab9-c363d7ef5b18 service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:51.559651 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:02:51.571778 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 860/1692] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:02:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:02:51.575193 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cace839-3471-4ce6-bab9-c363d7ef5b18 service neutron] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:51.587970 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa1eb67-16b5-47b9-a332-feca7a5e5cc6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:51.589634 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa1eb67-16b5-47b9-a332-feca7a5e5cc6 service nova] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:51.599011 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cace839-3471-4ce6-bab9-c363d7ef5b18 service neutron] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:51.608429 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 833/1693] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:02:51 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:02:51.609437 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa1eb67-16b5-47b9-a332-feca7a5e5cc6 service nova] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:51.612370 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b359320-5b32-497f-824d-e2a1efee04a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:51.613612 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b359320-5b32-497f-824d-e2a1efee04a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:51.614142 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b359320-5b32-497f-824d-e2a1efee04a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:51.614624 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b359320-5b32-497f-824d-e2a1efee04a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:51.615509 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b359320-5b32-497f-824d-e2a1efee04a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:51.622400 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b359320-5b32-497f-824d-e2a1efee04a7 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:51.632415 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa1eb67-16b5-47b9-a332-feca7a5e5cc6 service nova] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:51.646164 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 861/1694] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:02:51 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:02:51.648364 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f933f85c-f43b-4fc4-abc5-f6832b3bc336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:51.649107 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f933f85c-f43b-4fc4-abc5-f6832b3bc336 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:51.649860 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f933f85c-f43b-4fc4-abc5-f6832b3bc336 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:51.649971 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b359320-5b32-497f-824d-e2a1efee04a7 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:51.650337 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f933f85c-f43b-4fc4-abc5-f6832b3bc336 admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:51.651059 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f933f85c-f43b-4fc4-abc5-f6832b3bc336 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:51.653106 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f933f85c-f43b-4fc4-abc5-f6832b3bc336 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:51.656510 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-3b359320-5b32-497f-824d-e2a1efee04a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:51.685476 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b359320-5b32-497f-824d-e2a1efee04a7 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:51.693659 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c1f34-c30b-45ec-aaae-5ff17c082738 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:51.694585 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c1f34-c30b-45ec-aaae-5ff17c082738 service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:51.694874 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c1f34-c30b-45ec-aaae-5ff17c082738 service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:51.695153 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c1f34-c30b-45ec-aaae-5ff17c082738 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:51.719781 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825c1f34-c30b-45ec-aaae-5ff17c082738 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:51.724891 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 834/1695] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:02:51 2022] POST /identity/v3/projects => generated 377 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:02:51.726282 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f933f85c-f43b-4fc4-abc5-f6832b3bc336 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:51.728990 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825c1f34-c30b-45ec-aaae-5ff17c082738 service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:51.760787 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 862/1696] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:02:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:02:51.761573 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c1f34-c30b-45ec-aaae-5ff17c082738 service neutron] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:51.779960 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c1f34-c30b-45ec-aaae-5ff17c082738 service neutron] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:51.909919 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:02:51.942477 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5608b5f9-8d01-4639-b004-9061dc9dc604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:51.943292 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5608b5f9-8d01-4639-b004-9061dc9dc604 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:51.943731 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5608b5f9-8d01-4639-b004-9061dc9dc604 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:51.944194 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5608b5f9-8d01-4639-b004-9061dc9dc604 admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:51.945263 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5608b5f9-8d01-4639-b004-9061dc9dc604 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:51.947290 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5608b5f9-8d01-4639-b004-9061dc9dc604 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:51.951930 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f933f85c-f43b-4fc4-abc5-f6832b3bc336 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:51.982326 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9991da57-1b8e-4bae-94e5-df49babd49a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:51.983073 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9991da57-1b8e-4bae-94e5-df49babd49a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:51.983321 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9991da57-1b8e-4bae-94e5-df49babd49a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:51.983605 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9991da57-1b8e-4bae-94e5-df49babd49a0 admin admin] PATH_INFO: `/v3/projects/fd03c0233d8f4d3eb7963b37877b7fbd/users/61ae887498014989af26c138858fb472/roles/127fdc7ef05b4e0b98a940b334e5fcab` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:51.989733 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9991da57-1b8e-4bae-94e5-df49babd49a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd03c0233d8f4d3eb7963b37877b7fbd, user_id=61ae887498014989af26c138858fb472, role_id=127fdc7ef05b4e0b98a940b334e5fcab)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:52.009406 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9991da57-1b8e-4bae-94e5-df49babd49a0 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:52.032622 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 863/1697] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:02:51 2022] POST /identity/v3/users => generated 289 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:02:52.038783 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a958e6a5-d6d7-4f07-aa78-0974dda2115e None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:52.039079 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a958e6a5-d6d7-4f07-aa78-0974dda2115e None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:52.039361 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a958e6a5-d6d7-4f07-aa78-0974dda2115e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:52.044166 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 835/1698] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:02:51 2022] PUT /identity/v3/projects/fd03c0233d8f4d3eb7963b37877b7fbd/users/61ae887498014989af26c138858fb472/roles/127fdc7ef05b4e0b98a940b334e5fcab => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:02:52.056454 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9991da57-1b8e-4bae-94e5-df49babd49a0 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:52.140578 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-a958e6a5-d6d7-4f07-aa78-0974dda2115e None None] MFA Rules not processed for user `10b548df8cdf40d4879efbd34563385e`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:02:52.157275 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-a958e6a5-d6d7-4f07-aa78-0974dda2115e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:52.286138 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9991da57-1b8e-4bae-94e5-df49babd49a0 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:52.305350 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dd2242-ec4f-4721-b105-832304db2e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:52.307426 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd2242-ec4f-4721-b105-832304db2e70 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:52.309601 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd2242-ec4f-4721-b105-832304db2e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:52.309949 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd2242-ec4f-4721-b105-832304db2e70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:52.311810 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dd2242-ec4f-4721-b105-832304db2e70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:52.315706 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dd2242-ec4f-4721-b105-832304db2e70 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:52.345763 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 836/1699] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:02:52 2022] GET /identity/v3/roles => generated 1420 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:02:52.347126 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da29bb8c-e8e7-43c0-b603-ffe1cf76f3b6 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:52.347514 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da29bb8c-e8e7-43c0-b603-ffe1cf76f3b6 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:52.347894 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da29bb8c-e8e7-43c0-b603-ffe1cf76f3b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:52.364377 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 864/1700] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:02:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:02:52.367350 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a958e6a5-d6d7-4f07-aa78-0974dda2115e None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:52.390235 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a958e6a5-d6d7-4f07-aa78-0974dda2115e None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:52.396345 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3134123a-ab93-4868-9c81-4775e41c6121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:52.397511 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134123a-ab93-4868-9c81-4775e41c6121 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:52.397675 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134123a-ab93-4868-9c81-4775e41c6121 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:52.397917 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134123a-ab93-4868-9c81-4775e41c6121 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:52.398596 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3134123a-ab93-4868-9c81-4775e41c6121 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:52.402458 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3134123a-ab93-4868-9c81-4775e41c6121 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:52.429096 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 865/1701] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:02:52 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:02:52.429096 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca622eb-6ccd-4490-a007-05a2c7377fc5 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:52.429096 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca622eb-6ccd-4490-a007-05a2c7377fc5 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:52.429096 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca622eb-6ccd-4490-a007-05a2c7377fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:52.438855 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-da29bb8c-e8e7-43c0-b603-ffe1cf76f3b6 None None] MFA Rules not processed for user `61ae887498014989af26c138858fb472`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:02:52.445322 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-da29bb8c-e8e7-43c0-b603-ffe1cf76f3b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:52.464550 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-bca622eb-6ccd-4490-a007-05a2c7377fc5 None None] MFA Rules not processed for user `10b548df8cdf40d4879efbd34563385e`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:02:52.466826 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-bca622eb-6ccd-4490-a007-05a2c7377fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:52.482722 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 866/1702] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:02:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:02:52.483815 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca622eb-6ccd-4490-a007-05a2c7377fc5 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:52.504167 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca622eb-6ccd-4490-a007-05a2c7377fc5 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:52.511978 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7709ac0e-f5fa-4ef6-87a9-df5528f36689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:52.512813 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709ac0e-f5fa-4ef6-87a9-df5528f36689 admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:52.513152 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709ac0e-f5fa-4ef6-87a9-df5528f36689 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:52.513394 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709ac0e-f5fa-4ef6-87a9-df5528f36689 admin admin] PATH_INFO: `/v3/projects/7e40edb5ccb64e85a5421b0f1ff062fc/users/2b23ba0b4b6b469999dbae5bce051526/roles/719e5c62188d4f8a838987d6e72ca8f7` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:52.540283 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7709ac0e-f5fa-4ef6-87a9-df5528f36689 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e40edb5ccb64e85a5421b0f1ff062fc, user_id=2b23ba0b4b6b469999dbae5bce051526, role_id=719e5c62188d4f8a838987d6e72ca8f7)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:52.545086 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7709ac0e-f5fa-4ef6-87a9-df5528f36689 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:52.573414 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 867/1703] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:02:52 2022] PUT /identity/v3/projects/7e40edb5ccb64e85a5421b0f1ff062fc/users/2b23ba0b4b6b469999dbae5bce051526/roles/719e5c62188d4f8a838987d6e72ca8f7 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:02:52.574327 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7709ac0e-f5fa-4ef6-87a9-df5528f36689 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:52.580383 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-7709ac0e-f5fa-4ef6-87a9-df5528f36689 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:52.624348 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:02:52.658952 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 837/1704] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:02:52 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:02:52.666832 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3533a596-e67a-4d22-9ecd-ddbcd4688c2c None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:52.668522 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3533a596-e67a-4d22-9ecd-ddbcd4688c2c None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:52.668901 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3533a596-e67a-4d22-9ecd-ddbcd4688c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:52.754585 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-3533a596-e67a-4d22-9ecd-ddbcd4688c2c None None] MFA Rules not processed for user `2b23ba0b4b6b469999dbae5bce051526`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:02:52.756594 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-3533a596-e67a-4d22-9ecd-ddbcd4688c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:52.798344 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7709ac0e-f5fa-4ef6-87a9-df5528f36689 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:52.812310 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ff92a-ba3b-4750-8721-f71b24c8c261 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a005d8f0c46d44c7b6f2201a54717b12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:52.812642 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ff92a-ba3b-4750-8721-f71b24c8c261 service nova] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:52.812949 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ff92a-ba3b-4750-8721-f71b24c8c261 service nova] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:52.813195 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ff92a-ba3b-4750-8721-f71b24c8c261 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:52.842415 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:02:52.866704 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 838/1705] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:02:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:02:52.868165 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3533a596-e67a-4d22-9ecd-ddbcd4688c2c None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:52.869957 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-3533a596-e67a-4d22-9ecd-ddbcd4688c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:52.964538 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3533a596-e67a-4d22-9ecd-ddbcd4688c2c None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:52.969964 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2067a9b5-f4cc-44cf-9d21-77a3820966e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b8a09704b9b4ab2bffb813796ec6e77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:52.970944 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2067a9b5-f4cc-44cf-9d21-77a3820966e6 service cinder] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:52.971446 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2067a9b5-f4cc-44cf-9d21-77a3820966e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:52.972360 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2067a9b5-f4cc-44cf-9d21-77a3820966e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:52.985219 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670ff92a-ba3b-4750-8721-f71b24c8c261 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:52.986901 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670ff92a-ba3b-4750-8721-f71b24c8c261 service nova] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:53.032434 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 868/1706] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:02:52 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:02:53.064551 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2067a9b5-f4cc-44cf-9d21-77a3820966e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:53.065608 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246c388-523d-4175-8ce4-bcc11c2ec20b None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:53.066639 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2067a9b5-f4cc-44cf-9d21-77a3820966e6 service cinder] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:53.066926 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246c388-523d-4175-8ce4-bcc11c2ec20b None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:53.067360 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246c388-523d-4175-8ce4-bcc11c2ec20b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:53.084541 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 839/1707] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:02:52 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:02:53.086035 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2067a9b5-f4cc-44cf-9d21-77a3820966e6 service cinder] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:53.164242 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-7246c388-523d-4175-8ce4-bcc11c2ec20b None None] MFA Rules not processed for user `7dc5501d59fb4593b405f0e9bd2e49ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:02:53.165954 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-7246c388-523d-4175-8ce4-bcc11c2ec20b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:53.217817 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2067a9b5-f4cc-44cf-9d21-77a3820966e6 service cinder] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:53.219771 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587ccfe6-521d-4905-a4af-350bd603d784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:53.220674 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ccfe6-521d-4905-a4af-350bd603d784 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:53.220941 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ccfe6-521d-4905-a4af-350bd603d784 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:53.221215 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ccfe6-521d-4905-a4af-350bd603d784 admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:53.221880 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587ccfe6-521d-4905-a4af-350bd603d784 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:53.224117 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587ccfe6-521d-4905-a4af-350bd603d784 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:53.272326 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 840/1708] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:02:53 2022] POST /identity/v3/projects => generated 379 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:02:53.272326 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587ccfe6-521d-4905-a4af-350bd603d784 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:53.272837 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-587ccfe6-521d-4905-a4af-350bd603d784 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:53.322194 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:02:53.367212 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587ccfe6-521d-4905-a4af-350bd603d784 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:53.373096 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157255d9-39ac-4e47-95a1-c85918681c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:53.373973 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157255d9-39ac-4e47-95a1-c85918681c9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:53.374352 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157255d9-39ac-4e47-95a1-c85918681c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:53.374725 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157255d9-39ac-4e47-95a1-c85918681c9c admin admin] PATH_INFO: `/v3/projects/577132f31a0d4c609b927067d45f3105` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:53.376810 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157255d9-39ac-4e47-95a1-c85918681c9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=577132f31a0d4c609b927067d45f3105)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:53.379402 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157255d9-39ac-4e47-95a1-c85918681c9c admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:53.435518 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 869/1709] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:02:53 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:02:53.445333 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7246c388-523d-4175-8ce4-bcc11c2ec20b None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:53.464210 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-157255d9-39ac-4e47-95a1-c85918681c9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '577132f31a0d4c609b927067d45f3105', 'request_id': 'req-157255d9-39ac-4e47-95a1-c85918681c9c'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:02:53.477197 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-157255d9-39ac-4e47-95a1-c85918681c9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '577132f31a0d4c609b927067d45f3105', 'request_id': 'req-157255d9-39ac-4e47-95a1-c85918681c9c'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:02:53.484645 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7246c388-523d-4175-8ce4-bcc11c2ec20b None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:53.493393 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-157255d9-39ac-4e47-95a1-c85918681c9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '577132f31a0d4c609b927067d45f3105', 'request_id': 'req-157255d9-39ac-4e47-95a1-c85918681c9c'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:02:53.520667 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-157255d9-39ac-4e47-95a1-c85918681c9c admin admin] The token cache is being invalidate because project 577132f31a0d4c609b927067d45f3105 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:02:53.522051 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-157255d9-39ac-4e47-95a1-c85918681c9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:02:53.523322 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-157255d9-39ac-4e47-95a1-c85918681c9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:02:53.530546 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 841/1710] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:02:53 2022] DELETE /identity/v3/projects/577132f31a0d4c609b927067d45f3105 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:02:53.531908 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157255d9-39ac-4e47-95a1-c85918681c9c admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:53.539200 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-157255d9-39ac-4e47-95a1-c85918681c9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:53.580023 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:02:53.622355 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95008048-cb3e-4c4d-9c0a-99754448e86f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:53.623003 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95008048-cb3e-4c4d-9c0a-99754448e86f admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:53.623435 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95008048-cb3e-4c4d-9c0a-99754448e86f admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:53.623722 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95008048-cb3e-4c4d-9c0a-99754448e86f admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:53.624376 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95008048-cb3e-4c4d-9c0a-99754448e86f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:53.626647 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95008048-cb3e-4c4d-9c0a-99754448e86f admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:53.667443 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 870/1711] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:02:53 2022] POST /identity/v3/users => generated 290 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:02:53.671869 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961e3ae4-00ed-49f8-afd7-e6f0fe1b5be8 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:53.672228 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961e3ae4-00ed-49f8-afd7-e6f0fe1b5be8 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:53.672428 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961e3ae4-00ed-49f8-afd7-e6f0fe1b5be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:53.698869 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157255d9-39ac-4e47-95a1-c85918681c9c admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:53.713457 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-961e3ae4-00ed-49f8-afd7-e6f0fe1b5be8 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:02:53.713913 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc0ae4b-6060-490f-8d28-fcabf8fdb539 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b8a09704b9b4ab2bffb813796ec6e77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:53.714733 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-961e3ae4-00ed-49f8-afd7-e6f0fe1b5be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:53.715552 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc0ae4b-6060-490f-8d28-fcabf8fdb539 service cinder] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:53.719362 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc0ae4b-6060-490f-8d28-fcabf8fdb539 service cinder] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:53.722295 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc0ae4b-6060-490f-8d28-fcabf8fdb539 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:53.727110 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-efc0ae4b-6060-490f-8d28-fcabf8fdb539 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:53.728764 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 871/1712] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:02:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:02:53.729659 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961e3ae4-00ed-49f8-afd7-e6f0fe1b5be8 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:53.731109 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-961e3ae4-00ed-49f8-afd7-e6f0fe1b5be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:53.748175 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961e3ae4-00ed-49f8-afd7-e6f0fe1b5be8 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:53.756701 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19b70ed-7140-48b6-927f-f549f0bd3e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:53.756856 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b70ed-7140-48b6-927f-f549f0bd3e29 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:53.757133 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b70ed-7140-48b6-927f-f549f0bd3e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:53.757601 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b70ed-7140-48b6-927f-f549f0bd3e29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:53.758310 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19b70ed-7140-48b6-927f-f549f0bd3e29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:53.759916 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19b70ed-7140-48b6-927f-f549f0bd3e29 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:53.791330 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 872/1713] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:02:53 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:02:53.792445 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa5bf52-b169-49bf-8af3-5736586314ee None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:53.792730 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa5bf52-b169-49bf-8af3-5736586314ee None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:53.793004 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa5bf52-b169-49bf-8af3-5736586314ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:53.846548 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-9fa5bf52-b169-49bf-8af3-5736586314ee None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:02:53.847785 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-9fa5bf52-b169-49bf-8af3-5736586314ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:53.872172 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 873/1714] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:02:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:02:53.873113 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa5bf52-b169-49bf-8af3-5736586314ee None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:53.874857 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc0ae4b-6060-490f-8d28-fcabf8fdb539 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:53.891286 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa5bf52-b169-49bf-8af3-5736586314ee None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:53.892463 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc0ae4b-6060-490f-8d28-fcabf8fdb539 service cinder] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:53.899911 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6fd817-7bd5-4513-bdd6-02160e2d0bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:53.900672 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6fd817-7bd5-4513-bdd6-02160e2d0bba admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:53.901133 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6fd817-7bd5-4513-bdd6-02160e2d0bba admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:53.901615 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6fd817-7bd5-4513-bdd6-02160e2d0bba admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:53.902298 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6fd817-7bd5-4513-bdd6-02160e2d0bba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:53.905454 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6fd817-7bd5-4513-bdd6-02160e2d0bba admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:53.915032 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 842/1715] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:02:53 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:02:53.930594 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad225ffb-96b9-497a-94a1-e0d0db51895d None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:53.933728 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad225ffb-96b9-497a-94a1-e0d0db51895d None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:53.933861 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 874/1716] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:02:53 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:02:53.934768 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6fd817-7bd5-4513-bdd6-02160e2d0bba admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:53.935262 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad225ffb-96b9-497a-94a1-e0d0db51895d None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:53.939082 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 843/1717] 10.222.0.15 () {54 vars in 912 bytes} [Thu Aug 18 11:02:53 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:02:53.940149 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad225ffb-96b9-497a-94a1-e0d0db51895d None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:53.960317 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6fd817-7bd5-4513-bdd6-02160e2d0bba admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:53.973388 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad225ffb-96b9-497a-94a1-e0d0db51895d None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:53.978103 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f5ee88-5e04-4ece-9bb5-641e3b0eba13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:53.978722 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f5ee88-5e04-4ece-9bb5-641e3b0eba13 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:53.979002 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f5ee88-5e04-4ece-9bb5-641e3b0eba13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:53.979274 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f5ee88-5e04-4ece-9bb5-641e3b0eba13 admin admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:53.979937 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f5ee88-5e04-4ece-9bb5-641e3b0eba13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:02:53.980236 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f5ee88-5e04-4ece-9bb5-641e3b0eba13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:53.981933 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f5ee88-5e04-4ece-9bb5-641e3b0eba13 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:53.989211 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd728546-933c-4779-a76b-c3de305f3eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:53.990950 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd728546-933c-4779-a76b-c3de305f3eb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:53.993011 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd728546-933c-4779-a76b-c3de305f3eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:53.993809 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd728546-933c-4779-a76b-c3de305f3eb8 admin admin] PATH_INFO: `/v3/projects/8765465a0c144fa1b88dbdf014f96719/users/c9937dd509954622949e8fe852201d4e/roles/719e5c62188d4f8a838987d6e72ca8f7` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:54.012222 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 875/1718] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Aug 18 11:02:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:02:54.013469 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348ee97-4c57-4a03-9dce-a26a51bf261a None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:54.013789 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348ee97-4c57-4a03-9dce-a26a51bf261a None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:54.014064 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348ee97-4c57-4a03-9dce-a26a51bf261a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:54.017671 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:02:54.061930 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd728546-933c-4779-a76b-c3de305f3eb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8765465a0c144fa1b88dbdf014f96719, user_id=c9937dd509954622949e8fe852201d4e, role_id=719e5c62188d4f8a838987d6e72ca8f7)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:54.070600 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd728546-933c-4779-a76b-c3de305f3eb8 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:54.104237 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 844/1719] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:02:53 2022] PUT /identity/v3/projects/8765465a0c144fa1b88dbdf014f96719/users/c9937dd509954622949e8fe852201d4e/roles/719e5c62188d4f8a838987d6e72ca8f7 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:02:54.105583 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd728546-933c-4779-a76b-c3de305f3eb8 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:54.108030 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-0348ee97-4c57-4a03-9dce-a26a51bf261a None None] MFA Rules not processed for user `86c2cd74178f443d9c2398ff8e00cccc`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:02:54.109808 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-0348ee97-4c57-4a03-9dce-a26a51bf261a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:54.234332 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 876/1720] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Aug 18 11:02:54 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:02:54.235793 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c6872-a7ef-474e-8a8a-d48cf13f6ae1 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:54.236252 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c6872-a7ef-474e-8a8a-d48cf13f6ae1 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:54.236680 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c6872-a7ef-474e-8a8a-d48cf13f6ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:54.354052 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-cd6c6872-a7ef-474e-8a8a-d48cf13f6ae1 None None] MFA Rules not processed for user `c9937dd509954622949e8fe852201d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:02:54.357667 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-cd6c6872-a7ef-474e-8a8a-d48cf13f6ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:54.397456 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd728546-933c-4779-a76b-c3de305f3eb8 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:54.407284 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971815c9-d460-44d4-9c62-d9ad94f860d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:54.408189 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971815c9-d460-44d4-9c62-d9ad94f860d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:54.408542 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971815c9-d460-44d4-9c62-d9ad94f860d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:54.408884 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971815c9-d460-44d4-9c62-d9ad94f860d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:54.410168 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971815c9-d460-44d4-9c62-d9ad94f860d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:54.414075 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971815c9-d460-44d4-9c62-d9ad94f860d5 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:54.456116 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 845/1721] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:02:54 2022] POST /identity/v3/projects => generated 403 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:02:54.457209 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971815c9-d460-44d4-9c62-d9ad94f860d5 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:54.460192 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-971815c9-d460-44d4-9c62-d9ad94f860d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:54.513565 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 877/1722] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:02:54 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:02:54.514437 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6c6872-a7ef-474e-8a8a-d48cf13f6ae1 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:54.515769 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-cd6c6872-a7ef-474e-8a8a-d48cf13f6ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:54.534698 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6c6872-a7ef-474e-8a8a-d48cf13f6ae1 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:54.539965 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:02:54.588989 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971815c9-d460-44d4-9c62-d9ad94f860d5 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:54.594376 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7019af64-fc14-4835-8787-a459d2ff5b7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:54.599159 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7019af64-fc14-4835-8787-a459d2ff5b7b service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:54.600146 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7019af64-fc14-4835-8787-a459d2ff5b7b service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:54.600436 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7019af64-fc14-4835-8787-a459d2ff5b7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:54.613832 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7019af64-fc14-4835-8787-a459d2ff5b7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:54.621552 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7019af64-fc14-4835-8787-a459d2ff5b7b service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:54.634695 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 846/1723] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:02:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:02:54.635562 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7019af64-fc14-4835-8787-a459d2ff5b7b service neutron] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:54.745594 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7d0054-ab7e-4bcd-9324-9f17de0df922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:54.746414 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d0054-ab7e-4bcd-9324-9f17de0df922 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:54.746522 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d0054-ab7e-4bcd-9324-9f17de0df922 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:54.746768 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d0054-ab7e-4bcd-9324-9f17de0df922 admin admin] PATH_INFO: `/v3/projects/83c296e31a604c23b028c480c90270b4` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:54.748035 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7d0054-ab7e-4bcd-9324-9f17de0df922 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83c296e31a604c23b028c480c90270b4)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:54.751401 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7d0054-ab7e-4bcd-9324-9f17de0df922 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:54.801334 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7019af64-fc14-4835-8787-a459d2ff5b7b service neutron] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:54.816232 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ff0841-a3ce-4f5b-965c-8e3c0d700356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:54.820131 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ff0841-a3ce-4f5b-965c-8e3c0d700356 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:54.820725 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ff0841-a3ce-4f5b-965c-8e3c0d700356 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:54.820725 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ff0841-a3ce-4f5b-965c-8e3c0d700356 admin admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:54.825826 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ff0841-a3ce-4f5b-965c-8e3c0d700356 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:54.829180 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ff0841-a3ce-4f5b-965c-8e3c0d700356 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:54.879515 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 847/1724] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:02:54 2022] POST /identity/v3/users => generated 302 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:02:54.880371 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ff0841-a3ce-4f5b-965c-8e3c0d700356 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:54.881307 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-fe7d0054-ab7e-4bcd-9324-9f17de0df922 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83c296e31a604c23b028c480c90270b4', 'request_id': 'req-fe7d0054-ab7e-4bcd-9324-9f17de0df922'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:02:54.895977 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:02:54.903140 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-fe7d0054-ab7e-4bcd-9324-9f17de0df922 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83c296e31a604c23b028c480c90270b4', 'request_id': 'req-fe7d0054-ab7e-4bcd-9324-9f17de0df922'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:02:54.904307 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ff0841-a3ce-4f5b-965c-8e3c0d700356 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:54.912768 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-fe7d0054-ab7e-4bcd-9324-9f17de0df922 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83c296e31a604c23b028c480c90270b4', 'request_id': 'req-fe7d0054-ab7e-4bcd-9324-9f17de0df922'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:02:54.953484 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-fe7d0054-ab7e-4bcd-9324-9f17de0df922 admin admin] The token cache is being invalidate because project 83c296e31a604c23b028c480c90270b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:02:54.954350 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-fe7d0054-ab7e-4bcd-9324-9f17de0df922 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:02:54.955681 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-fe7d0054-ab7e-4bcd-9324-9f17de0df922 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:02:54.958357 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 878/1725] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:02:54 2022] DELETE /identity/v3/projects/83c296e31a604c23b028c480c90270b4 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:02:54.959889 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa1a6bd-582b-4613-9144-ab1584c09a52 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:54.961710 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa1a6bd-582b-4613-9144-ab1584c09a52 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:54.962079 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa1a6bd-582b-4613-9144-ab1584c09a52 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:54.965809 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 879/1726] 10.222.0.15 () {54 vars in 912 bytes} [Thu Aug 18 11:02:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:02:54.967569 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa1a6bd-582b-4613-9144-ab1584c09a52 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:54.971730 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-baa1a6bd-582b-4613-9144-ab1584c09a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:55.035140 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6396701a-fee9-41dc-be48-feb2dedf993b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:55.035745 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6396701a-fee9-41dc-be48-feb2dedf993b admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:55.036024 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6396701a-fee9-41dc-be48-feb2dedf993b admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:55.036298 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6396701a-fee9-41dc-be48-feb2dedf993b admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:55.036998 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6396701a-fee9-41dc-be48-feb2dedf993b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:55.039348 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6396701a-fee9-41dc-be48-feb2dedf993b admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:55.104501 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 848/1727] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:02:54 2022] POST /identity/v3/projects => generated 379 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:02:55.109609 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e11bd-6dfa-4652-b8a6-5114c386fbfd None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:55.109900 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e11bd-6dfa-4652-b8a6-5114c386fbfd None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:55.110199 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e11bd-6dfa-4652-b8a6-5114c386fbfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:55.135725 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-e90e11bd-6dfa-4652-b8a6-5114c386fbfd None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:02:55.137356 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-e90e11bd-6dfa-4652-b8a6-5114c386fbfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:55.172991 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa1a6bd-582b-4613-9144-ab1584c09a52 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:55.281104 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:02:55.298928 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 849/1728] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:02:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:02:55.300407 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f394c16a-76b1-4c7b-8a0e-78535dba5c4e None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:55.300739 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f394c16a-76b1-4c7b-8a0e-78535dba5c4e None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:55.301012 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f394c16a-76b1-4c7b-8a0e-78535dba5c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:55.316080 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f208857b-6567-4823-8e38-0457a235bb50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:55.316718 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f208857b-6567-4823-8e38-0457a235bb50 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:55.317004 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f208857b-6567-4823-8e38-0457a235bb50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:55.317282 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f208857b-6567-4823-8e38-0457a235bb50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:55.318640 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f208857b-6567-4823-8e38-0457a235bb50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:55.320768 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f208857b-6567-4823-8e38-0457a235bb50 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:55.336946 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-f394c16a-76b1-4c7b-8a0e-78535dba5c4e None None] MFA Rules not processed for user `86c2cd74178f443d9c2398ff8e00cccc`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:02:55.338184 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-f394c16a-76b1-4c7b-8a0e-78535dba5c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:55.346284 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 880/1729] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:02:54 2022] GET /identity/v3/roles => generated 1420 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:02:55.347367 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f208857b-6567-4823-8e38-0457a235bb50 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:55.357337 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-f208857b-6567-4823-8e38-0457a235bb50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:55.386230 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f208857b-6567-4823-8e38-0457a235bb50 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:55.401905 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cacebde-c8cb-4acd-acdb-d0fd60ea630d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:55.403025 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cacebde-c8cb-4acd-acdb-d0fd60ea630d admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:55.403465 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cacebde-c8cb-4acd-acdb-d0fd60ea630d admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:55.403904 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cacebde-c8cb-4acd-acdb-d0fd60ea630d admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:55.404698 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cacebde-c8cb-4acd-acdb-d0fd60ea630d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:55.406849 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cacebde-c8cb-4acd-acdb-d0fd60ea630d admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:55.457353 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 881/1730] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:02:55 2022] POST /identity/v3/users => generated 296 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:02:55.461102 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90580cc6-275e-41db-a167-2aea88c5beab None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:55.461102 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90580cc6-275e-41db-a167-2aea88c5beab None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:55.461393 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90580cc6-275e-41db-a167-2aea88c5beab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:55.513119 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-90580cc6-275e-41db-a167-2aea88c5beab None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:02:55.514394 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-90580cc6-275e-41db-a167-2aea88c5beab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:55.522227 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 850/1731] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Aug 18 11:02:55 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:02:55.538893 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 882/1732] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:02:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:02:55.539889 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90580cc6-275e-41db-a167-2aea88c5beab None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:55.548491 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f394c16a-76b1-4c7b-8a0e-78535dba5c4e None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:55.561651 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90580cc6-275e-41db-a167-2aea88c5beab None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:55.568461 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f394c16a-76b1-4c7b-8a0e-78535dba5c4e None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:55.578652 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1429418a-3fd6-4715-ba37-9431d3367f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:55.578652 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1429418a-3fd6-4715-ba37-9431d3367f9b admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:55.578652 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1429418a-3fd6-4715-ba37-9431d3367f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:55.578652 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1429418a-3fd6-4715-ba37-9431d3367f9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:55.579055 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1429418a-3fd6-4715-ba37-9431d3367f9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:55.579055 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1429418a-3fd6-4715-ba37-9431d3367f9b admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:55.589020 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4311e672-5175-4994-a8bc-ab7e8d4d695a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:55.589798 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4311e672-5175-4994-a8bc-ab7e8d4d695a admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:55.590088 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4311e672-5175-4994-a8bc-ab7e8d4d695a admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:55.590367 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4311e672-5175-4994-a8bc-ab7e8d4d695a admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:55.591023 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4311e672-5175-4994-a8bc-ab7e8d4d695a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:55.609642 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4311e672-5175-4994-a8bc-ab7e8d4d695a admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:55.623014 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 883/1733] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:02:55 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:02:55.642525 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1429418a-3fd6-4715-ba37-9431d3367f9b admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:55.646956 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-1429418a-3fd6-4715-ba37-9431d3367f9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:55.651474 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 851/1734] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:02:55 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:02:55.655664 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4311e672-5175-4994-a8bc-ab7e8d4d695a admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:55.687215 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4311e672-5175-4994-a8bc-ab7e8d4d695a admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:55.710126 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea1ba73-0d8f-427e-bf4e-b36c4face6ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:55.710788 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea1ba73-0d8f-427e-bf4e-b36c4face6ad admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:55.711081 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea1ba73-0d8f-427e-bf4e-b36c4face6ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:55.718422 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea1ba73-0d8f-427e-bf4e-b36c4face6ad admin admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:55.720468 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea1ba73-0d8f-427e-bf4e-b36c4face6ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:02:55.724043 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea1ba73-0d8f-427e-bf4e-b36c4face6ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:55.726624 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea1ba73-0d8f-427e-bf4e-b36c4face6ad admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:55.763580 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 852/1735] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Aug 18 11:02:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:02:55.766146 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea1ba73-0d8f-427e-bf4e-b36c4face6ad admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:55.775709 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-cea1ba73-0d8f-427e-bf4e-b36c4face6ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:55.802532 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea1ba73-0d8f-427e-bf4e-b36c4face6ad admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:55.814639 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87592f8-1a31-48ac-a6e8-d841ebe5240b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:55.816392 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87592f8-1a31-48ac-a6e8-d841ebe5240b service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:55.817552 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87592f8-1a31-48ac-a6e8-d841ebe5240b service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:55.818268 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87592f8-1a31-48ac-a6e8-d841ebe5240b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:55.837448 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87592f8-1a31-48ac-a6e8-d841ebe5240b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:55.840433 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87592f8-1a31-48ac-a6e8-d841ebe5240b service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:55.860869 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 853/1736] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:02:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:02:55.863295 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87592f8-1a31-48ac-a6e8-d841ebe5240b service neutron] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:55.867875 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1429418a-3fd6-4715-ba37-9431d3367f9b admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:55.881952 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:02:55.890492 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c414463c-ab3d-48c8-8ede-11d3ca24043c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a005d8f0c46d44c7b6f2201a54717b12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:55.891177 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c414463c-ab3d-48c8-8ede-11d3ca24043c service nova] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:55.891391 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c414463c-ab3d-48c8-8ede-11d3ca24043c service nova] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:55.891675 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c414463c-ab3d-48c8-8ede-11d3ca24043c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:55.893717 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87592f8-1a31-48ac-a6e8-d841ebe5240b service neutron] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:55.897344 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-c414463c-ab3d-48c8-8ede-11d3ca24043c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:55.906144 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e6e0ae-d34f-4dbe-bcff-33c3b40c7fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:55.906848 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e6e0ae-d34f-4dbe-bcff-33c3b40c7fea admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:55.907127 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e6e0ae-d34f-4dbe-bcff-33c3b40c7fea admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:55.907406 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e6e0ae-d34f-4dbe-bcff-33c3b40c7fea admin admin] PATH_INFO: `/v3/projects/768b8aefc21d45bfbccee8ee11dd0906/users/0343900ed31d47a187aea1a982f2d9a3/roles/127fdc7ef05b4e0b98a940b334e5fcab` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:55.956240 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e6e0ae-d34f-4dbe-bcff-33c3b40c7fea admin admin] RBAC: Authorizing `identity:create_grant(project_id=768b8aefc21d45bfbccee8ee11dd0906, user_id=0343900ed31d47a187aea1a982f2d9a3, role_id=127fdc7ef05b4e0b98a940b334e5fcab)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:55.964773 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e6e0ae-d34f-4dbe-bcff-33c3b40c7fea admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:56.012661 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 854/1737] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:02:55 2022] PUT /identity/v3/projects/768b8aefc21d45bfbccee8ee11dd0906/users/0343900ed31d47a187aea1a982f2d9a3/roles/127fdc7ef05b4e0b98a940b334e5fcab => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:02:56.012661 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e6e0ae-d34f-4dbe-bcff-33c3b40c7fea admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:56.055544 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c414463c-ab3d-48c8-8ede-11d3ca24043c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:56.057582 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c414463c-ab3d-48c8-8ede-11d3ca24043c service nova] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:56.070802 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 884/1738] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:02:55 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:02:56.072544 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cc8333-e518-4161-9528-2e7611130ce5 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:56.073042 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cc8333-e518-4161-9528-2e7611130ce5 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:56.073742 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cc8333-e518-4161-9528-2e7611130ce5 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:56.080757 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 885/1739] 10.222.0.15 () {54 vars in 961 bytes} [Thu Aug 18 11:02:56 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:02:56.082104 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cc8333-e518-4161-9528-2e7611130ce5 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:56.150249 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:02:56.193473 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e6e0ae-d34f-4dbe-bcff-33c3b40c7fea admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:56.201639 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cc8333-e518-4161-9528-2e7611130ce5 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:56.207866 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5679c89d-0003-4b05-ad41-7752148b2b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:56.208735 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5679c89d-0003-4b05-ad41-7752148b2b37 admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:56.209215 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5679c89d-0003-4b05-ad41-7752148b2b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:56.209970 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5679c89d-0003-4b05-ad41-7752148b2b37 admin admin] PATH_INFO: `/v3/projects/86dd669dc79b4a83828293245dd9fa71/users/6cfd46073f6b44ef8d7353b5527acfa3/roles/719e5c62188d4f8a838987d6e72ca8f7` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:56.218282 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b10c0ec-1a53-46de-b999-962d9c65f4a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:56.221858 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10c0ec-1a53-46de-b999-962d9c65f4a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:56.222230 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10c0ec-1a53-46de-b999-962d9c65f4a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:56.222575 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10c0ec-1a53-46de-b999-962d9c65f4a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:56.225808 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b10c0ec-1a53-46de-b999-962d9c65f4a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:56.230754 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b10c0ec-1a53-46de-b999-962d9c65f4a6 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:56.254635 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5679c89d-0003-4b05-ad41-7752148b2b37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86dd669dc79b4a83828293245dd9fa71, user_id=6cfd46073f6b44ef8d7353b5527acfa3, role_id=719e5c62188d4f8a838987d6e72ca8f7)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:56.270153 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5679c89d-0003-4b05-ad41-7752148b2b37 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:56.305670 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 855/1740] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:02:56 2022] PUT /identity/v3/projects/86dd669dc79b4a83828293245dd9fa71/users/6cfd46073f6b44ef8d7353b5527acfa3/roles/719e5c62188d4f8a838987d6e72ca8f7 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:02:56.305670 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5679c89d-0003-4b05-ad41-7752148b2b37 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:56.309039 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 886/1741] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:02:56 2022] POST /identity/v3/projects => generated 405 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:02:56.312970 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a3b2d7-b2a3-4d27-a93d-2ff884092895 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:56.313950 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a3b2d7-b2a3-4d27-a93d-2ff884092895 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:56.314902 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a3b2d7-b2a3-4d27-a93d-2ff884092895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:56.360484 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-f4a3b2d7-b2a3-4d27-a93d-2ff884092895 None None] MFA Rules not processed for user `0f918bcdd83d4d48be3fff5a48c54929`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:02:56.361760 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-f4a3b2d7-b2a3-4d27-a93d-2ff884092895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:56.387129 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5679c89d-0003-4b05-ad41-7752148b2b37 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:56.439109 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 887/1742] 10.222.0.15 () {58 vars in 1058 bytes} [Thu Aug 18 11:02:56 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:02:56.452172 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a3b2d7-b2a3-4d27-a93d-2ff884092895 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:56.534911 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc81673c-0761-4cdb-ac08-4ff46cc874a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:56.535542 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81673c-0761-4cdb-ac08-4ff46cc874a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:56.535822 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81673c-0761-4cdb-ac08-4ff46cc874a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:56.536090 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81673c-0761-4cdb-ac08-4ff46cc874a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:56.537309 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc81673c-0761-4cdb-ac08-4ff46cc874a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:56.540653 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc81673c-0761-4cdb-ac08-4ff46cc874a1 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:56.581320 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 856/1743] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:02:56 2022] GET /identity/v3/roles => generated 1420 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:02:56.583119 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27f76c8-d1f5-4e35-9f17-954934353bbd None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:56.583404 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27f76c8-d1f5-4e35-9f17-954934353bbd None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:56.583740 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27f76c8-d1f5-4e35-9f17-954934353bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:56.630256 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:02:56.631415 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a3b2d7-b2a3-4d27-a93d-2ff884092895 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:56.642079 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec0f75d-fc01-4d4c-be67-df9b182c8ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:56.642971 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec0f75d-fc01-4d4c-be67-df9b182c8ece admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:56.644178 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec0f75d-fc01-4d4c-be67-df9b182c8ece admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:56.649174 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec0f75d-fc01-4d4c-be67-df9b182c8ece admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:56.650707 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec0f75d-fc01-4d4c-be67-df9b182c8ece admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:56.652848 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec0f75d-fc01-4d4c-be67-df9b182c8ece admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:56.665389 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-f27f76c8-d1f5-4e35-9f17-954934353bbd None None] MFA Rules not processed for user `6cfd46073f6b44ef8d7353b5527acfa3`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:02:56.666679 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-f27f76c8-d1f5-4e35-9f17-954934353bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:56.714808 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 888/1744] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:02:56 2022] POST /identity/v3/users => generated 303 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:02:56.715802 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec0f75d-fc01-4d4c-be67-df9b182c8ece admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:56.753393 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec0f75d-fc01-4d4c-be67-df9b182c8ece admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:56.770498 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31548f5-bae9-4536-a598-488fc9269e21 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f918bcdd83d4d48be3fff5a48c54929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:56.771228 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31548f5-bae9-4536-a598-488fc9269e21 service placement] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:56.771512 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31548f5-bae9-4536-a598-488fc9269e21 service placement] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:56.771787 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31548f5-bae9-4536-a598-488fc9269e21 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:56.775914 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-a31548f5-bae9-4536-a598-488fc9269e21 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:56.801825 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31548f5-bae9-4536-a598-488fc9269e21 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:56.803986 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31548f5-bae9-4536-a598-488fc9269e21 service placement] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:56.869165 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 889/1745] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:02:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:02:56.870055 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31548f5-bae9-4536-a598-488fc9269e21 service placement] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:56.910602 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 857/1746] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:02:56 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:02:56.914121 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957b2af1-d62b-4787-8af1-5e5588bc858d None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:56.914421 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957b2af1-d62b-4787-8af1-5e5588bc858d None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:56.914700 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957b2af1-d62b-4787-8af1-5e5588bc858d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:56.917194 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31548f5-bae9-4536-a598-488fc9269e21 service placement] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:56.944639 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9342e9b-999c-4cdc-b2fd-e4abb2ee9dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:56.945330 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9342e9b-999c-4cdc-b2fd-e4abb2ee9dde admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:56.945635 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9342e9b-999c-4cdc-b2fd-e4abb2ee9dde admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:56.946322 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9342e9b-999c-4cdc-b2fd-e4abb2ee9dde admin admin] PATH_INFO: `/v3/projects/768b8aefc21d45bfbccee8ee11dd0906/users/0343900ed31d47a187aea1a982f2d9a3/roles/127fdc7ef05b4e0b98a940b334e5fcab` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:56.961328 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9342e9b-999c-4cdc-b2fd-e4abb2ee9dde admin admin] RBAC: Authorizing `identity:create_grant(project_id=768b8aefc21d45bfbccee8ee11dd0906, user_id=0343900ed31d47a187aea1a982f2d9a3, role_id=127fdc7ef05b4e0b98a940b334e5fcab)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:56.966903 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9342e9b-999c-4cdc-b2fd-e4abb2ee9dde admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:57.006946 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-957b2af1-d62b-4787-8af1-5e5588bc858d None None] MFA Rules not processed for user `074cfcc7943349a490b29cd4ae3364cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:02:57.009983 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-957b2af1-d62b-4787-8af1-5e5588bc858d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:57.027021 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 890/1747] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:02:56 2022] PUT /identity/v3/projects/768b8aefc21d45bfbccee8ee11dd0906/users/0343900ed31d47a187aea1a982f2d9a3/roles/127fdc7ef05b4e0b98a940b334e5fcab => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:02:57.029412 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9342e9b-999c-4cdc-b2fd-e4abb2ee9dde admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:57.188076 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:02:57.271932 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9342e9b-999c-4cdc-b2fd-e4abb2ee9dde admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:57.280479 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4445c518-1ff5-4a47-92ed-440494a3145d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:57.281458 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445c518-1ff5-4a47-92ed-440494a3145d admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:57.285897 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 858/1748] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:02:56 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:02:57.291363 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e207e2c2-b2d2-4b23-b2ed-90c97e8b45fc None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:57.291664 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e207e2c2-b2d2-4b23-b2ed-90c97e8b45fc None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:57.291947 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e207e2c2-b2d2-4b23-b2ed-90c97e8b45fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:57.298030 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445c518-1ff5-4a47-92ed-440494a3145d admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:57.298549 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445c518-1ff5-4a47-92ed-440494a3145d admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:57.300219 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4445c518-1ff5-4a47-92ed-440494a3145d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:57.304125 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4445c518-1ff5-4a47-92ed-440494a3145d admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:57.359235 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 891/1749] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:02:57 2022] GET /identity/v3/roles => generated 1420 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:02:57.361504 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4445c518-1ff5-4a47-92ed-440494a3145d admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:57.375155 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-e207e2c2-b2d2-4b23-b2ed-90c97e8b45fc None None] MFA Rules not processed for user `57e117589fc14e4d9d8d8494bddf9c12`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:02:57.378577 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-e207e2c2-b2d2-4b23-b2ed-90c97e8b45fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:57.407926 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4445c518-1ff5-4a47-92ed-440494a3145d admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:57.459573 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8ea9d7-c03b-44a4-86cc-09cb1a9d1c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:57.460402 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ea9d7-c03b-44a4-86cc-09cb1a9d1c37 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:57.474293 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ea9d7-c03b-44a4-86cc-09cb1a9d1c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:57.474980 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ea9d7-c03b-44a4-86cc-09cb1a9d1c37 admin admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:57.476824 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8ea9d7-c03b-44a4-86cc-09cb1a9d1c37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:57.483081 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8ea9d7-c03b-44a4-86cc-09cb1a9d1c37 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:57.583512 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 859/1750] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:02:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:02:57.583512 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497c437-0ca6-4edc-b00a-f79a74333032 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:57.583512 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497c437-0ca6-4edc-b00a-f79a74333032 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:57.583512 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497c437-0ca6-4edc-b00a-f79a74333032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:57.637214 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 892/1751] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:02:57 2022] POST /identity/v3/projects => generated 405 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:02:57.640896 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8ea9d7-c03b-44a4-86cc-09cb1a9d1c37 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:57.670786 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-2497c437-0ca6-4edc-b00a-f79a74333032 None None] MFA Rules not processed for user `0343900ed31d47a187aea1a982f2d9a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:02:57.672822 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-2497c437-0ca6-4edc-b00a-f79a74333032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:57.739605 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:02:57.947877 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8ea9d7-c03b-44a4-86cc-09cb1a9d1c37 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:57.986925 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f5b1a-bd00-416f-9856-1793e969096b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:57.993543 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f5b1a-bd00-416f-9856-1793e969096b admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:57.993882 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f5b1a-bd00-416f-9856-1793e969096b admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:57.994127 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f5b1a-bd00-416f-9856-1793e969096b admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:57.994816 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69f5b1a-bd00-416f-9856-1793e969096b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:58.004970 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69f5b1a-bd00-416f-9856-1793e969096b admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:58.029788 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 860/1752] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:02:57 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 453 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:02:58.038888 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2497c437-0ca6-4edc-b00a-f79a74333032 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:58.083349 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 893/1753] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:02:57 2022] GET /identity/v3/roles => generated 1420 bytes in 442 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:02:58.093925 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f5b1a-bd00-416f-9856-1793e969096b admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:58.132566 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f5b1a-bd00-416f-9856-1793e969096b admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:58.165532 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b899af98-e670-4f59-b698-eafa212b3a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:58.166207 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899af98-e670-4f59-b698-eafa212b3a38 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:58.166536 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899af98-e670-4f59-b698-eafa212b3a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:58.166810 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899af98-e670-4f59-b698-eafa212b3a38 admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:58.172250 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b899af98-e670-4f59-b698-eafa212b3a38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:58.178345 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b899af98-e670-4f59-b698-eafa212b3a38 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:58.242249 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 894/1754] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:02:58 2022] POST /identity/v3/users => generated 309 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:02:58.243287 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b899af98-e670-4f59-b698-eafa212b3a38 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:58.248228 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-b899af98-e670-4f59-b698-eafa212b3a38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:58.377595 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2497c437-0ca6-4edc-b00a-f79a74333032 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:58.394356 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f6d4e2-864a-4b51-8ee1-fe797fa28948 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a005d8f0c46d44c7b6f2201a54717b12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:58.394992 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6d4e2-864a-4b51-8ee1-fe797fa28948 service nova] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:58.395273 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6d4e2-864a-4b51-8ee1-fe797fa28948 service nova] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:58.395546 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6d4e2-864a-4b51-8ee1-fe797fa28948 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:58.521392 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b899af98-e670-4f59-b698-eafa212b3a38 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:58.541605 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba692dc-34f9-4d4b-8d92-5165ed6f520e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b8a09704b9b4ab2bffb813796ec6e77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:58.542344 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba692dc-34f9-4d4b-8d92-5165ed6f520e service cinder] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:58.542628 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba692dc-34f9-4d4b-8d92-5165ed6f520e service cinder] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:58.542895 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba692dc-34f9-4d4b-8d92-5165ed6f520e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:58.566728 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f6d4e2-864a-4b51-8ee1-fe797fa28948 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:58.569658 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f6d4e2-864a-4b51-8ee1-fe797fa28948 service nova] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:58.583023 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 861/1755] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:02:58 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:02:58.584366 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f6d4e2-864a-4b51-8ee1-fe797fa28948 service nova] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:58.593004 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba692dc-34f9-4d4b-8d92-5165ed6f520e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:58.599878 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f6d4e2-864a-4b51-8ee1-fe797fa28948 service nova] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:58.604606 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba692dc-34f9-4d4b-8d92-5165ed6f520e service cinder] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:58.607644 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dd8eb5-7541-4c83-b7e5-dc1a12058a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:58.608756 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd8eb5-7541-4c83-b7e5-dc1a12058a5c admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:58.609048 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd8eb5-7541-4c83-b7e5-dc1a12058a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:58.609378 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd8eb5-7541-4c83-b7e5-dc1a12058a5c admin admin] PATH_INFO: `/v3/projects/45a09864d9cb4a31980b223bdaa379bc/users/1c576ca635654768a1c2b18e05b034ff/roles/719e5c62188d4f8a838987d6e72ca8f7` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:58.640598 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dd8eb5-7541-4c83-b7e5-dc1a12058a5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=45a09864d9cb4a31980b223bdaa379bc, user_id=1c576ca635654768a1c2b18e05b034ff, role_id=719e5c62188d4f8a838987d6e72ca8f7)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:58.643799 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dd8eb5-7541-4c83-b7e5-dc1a12058a5c admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:58.657016 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 895/1756] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:02:58 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:02:58.658319 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba692dc-34f9-4d4b-8d92-5165ed6f520e service cinder] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:58.696783 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 862/1757] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:02:58 2022] PUT /identity/v3/projects/45a09864d9cb4a31980b223bdaa379bc/users/1c576ca635654768a1c2b18e05b034ff/roles/719e5c62188d4f8a838987d6e72ca8f7 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:02:58.700231 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa8c7f-b2c9-4178-b92d-a61b3821a071 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:58.705383 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa8c7f-b2c9-4178-b92d-a61b3821a071 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:58.705821 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa8c7f-b2c9-4178-b92d-a61b3821a071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:58.716244 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba692dc-34f9-4d4b-8d92-5165ed6f520e service cinder] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:58.790847 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-c2aa8c7f-b2c9-4178-b92d-a61b3821a071 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:02:58.794205 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-c2aa8c7f-b2c9-4178-b92d-a61b3821a071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:58.799866 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:02:58.920834 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:02:59.011301 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb168ec6-b038-4d66-824f-94b440154afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:59.011928 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb168ec6-b038-4d66-824f-94b440154afd admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:59.012254 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb168ec6-b038-4d66-824f-94b440154afd admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:59.012633 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb168ec6-b038-4d66-824f-94b440154afd admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:59.013279 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb168ec6-b038-4d66-824f-94b440154afd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:59.014932 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb168ec6-b038-4d66-824f-94b440154afd admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:59.046332 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 896/1758] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:02:58 2022] GET /identity/v3/roles => generated 1420 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:02:59.047221 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb168ec6-b038-4d66-824f-94b440154afd admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:59.052567 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-bb168ec6-b038-4d66-824f-94b440154afd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:59.096732 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 863/1759] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:02:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:02:59.100572 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aa8c7f-b2c9-4178-b92d-a61b3821a071 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:59.140910 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aa8c7f-b2c9-4178-b92d-a61b3821a071 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:59.167436 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfd9de5-f909-496d-bea7-2d274328d4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:59.168197 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd9de5-f909-496d-bea7-2d274328d4ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:59.168482 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd9de5-f909-496d-bea7-2d274328d4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:59.168778 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd9de5-f909-496d-bea7-2d274328d4ba admin admin] PATH_INFO: `/v3/projects/bd10e14e223f41fb98a96cf519ba4671/users/2c6d67477bb248d894287ea9a6326c71/roles/127fdc7ef05b4e0b98a940b334e5fcab` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:59.221049 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb168ec6-b038-4d66-824f-94b440154afd admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:59.230709 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fde638-7f53-4d77-a575-9de6941755c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b8a09704b9b4ab2bffb813796ec6e77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:59.231533 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fde638-7f53-4d77-a575-9de6941755c4 service cinder] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:59.231825 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fde638-7f53-4d77-a575-9de6941755c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:59.232098 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fde638-7f53-4d77-a575-9de6941755c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:59.234646 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-b4fde638-7f53-4d77-a575-9de6941755c4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:02:59.242168 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfd9de5-f909-496d-bea7-2d274328d4ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd10e14e223f41fb98a96cf519ba4671, user_id=2c6d67477bb248d894287ea9a6326c71, role_id=127fdc7ef05b4e0b98a940b334e5fcab)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:59.244727 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfd9de5-f909-496d-bea7-2d274328d4ba admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:59.303343 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 864/1760] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:02:59 2022] PUT /identity/v3/projects/bd10e14e223f41fb98a96cf519ba4671/users/2c6d67477bb248d894287ea9a6326c71/roles/127fdc7ef05b4e0b98a940b334e5fcab => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:02:59.307797 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfd9de5-f909-496d-bea7-2d274328d4ba admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:59.437342 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fde638-7f53-4d77-a575-9de6941755c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:59.451483 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fde638-7f53-4d77-a575-9de6941755c4 service cinder] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:59.475911 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 897/1761] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:02:59 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:02:59.487827 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fde638-7f53-4d77-a575-9de6941755c4 service cinder] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:59.536443 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fde638-7f53-4d77-a575-9de6941755c4 service cinder] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:59.662954 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e111bec-c338-46a0-919a-e5632a798d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:59.664493 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e111bec-c338-46a0-919a-e5632a798d44 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:59.664953 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e111bec-c338-46a0-919a-e5632a798d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:59.665343 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e111bec-c338-46a0-919a-e5632a798d44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:59.666517 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e111bec-c338-46a0-919a-e5632a798d44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:59.668682 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e111bec-c338-46a0-919a-e5632a798d44 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:59.685073 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 898/1762] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:02:59 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:02:59.688557 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e111bec-c338-46a0-919a-e5632a798d44 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:02:59.702164 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e111bec-c338-46a0-919a-e5632a798d44 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:59.711899 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a763383-f1b2-4e88-bdcf-67c0a1a65306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:59.716439 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a763383-f1b2-4e88-bdcf-67c0a1a65306 admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:59.717617 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a763383-f1b2-4e88-bdcf-67c0a1a65306 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:59.718055 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a763383-f1b2-4e88-bdcf-67c0a1a65306 admin admin] PATH_INFO: `/v3/projects/bd10e14e223f41fb98a96cf519ba4671/users/2c6d67477bb248d894287ea9a6326c71/roles/127fdc7ef05b4e0b98a940b334e5fcab` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:59.729706 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a763383-f1b2-4e88-bdcf-67c0a1a65306 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd10e14e223f41fb98a96cf519ba4671, user_id=2c6d67477bb248d894287ea9a6326c71, role_id=127fdc7ef05b4e0b98a940b334e5fcab)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:59.729887 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfd9de5-f909-496d-bea7-2d274328d4ba admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:02:59.743898 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ca835a-e58d-4753-b50c-d0b12bbf1525 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:02:59.744088 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a763383-f1b2-4e88-bdcf-67c0a1a65306 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:59.744558 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca835a-e58d-4753-b50c-d0b12bbf1525 service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:59.745768 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca835a-e58d-4753-b50c-d0b12bbf1525 service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:59.746052 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca835a-e58d-4753-b50c-d0b12bbf1525 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:59.759001 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:02:59.798234 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 899/1763] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:02:59 2022] PUT /identity/v3/projects/bd10e14e223f41fb98a96cf519ba4671/users/2c6d67477bb248d894287ea9a6326c71/roles/127fdc7ef05b4e0b98a940b334e5fcab => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:02:59.817544 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ca835a-e58d-4753-b50c-d0b12bbf1525 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:02:59.820079 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8496ef-96f3-4284-83df-d45f9dad66cf None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:02:59.820440 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8496ef-96f3-4284-83df-d45f9dad66cf None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:02:59.820793 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8496ef-96f3-4284-83df-d45f9dad66cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:02:59.824285 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ca835a-e58d-4753-b50c-d0b12bbf1525 service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:02:59.863544 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 865/1764] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:02:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:02:59.920835 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-ba8496ef-96f3-4284-83df-d45f9dad66cf None None] MFA Rules not processed for user `2c6d67477bb248d894287ea9a6326c71`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:02:59.925116 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-ba8496ef-96f3-4284-83df-d45f9dad66cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:00.238950 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 900/1765] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:02:59 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 418 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:03:00.391485 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ca835a-e58d-4753-b50c-d0b12bbf1525 service neutron] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:00.561898 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ca835a-e58d-4753-b50c-d0b12bbf1525 service neutron] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:00.628573 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a300e19f-fca4-48f0-a204-49589f9fbd37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b8a09704b9b4ab2bffb813796ec6e77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:00.631195 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a300e19f-fca4-48f0-a204-49589f9fbd37 service cinder] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:00.631765 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a300e19f-fca4-48f0-a204-49589f9fbd37 service cinder] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:00.632223 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a300e19f-fca4-48f0-a204-49589f9fbd37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:00.651734 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a300e19f-fca4-48f0-a204-49589f9fbd37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:00.654145 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a300e19f-fca4-48f0-a204-49589f9fbd37 service cinder] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:00.677204 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 866/1766] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:03:00 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:03:00.987994 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8496ef-96f3-4284-83df-d45f9dad66cf None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:01.174486 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8496ef-96f3-4284-83df-d45f9dad66cf None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:01.188565 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8a4ed7-1c79-4657-95ce-eae1fe311cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:01.189227 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8a4ed7-1c79-4657-95ce-eae1fe311cb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:01.189594 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8a4ed7-1c79-4657-95ce-eae1fe311cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:01.189875 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8a4ed7-1c79-4657-95ce-eae1fe311cb5 admin admin] PATH_INFO: `/v3/users/6cfd46073f6b44ef8d7353b5527acfa3` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:01.191552 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8a4ed7-1c79-4657-95ce-eae1fe311cb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cfd46073f6b44ef8d7353b5527acfa3)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:01.193350 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8a4ed7-1c79-4657-95ce-eae1fe311cb5 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:01.305102 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-0e8a4ed7-1c79-4657-95ce-eae1fe311cb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cfd46073f6b44ef8d7353b5527acfa3'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:01.306700 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-0e8a4ed7-1c79-4657-95ce-eae1fe311cb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cfd46073f6b44ef8d7353b5527acfa3'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:01.318990 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-0e8a4ed7-1c79-4657-95ce-eae1fe311cb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cfd46073f6b44ef8d7353b5527acfa3'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:01.341339 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-0e8a4ed7-1c79-4657-95ce-eae1fe311cb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cfd46073f6b44ef8d7353b5527acfa3'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:01.354773 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-0e8a4ed7-1c79-4657-95ce-eae1fe311cb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cfd46073f6b44ef8d7353b5527acfa3'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:01.358057 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:03:01.366944 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 901/1767] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:03:00 2022] DELETE /identity/v3/users/6cfd46073f6b44ef8d7353b5527acfa3 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:03:01.372270 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c3bc3-4e03-44c6-a9ac-d7ef88366f41 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:01.372930 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c3bc3-4e03-44c6-a9ac-d7ef88366f41 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:01.373361 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c3bc3-4e03-44c6-a9ac-d7ef88366f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:01.406695 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:03:01.417558 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-1f4c3bc3-4e03-44c6-a9ac-d7ef88366f41 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:03:01.420206 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-1f4c3bc3-4e03-44c6-a9ac-d7ef88366f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:01.527251 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 867/1768] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:03:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:03:01.842043 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8a4ed7-1c79-4657-95ce-eae1fe311cb5 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:01.845857 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-0e8a4ed7-1c79-4657-95ce-eae1fe311cb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:02.014534 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133fad3a-8d5b-4ab4-9e04-73f70d311ea3 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:02.015214 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133fad3a-8d5b-4ab4-9e04-73f70d311ea3 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:02.016145 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133fad3a-8d5b-4ab4-9e04-73f70d311ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:02.126688 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-133fad3a-8d5b-4ab4-9e04-73f70d311ea3 None None] MFA Rules not processed for user `bcacf809f13043ab90716607160a70db`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:03:02.131185 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-133fad3a-8d5b-4ab4-9e04-73f70d311ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:02.189423 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8a4ed7-1c79-4657-95ce-eae1fe311cb5 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:02.203635 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bd621d-f74f-41b8-80de-5428b9536ce1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:02.205744 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd621d-f74f-41b8-80de-5428b9536ce1 service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:02.206685 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd621d-f74f-41b8-80de-5428b9536ce1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:02.207419 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd621d-f74f-41b8-80de-5428b9536ce1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:02.245316 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bd621d-f74f-41b8-80de-5428b9536ce1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:02.245316 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bd621d-f74f-41b8-80de-5428b9536ce1 service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:02.257764 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 902/1769] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:03:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:03:02.374782 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 868/1770] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Aug 18 11:03:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:03:02.393029 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e6ec18-e093-4d1c-9ced-43881f8ae59f None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:02.393505 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e6ec18-e093-4d1c-9ced-43881f8ae59f None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:02.393689 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e6ec18-e093-4d1c-9ced-43881f8ae59f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:02.490162 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-d8e6ec18-e093-4d1c-9ced-43881f8ae59f None None] MFA Rules not processed for user `7dc5501d59fb4593b405f0e9bd2e49ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:03:02.496751 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce8d82-82a5-4934-8eff-c6ca9069867a None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:02.497800 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce8d82-82a5-4934-8eff-c6ca9069867a None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:02.498117 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce8d82-82a5-4934-8eff-c6ca9069867a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:02.525202 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-d8e6ec18-e093-4d1c-9ced-43881f8ae59f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:02.651600 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-15ce8d82-82a5-4934-8eff-c6ca9069867a None None] MFA Rules not processed for user `1c576ca635654768a1c2b18e05b034ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:03:02.658477 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-15ce8d82-82a5-4934-8eff-c6ca9069867a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:02.822607 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 903/1771] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:03:02 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 431 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:03:02.825465 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e6ec18-e093-4d1c-9ced-43881f8ae59f None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:02.827750 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-d8e6ec18-e093-4d1c-9ced-43881f8ae59f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:02.910988 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 869/1772] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:03:02 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 421 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:03:02.913893 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ce8d82-82a5-4934-8eff-c6ca9069867a None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:02.915780 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-15ce8d82-82a5-4934-8eff-c6ca9069867a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:02.957668 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ce8d82-82a5-4934-8eff-c6ca9069867a None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:02.964008 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2944dc-ea55-4d03-9faf-f73b6f830caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:02.965528 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2944dc-ea55-4d03-9faf-f73b6f830caa admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:02.965932 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2944dc-ea55-4d03-9faf-f73b6f830caa admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:02.969431 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2944dc-ea55-4d03-9faf-f73b6f830caa admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:02.969431 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2944dc-ea55-4d03-9faf-f73b6f830caa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:02.971095 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2944dc-ea55-4d03-9faf-f73b6f830caa admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:02.977511 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:03:03.022324 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 870/1773] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:03:02 2022] POST /identity/v3/projects => generated 403 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:03:03.023689 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2944dc-ea55-4d03-9faf-f73b6f830caa admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:03.030169 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e6ec18-e093-4d1c-9ced-43881f8ae59f None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:03.111989 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:03:03.184251 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2944dc-ea55-4d03-9faf-f73b6f830caa admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:03.196112 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256724aa-2a6e-4d2d-afd6-14c81e67a020 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f97e906b1922419d8511ab1c8b9c86e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:03.196721 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256724aa-2a6e-4d2d-afd6-14c81e67a020 service swift] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:03.198384 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256724aa-2a6e-4d2d-afd6-14c81e67a020 service swift] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:03.198844 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69975502-1d30-4432-9c12-4ab93690d1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:03.199483 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69975502-1d30-4432-9c12-4ab93690d1fd admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:03.200221 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69975502-1d30-4432-9c12-4ab93690d1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:03.200801 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69975502-1d30-4432-9c12-4ab93690d1fd admin admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:03.201018 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256724aa-2a6e-4d2d-afd6-14c81e67a020 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:03.201672 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69975502-1d30-4432-9c12-4ab93690d1fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:03.203770 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69975502-1d30-4432-9c12-4ab93690d1fd admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:03.238628 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 871/1774] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:03:03 2022] POST /identity/v3/users => generated 308 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:03:03.245841 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69975502-1d30-4432-9c12-4ab93690d1fd admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:03.264297 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69975502-1d30-4432-9c12-4ab93690d1fd admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:03.274317 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ab8376-e513-4032-a66b-46d418907e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:03.289559 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab8376-e513-4032-a66b-46d418907e6c admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:03.289559 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab8376-e513-4032-a66b-46d418907e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:03.289559 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab8376-e513-4032-a66b-46d418907e6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:03.289559 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ab8376-e513-4032-a66b-46d418907e6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:03.289559 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ab8376-e513-4032-a66b-46d418907e6c admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:03.329468 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 872/1775] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:03:03 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:03:03.330777 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ab8376-e513-4032-a66b-46d418907e6c admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:03.367087 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ab8376-e513-4032-a66b-46d418907e6c admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:03.373103 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4188377f-a01e-4d02-b4df-0d31c4a171f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:03.373949 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4188377f-a01e-4d02-b4df-0d31c4a171f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:03.374125 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4188377f-a01e-4d02-b4df-0d31c4a171f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:03.374433 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4188377f-a01e-4d02-b4df-0d31c4a171f7 admin admin] PATH_INFO: `/v3/projects/b639a55bb8fb48959a70ae9048e14a19/users/e27c22cb606f435e9fe4bcf97fa13763/roles/127fdc7ef05b4e0b98a940b334e5fcab` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:03.375560 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256724aa-2a6e-4d2d-afd6-14c81e67a020 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:03.377392 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256724aa-2a6e-4d2d-afd6-14c81e67a020 service swift] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:03.395731 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4188377f-a01e-4d02-b4df-0d31c4a171f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b639a55bb8fb48959a70ae9048e14a19, user_id=e27c22cb606f435e9fe4bcf97fa13763, role_id=127fdc7ef05b4e0b98a940b334e5fcab)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:03.401070 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 904/1776] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Aug 18 11:03:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 577 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 11:03:03.401561 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4188377f-a01e-4d02-b4df-0d31c4a171f7 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:03.430363 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 873/1777] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:03:03 2022] PUT /identity/v3/projects/b639a55bb8fb48959a70ae9048e14a19/users/e27c22cb606f435e9fe4bcf97fa13763/roles/127fdc7ef05b4e0b98a940b334e5fcab => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:03:03.434693 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256724aa-2a6e-4d2d-afd6-14c81e67a020 service swift] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:03.459596 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256724aa-2a6e-4d2d-afd6-14c81e67a020 service swift] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:03.615901 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2ed120-8221-43c5-9401-7b479eac3b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:03.616524 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ed120-8221-43c5-9401-7b479eac3b2f admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:03.616899 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ed120-8221-43c5-9401-7b479eac3b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:03.617067 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ed120-8221-43c5-9401-7b479eac3b2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:03.617841 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2ed120-8221-43c5-9401-7b479eac3b2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:03.619369 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2ed120-8221-43c5-9401-7b479eac3b2f admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:03.648319 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 905/1778] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:03:03 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:03:03.653213 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4188377f-a01e-4d02-b4df-0d31c4a171f7 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:03.672837 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4188377f-a01e-4d02-b4df-0d31c4a171f7 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:03.688404 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4fe633-d7b2-41c6-9a18-51072eb50f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:03.689804 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4fe633-d7b2-41c6-9a18-51072eb50f44 admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:03.689804 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4fe633-d7b2-41c6-9a18-51072eb50f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:03.689978 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4fe633-d7b2-41c6-9a18-51072eb50f44 admin admin] PATH_INFO: `/v3/projects/b639a55bb8fb48959a70ae9048e14a19/users/e27c22cb606f435e9fe4bcf97fa13763/roles/127fdc7ef05b4e0b98a940b334e5fcab` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:03.701007 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4fe633-d7b2-41c6-9a18-51072eb50f44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b639a55bb8fb48959a70ae9048e14a19, user_id=e27c22cb606f435e9fe4bcf97fa13763, role_id=127fdc7ef05b4e0b98a940b334e5fcab)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:03.718686 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4fe633-d7b2-41c6-9a18-51072eb50f44 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:03.759919 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 874/1779] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:03:03 2022] PUT /identity/v3/projects/b639a55bb8fb48959a70ae9048e14a19/users/e27c22cb606f435e9fe4bcf97fa13763/roles/127fdc7ef05b4e0b98a940b334e5fcab => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:03:04.505702 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2ed120-8221-43c5-9401-7b479eac3b2f admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:04.507383 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-ef2ed120-8221-43c5-9401-7b479eac3b2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:04.540401 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2ed120-8221-43c5-9401-7b479eac3b2f admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:04.796189 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf07725-da3d-4bc3-a408-1f2130e6cdbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:04.799070 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf07725-da3d-4bc3-a408-1f2130e6cdbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:04.799397 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf07725-da3d-4bc3-a408-1f2130e6cdbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:04.799847 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf07725-da3d-4bc3-a408-1f2130e6cdbe admin admin] PATH_INFO: `/v3/users/2b23ba0b4b6b469999dbae5bce051526` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:04.801497 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf07725-da3d-4bc3-a408-1f2130e6cdbe admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b23ba0b4b6b469999dbae5bce051526)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:04.808381 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf07725-da3d-4bc3-a408-1f2130e6cdbe admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:04.873402 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:03:04.981454 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-fbf07725-da3d-4bc3-a408-1f2130e6cdbe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b23ba0b4b6b469999dbae5bce051526'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:04.982336 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-fbf07725-da3d-4bc3-a408-1f2130e6cdbe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b23ba0b4b6b469999dbae5bce051526'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:05.000817 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-fbf07725-da3d-4bc3-a408-1f2130e6cdbe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b23ba0b4b6b469999dbae5bce051526'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:05.061407 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-fbf07725-da3d-4bc3-a408-1f2130e6cdbe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b23ba0b4b6b469999dbae5bce051526'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:05.077918 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-fbf07725-da3d-4bc3-a408-1f2130e6cdbe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b23ba0b4b6b469999dbae5bce051526'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:05.101404 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b49140-3c99-4c34-9bff-766cf9b98e5b None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:05.102189 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b49140-3c99-4c34-9bff-766cf9b98e5b None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:05.102327 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 906/1780] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:03:04 2022] DELETE /identity/v3/users/2b23ba0b4b6b469999dbae5bce051526 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:03:05.102990 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b49140-3c99-4c34-9bff-766cf9b98e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:05.167805 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-48b49140-3c99-4c34-9bff-766cf9b98e5b None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:03:05.171449 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-48b49140-3c99-4c34-9bff-766cf9b98e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:05.422461 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 875/1781] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:03:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:03:05.571658 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf07725-da3d-4bc3-a408-1f2130e6cdbe admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:05.573375 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-fbf07725-da3d-4bc3-a408-1f2130e6cdbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:05.723031 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc41a52-4400-4fb9-9b84-cc336b71cedf None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:05.723765 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc41a52-4400-4fb9-9b84-cc336b71cedf None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:05.724649 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc41a52-4400-4fb9-9b84-cc336b71cedf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:05.765223 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf07725-da3d-4bc3-a408-1f2130e6cdbe admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:05.778760 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610f2dbe-b98c-4fb4-9842-c92362e96593 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:05.781870 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f2dbe-b98c-4fb4-9842-c92362e96593 service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:05.786071 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f2dbe-b98c-4fb4-9842-c92362e96593 service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:05.791367 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f2dbe-b98c-4fb4-9842-c92362e96593 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:05.798666 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-3dc41a52-4400-4fb9-9b84-cc336b71cedf None None] MFA Rules not processed for user `86c2cd74178f443d9c2398ff8e00cccc`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:03:05.800801 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-3dc41a52-4400-4fb9-9b84-cc336b71cedf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:05.828284 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610f2dbe-b98c-4fb4-9842-c92362e96593 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:05.830052 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 876/1782] 10.222.0.40 () {58 vars in 1015 bytes} [Thu Aug 18 11:03:05 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:03:05.831152 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610f2dbe-b98c-4fb4-9842-c92362e96593 service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:05.845460 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 907/1783] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:03:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:03:05.874607 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc41a52-4400-4fb9-9b84-cc336b71cedf None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:05.890414 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc41a52-4400-4fb9-9b84-cc336b71cedf None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:05.899330 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e06791-9f26-4f95-9d16-b4214af647cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:05.900399 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e06791-9f26-4f95-9d16-b4214af647cf service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:05.900910 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e06791-9f26-4f95-9d16-b4214af647cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:05.901613 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e06791-9f26-4f95-9d16-b4214af647cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:05.921031 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e06791-9f26-4f95-9d16-b4214af647cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:05.924810 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e06791-9f26-4f95-9d16-b4214af647cf service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:05.946371 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 877/1784] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:03:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:03:06.094948 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610f2dbe-b98c-4fb4-9842-c92362e96593 service neutron] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:06.097430 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-610f2dbe-b98c-4fb4-9842-c92362e96593 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:06.126235 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610f2dbe-b98c-4fb4-9842-c92362e96593 service neutron] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:06.142105 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d04ff3-1082-4699-a659-1b7ee4593a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:06.143582 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d04ff3-1082-4699-a659-1b7ee4593a68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:06.144534 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d04ff3-1082-4699-a659-1b7ee4593a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:06.146933 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d04ff3-1082-4699-a659-1b7ee4593a68 admin admin] PATH_INFO: `/v3/projects/86dd669dc79b4a83828293245dd9fa71` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:06.159673 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d04ff3-1082-4699-a659-1b7ee4593a68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86dd669dc79b4a83828293245dd9fa71)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:06.162851 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d04ff3-1082-4699-a659-1b7ee4593a68 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:06.318578 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-c2d04ff3-1082-4699-a659-1b7ee4593a68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86dd669dc79b4a83828293245dd9fa71', 'request_id': 'req-c2d04ff3-1082-4699-a659-1b7ee4593a68'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:06.339286 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-c2d04ff3-1082-4699-a659-1b7ee4593a68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86dd669dc79b4a83828293245dd9fa71', 'request_id': 'req-c2d04ff3-1082-4699-a659-1b7ee4593a68'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:06.352085 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-c2d04ff3-1082-4699-a659-1b7ee4593a68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86dd669dc79b4a83828293245dd9fa71', 'request_id': 'req-c2d04ff3-1082-4699-a659-1b7ee4593a68'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:06.380178 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-c2d04ff3-1082-4699-a659-1b7ee4593a68 admin admin] The token cache is being invalidate because project 86dd669dc79b4a83828293245dd9fa71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:03:06.380812 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-c2d04ff3-1082-4699-a659-1b7ee4593a68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:06.381801 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-c2d04ff3-1082-4699-a659-1b7ee4593a68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:06.383506 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 908/1785] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:03:06 2022] DELETE /identity/v3/projects/86dd669dc79b4a83828293245dd9fa71 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:03:06.387991 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e06791-9f26-4f95-9d16-b4214af647cf service neutron] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:06.408626 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e06791-9f26-4f95-9d16-b4214af647cf service neutron] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:06.428689 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:03:06.635638 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a54f73-c2cb-4f89-b0c7-0f3024698caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:06.637199 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a54f73-c2cb-4f89-b0c7-0f3024698caf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:06.637747 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a54f73-c2cb-4f89-b0c7-0f3024698caf admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:06.638210 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a54f73-c2cb-4f89-b0c7-0f3024698caf admin admin] PATH_INFO: `/v3/users/2c6d67477bb248d894287ea9a6326c71` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:06.642935 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a54f73-c2cb-4f89-b0c7-0f3024698caf admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c6d67477bb248d894287ea9a6326c71)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:06.645242 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a54f73-c2cb-4f89-b0c7-0f3024698caf admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:06.801641 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-96a54f73-c2cb-4f89-b0c7-0f3024698caf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c6d67477bb248d894287ea9a6326c71'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:06.825506 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-96a54f73-c2cb-4f89-b0c7-0f3024698caf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c6d67477bb248d894287ea9a6326c71'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:06.826482 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-96a54f73-c2cb-4f89-b0c7-0f3024698caf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c6d67477bb248d894287ea9a6326c71'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:06.827562 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-96a54f73-c2cb-4f89-b0c7-0f3024698caf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c6d67477bb248d894287ea9a6326c71'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:06.846702 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-96a54f73-c2cb-4f89-b0c7-0f3024698caf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c6d67477bb248d894287ea9a6326c71'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:06.913353 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 878/1786] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:03:06 2022] DELETE /identity/v3/users/2c6d67477bb248d894287ea9a6326c71 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:03:07.851683 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d04ff3-1082-4699-a659-1b7ee4593a68 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:07.853358 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-c2d04ff3-1082-4699-a659-1b7ee4593a68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:07.877717 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d04ff3-1082-4699-a659-1b7ee4593a68 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:07.929579 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:03:08.189023 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82e86d7-802b-4915-8331-2f11bf8c0d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:08.192014 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e86d7-802b-4915-8331-2f11bf8c0d16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:08.193218 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e86d7-802b-4915-8331-2f11bf8c0d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:08.196297 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e86d7-802b-4915-8331-2f11bf8c0d16 admin admin] PATH_INFO: `/v3/projects/7e40edb5ccb64e85a5421b0f1ff062fc` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:08.199354 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82e86d7-802b-4915-8331-2f11bf8c0d16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e40edb5ccb64e85a5421b0f1ff062fc)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:08.233349 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82e86d7-802b-4915-8331-2f11bf8c0d16 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:08.472743 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b65970-d187-4807-b491-8258805b7eb5 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:08.473222 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b65970-d187-4807-b491-8258805b7eb5 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:08.473503 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b65970-d187-4807-b491-8258805b7eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:08.487423 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-a82e86d7-802b-4915-8331-2f11bf8c0d16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e40edb5ccb64e85a5421b0f1ff062fc', 'request_id': 'req-a82e86d7-802b-4915-8331-2f11bf8c0d16'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:08.515065 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-a82e86d7-802b-4915-8331-2f11bf8c0d16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e40edb5ccb64e85a5421b0f1ff062fc', 'request_id': 'req-a82e86d7-802b-4915-8331-2f11bf8c0d16'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:08.549028 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-a82e86d7-802b-4915-8331-2f11bf8c0d16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e40edb5ccb64e85a5421b0f1ff062fc', 'request_id': 'req-a82e86d7-802b-4915-8331-2f11bf8c0d16'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:08.609770 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-20b65970-d187-4807-b491-8258805b7eb5 None None] MFA Rules not processed for user `e27c22cb606f435e9fe4bcf97fa13763`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:03:08.617684 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-a82e86d7-802b-4915-8331-2f11bf8c0d16 admin admin] The token cache is being invalidate because project 7e40edb5ccb64e85a5421b0f1ff062fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:03:08.618045 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-a82e86d7-802b-4915-8331-2f11bf8c0d16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:08.618626 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-20b65970-d187-4807-b491-8258805b7eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:08.637849 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-a82e86d7-802b-4915-8331-2f11bf8c0d16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:08.646869 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 909/1787] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:03:07 2022] DELETE /identity/v3/projects/7e40edb5ccb64e85a5421b0f1ff062fc => generated 0 bytes in 793 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:03:08.648618 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82e86d7-802b-4915-8331-2f11bf8c0d16 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:08.651047 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-a82e86d7-802b-4915-8331-2f11bf8c0d16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:08.923352 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 879/1788] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:03:08 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 444 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:03:08.970448 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82e86d7-802b-4915-8331-2f11bf8c0d16 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:08.994736 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd19df2-ae02-4064-b5e1-bce4c87ed153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:08.997890 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd19df2-ae02-4064-b5e1-bce4c87ed153 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:08.998837 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd19df2-ae02-4064-b5e1-bce4c87ed153 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:08.999127 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd19df2-ae02-4064-b5e1-bce4c87ed153 admin admin] PATH_INFO: `/v3/users/c9937dd509954622949e8fe852201d4e` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:09.003888 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd19df2-ae02-4064-b5e1-bce4c87ed153 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9937dd509954622949e8fe852201d4e)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:09.009234 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd19df2-ae02-4064-b5e1-bce4c87ed153 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:09.147217 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:03:09.152519 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-edd19df2-ae02-4064-b5e1-bce4c87ed153 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9937dd509954622949e8fe852201d4e'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:09.153545 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-edd19df2-ae02-4064-b5e1-bce4c87ed153 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9937dd509954622949e8fe852201d4e'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:09.187222 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-edd19df2-ae02-4064-b5e1-bce4c87ed153 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9937dd509954622949e8fe852201d4e'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:09.260913 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-edd19df2-ae02-4064-b5e1-bce4c87ed153 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9937dd509954622949e8fe852201d4e'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:09.278999 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-edd19df2-ae02-4064-b5e1-bce4c87ed153 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9937dd509954622949e8fe852201d4e'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:09.300892 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 910/1789] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:03:08 2022] DELETE /identity/v3/users/c9937dd509954622949e8fe852201d4e => generated 0 bytes in 653 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:03:09.725983 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b65970-d187-4807-b491-8258805b7eb5 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:09.728368 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-20b65970-d187-4807-b491-8258805b7eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:09.757883 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b65970-d187-4807-b491-8258805b7eb5 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:09.791826 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:03:09.983206 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3e782b-2b54-4315-97c6-5518ff6b479a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:09.984200 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3e782b-2b54-4315-97c6-5518ff6b479a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:09.984770 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3e782b-2b54-4315-97c6-5518ff6b479a admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:09.985186 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3e782b-2b54-4315-97c6-5518ff6b479a admin admin] PATH_INFO: `/v3/projects/bd10e14e223f41fb98a96cf519ba4671` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:09.990817 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3e782b-2b54-4315-97c6-5518ff6b479a admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd10e14e223f41fb98a96cf519ba4671)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:09.992970 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3e782b-2b54-4315-97c6-5518ff6b479a admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:10.076732 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851c1fbe-1277-4e8d-a6b1-1b1598de8aef None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:10.077296 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851c1fbe-1277-4e8d-a6b1-1b1598de8aef None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:10.077296 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851c1fbe-1277-4e8d-a6b1-1b1598de8aef None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:10.078930 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 911/1790] 10.222.0.15 () {54 vars in 921 bytes} [Thu Aug 18 11:03:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 11:03:10.130186 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-6d3e782b-2b54-4315-97c6-5518ff6b479a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd10e14e223f41fb98a96cf519ba4671', 'request_id': 'req-6d3e782b-2b54-4315-97c6-5518ff6b479a'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:10.138368 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c896f-69d9-4ca0-8224-c07023c3993b None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:10.138867 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c896f-69d9-4ca0-8224-c07023c3993b None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:10.139298 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c896f-69d9-4ca0-8224-c07023c3993b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:10.151430 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-6d3e782b-2b54-4315-97c6-5518ff6b479a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd10e14e223f41fb98a96cf519ba4671', 'request_id': 'req-6d3e782b-2b54-4315-97c6-5518ff6b479a'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:10.183718 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-6d3e782b-2b54-4315-97c6-5518ff6b479a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd10e14e223f41fb98a96cf519ba4671', 'request_id': 'req-6d3e782b-2b54-4315-97c6-5518ff6b479a'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:10.219473 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-ad3c896f-69d9-4ca0-8224-c07023c3993b None None] MFA Rules not processed for user `a005d8f0c46d44c7b6f2201a54717b12`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:03:10.221155 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-ad3c896f-69d9-4ca0-8224-c07023c3993b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:10.228688 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-6d3e782b-2b54-4315-97c6-5518ff6b479a admin admin] The token cache is being invalidate because project bd10e14e223f41fb98a96cf519ba4671 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:03:10.229062 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-6d3e782b-2b54-4315-97c6-5518ff6b479a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:10.231097 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-6d3e782b-2b54-4315-97c6-5518ff6b479a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:10.249078 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 880/1791] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:03:09 2022] DELETE /identity/v3/projects/bd10e14e223f41fb98a96cf519ba4671 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:03:10.253906 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b218387-1a8e-45d8-8a62-3ee298cafe14 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:10.254277 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b218387-1a8e-45d8-8a62-3ee298cafe14 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:10.254519 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b218387-1a8e-45d8-8a62-3ee298cafe14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:10.296130 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-7b218387-1a8e-45d8-8a62-3ee298cafe14 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:03:10.300451 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-7b218387-1a8e-45d8-8a62-3ee298cafe14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:10.497852 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 912/1792] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Aug 18 11:03:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:03:10.548083 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3c896f-69d9-4ca0-8224-c07023c3993b None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:10.549916 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-ad3c896f-69d9-4ca0-8224-c07023c3993b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:10.572669 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3c896f-69d9-4ca0-8224-c07023c3993b None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:10.594893 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 881/1793] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:03:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:03:10.595117 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0506bd-2fdd-49d6-9f49-d9bb0fe10487 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:10.595242 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411dda30-03df-48a6-ad66-db3874225427 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a005d8f0c46d44c7b6f2201a54717b12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:10.595403 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0506bd-2fdd-49d6-9f49-d9bb0fe10487 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:10.595689 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0506bd-2fdd-49d6-9f49-d9bb0fe10487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:10.596023 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411dda30-03df-48a6-ad66-db3874225427 service nova] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:10.596734 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411dda30-03df-48a6-ad66-db3874225427 service nova] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:10.597006 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411dda30-03df-48a6-ad66-db3874225427 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:10.634551 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411dda30-03df-48a6-ad66-db3874225427 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:10.636402 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411dda30-03df-48a6-ad66-db3874225427 service nova] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:10.641299 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-7b0506bd-2fdd-49d6-9f49-d9bb0fe10487 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:03:10.644368 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-7b0506bd-2fdd-49d6-9f49-d9bb0fe10487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:10.664735 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 913/1794] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:03:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:03:10.665830 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411dda30-03df-48a6-ad66-db3874225427 service nova] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:10.670480 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 882/1795] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:03:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:03:10.714971 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411dda30-03df-48a6-ad66-db3874225427 service nova] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:10.738004 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24672ad5-28e4-4197-89a6-0e4ed9c91c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:10.738675 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24672ad5-28e4-4197-89a6-0e4ed9c91c10 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:10.738960 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24672ad5-28e4-4197-89a6-0e4ed9c91c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:10.739254 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24672ad5-28e4-4197-89a6-0e4ed9c91c10 admin admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:10.740077 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24672ad5-28e4-4197-89a6-0e4ed9c91c10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:03:10.740459 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24672ad5-28e4-4197-89a6-0e4ed9c91c10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:10.742182 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24672ad5-28e4-4197-89a6-0e4ed9c91c10 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:10.776905 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 914/1796] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Aug 18 11:03:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:03:10.781259 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0506bd-2fdd-49d6-9f49-d9bb0fe10487 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:10.799842 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0506bd-2fdd-49d6-9f49-d9bb0fe10487 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:10.811534 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690b8ea0-c807-4b33-9d6f-d7b8013566ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:10.812249 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690b8ea0-c807-4b33-9d6f-d7b8013566ee admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:10.815072 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690b8ea0-c807-4b33-9d6f-d7b8013566ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:10.815390 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690b8ea0-c807-4b33-9d6f-d7b8013566ee admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:10.817286 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690b8ea0-c807-4b33-9d6f-d7b8013566ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:10.824592 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690b8ea0-c807-4b33-9d6f-d7b8013566ee admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:10.918248 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24672ad5-28e4-4197-89a6-0e4ed9c91c10 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:10.933005 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 883/1797] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:03:10 2022] POST /identity/v3/projects => generated 373 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:03:10.940469 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24672ad5-28e4-4197-89a6-0e4ed9c91c10 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:11.105813 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e96d40-2139-4af1-bd25-d0f71b90d877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:11.106628 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e96d40-2139-4af1-bd25-d0f71b90d877 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:11.106932 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e96d40-2139-4af1-bd25-d0f71b90d877 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:11.107310 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e96d40-2139-4af1-bd25-d0f71b90d877 admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:11.108040 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e96d40-2139-4af1-bd25-d0f71b90d877 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:11.111038 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e96d40-2139-4af1-bd25-d0f71b90d877 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:11.148579 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690b8ea0-c807-4b33-9d6f-d7b8013566ee admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:11.160202 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 915/1798] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:03:10 2022] POST /identity/v3/users => generated 287 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:03:11.165263 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690b8ea0-c807-4b33-9d6f-d7b8013566ee admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:11.182075 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed58ad8-19b3-4707-90ce-a66a3a4a3ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:11.182969 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed58ad8-19b3-4707-90ce-a66a3a4a3ce4 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:11.183299 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed58ad8-19b3-4707-90ce-a66a3a4a3ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:11.183865 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed58ad8-19b3-4707-90ce-a66a3a4a3ce4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:11.184632 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed58ad8-19b3-4707-90ce-a66a3a4a3ce4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:11.187492 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed58ad8-19b3-4707-90ce-a66a3a4a3ce4 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:11.211354 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e96d40-2139-4af1-bd25-d0f71b90d877 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:11.212850 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 884/1799] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:03:11 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:03:11.237685 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e96d40-2139-4af1-bd25-d0f71b90d877 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:11.244220 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65e4205-dd11-4c5d-b949-04e64feb86de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:11.244850 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65e4205-dd11-4c5d-b949-04e64feb86de admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:11.245862 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65e4205-dd11-4c5d-b949-04e64feb86de admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:11.246138 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65e4205-dd11-4c5d-b949-04e64feb86de admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:11.246807 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65e4205-dd11-4c5d-b949-04e64feb86de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:11.248497 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65e4205-dd11-4c5d-b949-04e64feb86de admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:11.317375 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed58ad8-19b3-4707-90ce-a66a3a4a3ce4 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:11.317720 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 916/1800] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:03:11 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:03:11.326157 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:03:11.341583 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed58ad8-19b3-4707-90ce-a66a3a4a3ce4 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:11.358362 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80929c49-957d-4c34-bee7-2ff9c607a1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:11.359413 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80929c49-957d-4c34-bee7-2ff9c607a1de admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:11.359920 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80929c49-957d-4c34-bee7-2ff9c607a1de admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:11.360413 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80929c49-957d-4c34-bee7-2ff9c607a1de admin admin] PATH_INFO: `/v3/projects/13230239cd5242fb894966aeef4b504e/users/e06c87f7a365459cb60dcdc1d43e95a6/roles/719e5c62188d4f8a838987d6e72ca8f7` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:11.400773 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80929c49-957d-4c34-bee7-2ff9c607a1de admin admin] RBAC: Authorizing `identity:create_grant(project_id=13230239cd5242fb894966aeef4b504e, user_id=e06c87f7a365459cb60dcdc1d43e95a6, role_id=719e5c62188d4f8a838987d6e72ca8f7)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:11.403866 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80929c49-957d-4c34-bee7-2ff9c607a1de admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:11.437419 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 885/1801] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:03:11 2022] PUT /identity/v3/projects/13230239cd5242fb894966aeef4b504e/users/e06c87f7a365459cb60dcdc1d43e95a6/roles/719e5c62188d4f8a838987d6e72ca8f7 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:03:11.449158 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df731d92-0667-4926-b55f-6be98a04dd74 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:11.449445 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df731d92-0667-4926-b55f-6be98a04dd74 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:11.449768 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df731d92-0667-4926-b55f-6be98a04dd74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:11.472219 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:03:11.535074 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-df731d92-0667-4926-b55f-6be98a04dd74 None None] MFA Rules not processed for user `e06c87f7a365459cb60dcdc1d43e95a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:03:11.543519 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-df731d92-0667-4926-b55f-6be98a04dd74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:11.782678 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 917/1802] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:03:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:03:11.788303 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80929c49-957d-4c34-bee7-2ff9c607a1de admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:11.935144 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80929c49-957d-4c34-bee7-2ff9c607a1de admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:11.943296 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ebe1b2-9e3d-451b-9198-9481389c7a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:11.945080 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ebe1b2-9e3d-451b-9198-9481389c7a4c admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:11.945859 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ebe1b2-9e3d-451b-9198-9481389c7a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:11.946340 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ebe1b2-9e3d-451b-9198-9481389c7a4c admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:11.947634 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ebe1b2-9e3d-451b-9198-9481389c7a4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:11.950701 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ebe1b2-9e3d-451b-9198-9481389c7a4c admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:12.029576 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 886/1803] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:03:11 2022] POST /identity/v3/projects => generated 371 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:03:12.034229 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df731d92-0667-4926-b55f-6be98a04dd74 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:12.063400 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df731d92-0667-4926-b55f-6be98a04dd74 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:12.273055 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edc42e6-c5dd-403c-9dc0-1ba37a37d9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:12.281601 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc42e6-c5dd-403c-9dc0-1ba37a37d9a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:12.283373 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc42e6-c5dd-403c-9dc0-1ba37a37d9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:12.284435 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc42e6-c5dd-403c-9dc0-1ba37a37d9a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:12.285297 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edc42e6-c5dd-403c-9dc0-1ba37a37d9a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:12.291346 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edc42e6-c5dd-403c-9dc0-1ba37a37d9a4 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:12.341186 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 918/1804] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:03:12 2022] POST /identity/v3/users => generated 292 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 11:03:12.343918 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ebe1b2-9e3d-451b-9198-9481389c7a4c admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:12.357733 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ebe1b2-9e3d-451b-9198-9481389c7a4c admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:12.369019 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dc6310-83b9-4193-b947-97ca47dd74ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:12.370827 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc6310-83b9-4193-b947-97ca47dd74ab admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:12.371114 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc6310-83b9-4193-b947-97ca47dd74ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:12.371390 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc6310-83b9-4193-b947-97ca47dd74ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:12.372060 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dc6310-83b9-4193-b947-97ca47dd74ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:12.377096 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dc6310-83b9-4193-b947-97ca47dd74ab admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:12.408738 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edc42e6-c5dd-403c-9dc0-1ba37a37d9a4 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:12.427914 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 887/1805] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:03:12 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:03:12.437576 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edc42e6-c5dd-403c-9dc0-1ba37a37d9a4 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:12.443417 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc7eca1-6744-42a2-ad0f-4c1a62203b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:12.444276 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc7eca1-6744-42a2-ad0f-4c1a62203b3d admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:12.444559 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc7eca1-6744-42a2-ad0f-4c1a62203b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:12.444843 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc7eca1-6744-42a2-ad0f-4c1a62203b3d admin admin] PATH_INFO: `/v3/projects/528a7d0bb8584967b7bde6b3297507a8/users/908710b11a8a4bcfaab31efc1de62765/roles/127fdc7ef05b4e0b98a940b334e5fcab` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:12.489202 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc7eca1-6744-42a2-ad0f-4c1a62203b3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=528a7d0bb8584967b7bde6b3297507a8, user_id=908710b11a8a4bcfaab31efc1de62765, role_id=127fdc7ef05b4e0b98a940b334e5fcab)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:12.496556 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc7eca1-6744-42a2-ad0f-4c1a62203b3d admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:12.552492 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dc6310-83b9-4193-b947-97ca47dd74ab admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:12.557978 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 919/1806] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:03:12 2022] PUT /identity/v3/projects/528a7d0bb8584967b7bde6b3297507a8/users/908710b11a8a4bcfaab31efc1de62765/roles/127fdc7ef05b4e0b98a940b334e5fcab => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:03:12.566373 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dc6310-83b9-4193-b947-97ca47dd74ab admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:12.694698 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb703b1e-ae1c-4bbf-8930-be8503057d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:12.695485 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb703b1e-ae1c-4bbf-8930-be8503057d2a admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:12.695678 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb703b1e-ae1c-4bbf-8930-be8503057d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:12.695962 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb703b1e-ae1c-4bbf-8930-be8503057d2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:12.696625 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb703b1e-ae1c-4bbf-8930-be8503057d2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:12.698558 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb703b1e-ae1c-4bbf-8930-be8503057d2a admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:12.730953 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc7eca1-6744-42a2-ad0f-4c1a62203b3d admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:12.736702 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 888/1807] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:03:12 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:03:12.743990 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc7eca1-6744-42a2-ad0f-4c1a62203b3d admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:12.749526 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f70c009-deaa-49d1-8f5b-4e9008b710f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:12.750919 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f70c009-deaa-49d1-8f5b-4e9008b710f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:12.751293 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f70c009-deaa-49d1-8f5b-4e9008b710f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:12.751724 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f70c009-deaa-49d1-8f5b-4e9008b710f1 admin admin] PATH_INFO: `/v3/projects/528a7d0bb8584967b7bde6b3297507a8/users/908710b11a8a4bcfaab31efc1de62765/roles/127fdc7ef05b4e0b98a940b334e5fcab` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:12.754238 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f70c009-deaa-49d1-8f5b-4e9008b710f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=528a7d0bb8584967b7bde6b3297507a8, user_id=908710b11a8a4bcfaab31efc1de62765, role_id=127fdc7ef05b4e0b98a940b334e5fcab)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:12.759689 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f70c009-deaa-49d1-8f5b-4e9008b710f1 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:12.790137 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 920/1808] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:03:12 2022] PUT /identity/v3/projects/528a7d0bb8584967b7bde6b3297507a8/users/908710b11a8a4bcfaab31efc1de62765/roles/127fdc7ef05b4e0b98a940b334e5fcab => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:03:12.791148 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b85fc-3e3b-4be8-a4ff-e589cb10c45d None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:12.791750 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b85fc-3e3b-4be8-a4ff-e589cb10c45d None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:12.792117 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b85fc-3e3b-4be8-a4ff-e589cb10c45d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:12.850032 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-ec4b85fc-3e3b-4be8-a4ff-e589cb10c45d None None] MFA Rules not processed for user `908710b11a8a4bcfaab31efc1de62765`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:03:12.851954 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-ec4b85fc-3e3b-4be8-a4ff-e589cb10c45d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:12.922595 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971b0e6-df3d-4751-b544-33b205dce21a None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:12.923185 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971b0e6-df3d-4751-b544-33b205dce21a None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:12.923710 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971b0e6-df3d-4751-b544-33b205dce21a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:12.955367 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-7971b0e6-df3d-4751-b544-33b205dce21a None None] MFA Rules not processed for user `57e117589fc14e4d9d8d8494bddf9c12`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:03:12.976716 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-7971b0e6-df3d-4751-b544-33b205dce21a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:13.005187 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:03:13.117474 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:03:13.139991 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 889/1809] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:03:12 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:03:13.151419 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 921/1810] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:03:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:03:13.159257 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4b85fc-3e3b-4be8-a4ff-e589cb10c45d None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:13.162999 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-ec4b85fc-3e3b-4be8-a4ff-e589cb10c45d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:13.333231 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4b85fc-3e3b-4be8-a4ff-e589cb10c45d None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:13.338375 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b4871c-9f25-4349-8848-237c228a93bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b8a09704b9b4ab2bffb813796ec6e77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:13.339018 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b4871c-9f25-4349-8848-237c228a93bb service cinder] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:13.339303 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b4871c-9f25-4349-8848-237c228a93bb service cinder] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:13.339874 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b4871c-9f25-4349-8848-237c228a93bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:13.357037 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b4871c-9f25-4349-8848-237c228a93bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:13.363203 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b4871c-9f25-4349-8848-237c228a93bb service cinder] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:13.384227 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 890/1811] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:03:13 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:03:13.450599 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37ba3d4-e58d-497d-98b5-64e1d2299f32 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:13.451041 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37ba3d4-e58d-497d-98b5-64e1d2299f32 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:13.451149 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37ba3d4-e58d-497d-98b5-64e1d2299f32 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:13.452509 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 922/1812] 10.222.0.15 () {54 vars in 921 bytes} [Thu Aug 18 11:03:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:03:13.471430 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e84668-7f7b-410c-aee7-af04d8c9552d None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:13.471721 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e84668-7f7b-410c-aee7-af04d8c9552d None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:13.474496 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e84668-7f7b-410c-aee7-af04d8c9552d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:13.515174 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37ba3d4-e58d-497d-98b5-64e1d2299f32 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:13.540554 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37ba3d4-e58d-497d-98b5-64e1d2299f32 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:13.546206 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-77e84668-7f7b-410c-aee7-af04d8c9552d None None] MFA Rules not processed for user `0f918bcdd83d4d48be3fff5a48c54929`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:03:13.547516 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-77e84668-7f7b-410c-aee7-af04d8c9552d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:13.550719 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1db05d8-a053-4631-b084-b7257f15104d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b8a09704b9b4ab2bffb813796ec6e77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:13.551562 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db05d8-a053-4631-b084-b7257f15104d service cinder] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:13.552621 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db05d8-a053-4631-b084-b7257f15104d service cinder] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:13.553714 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db05d8-a053-4631-b084-b7257f15104d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:13.700241 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 891/1813] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Aug 18 11:03:13 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:03:13.711517 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1db05d8-a053-4631-b084-b7257f15104d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:13.713013 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1db05d8-a053-4631-b084-b7257f15104d service cinder] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:13.723592 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f02b89a-0da8-48ae-b039-4c1f628990da None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:13.727118 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f02b89a-0da8-48ae-b039-4c1f628990da None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:13.727742 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f02b89a-0da8-48ae-b039-4c1f628990da None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:13.733568 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 923/1815] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:03:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:03:13.733873 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 892/1815] 10.222.0.15 () {54 vars in 921 bytes} [Thu Aug 18 11:03:13 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:03:13.752739 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1db05d8-a053-4631-b084-b7257f15104d service cinder] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:13.755439 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-a1db05d8-a053-4631-b084-b7257f15104d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:13.789335 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1db05d8-a053-4631-b084-b7257f15104d service cinder] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:13.805596 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b653d21a-6219-4c54-83ba-40112a72e8a4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f918bcdd83d4d48be3fff5a48c54929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:13.806281 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653d21a-6219-4c54-83ba-40112a72e8a4 service placement] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:13.806584 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653d21a-6219-4c54-83ba-40112a72e8a4 service placement] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:13.806863 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653d21a-6219-4c54-83ba-40112a72e8a4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:13.819855 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b653d21a-6219-4c54-83ba-40112a72e8a4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:13.822131 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b653d21a-6219-4c54-83ba-40112a72e8a4 service placement] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:13.876125 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 924/1816] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:03:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:03:13.999125 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b756753-63c2-4741-96dd-3bdd1880e46a None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:13.999756 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b756753-63c2-4741-96dd-3bdd1880e46a None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:14.000362 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b756753-63c2-4741-96dd-3bdd1880e46a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:14.138748 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-0b756753-63c2-4741-96dd-3bdd1880e46a None None] MFA Rules not processed for user `a005d8f0c46d44c7b6f2201a54717b12`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:03:14.142924 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-0b756753-63c2-4741-96dd-3bdd1880e46a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:14.327862 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 893/1817] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Aug 18 11:03:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:03:14.515863 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b653d21a-6219-4c54-83ba-40112a72e8a4 service placement] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:14.521983 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-b653d21a-6219-4c54-83ba-40112a72e8a4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:14.725317 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b653d21a-6219-4c54-83ba-40112a72e8a4 service placement] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:14.740629 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a95ebd8-1bc6-4660-8601-e84eee79a6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:14.741007 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a95ebd8-1bc6-4660-8601-e84eee79a6cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:14.741288 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a95ebd8-1bc6-4660-8601-e84eee79a6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:14.741582 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a95ebd8-1bc6-4660-8601-e84eee79a6cc admin admin] PATH_INFO: `/v3/projects/8765465a0c144fa1b88dbdf014f96719` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:14.743404 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a95ebd8-1bc6-4660-8601-e84eee79a6cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=8765465a0c144fa1b88dbdf014f96719)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:14.745391 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a95ebd8-1bc6-4660-8601-e84eee79a6cc admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:14.899883 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-5a95ebd8-1bc6-4660-8601-e84eee79a6cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8765465a0c144fa1b88dbdf014f96719', 'request_id': 'req-5a95ebd8-1bc6-4660-8601-e84eee79a6cc'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:14.915548 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-5a95ebd8-1bc6-4660-8601-e84eee79a6cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8765465a0c144fa1b88dbdf014f96719', 'request_id': 'req-5a95ebd8-1bc6-4660-8601-e84eee79a6cc'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:14.933549 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-5a95ebd8-1bc6-4660-8601-e84eee79a6cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8765465a0c144fa1b88dbdf014f96719', 'request_id': 'req-5a95ebd8-1bc6-4660-8601-e84eee79a6cc'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:14.978630 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-5a95ebd8-1bc6-4660-8601-e84eee79a6cc admin admin] The token cache is being invalidate because project 8765465a0c144fa1b88dbdf014f96719 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:03:14.979251 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-5a95ebd8-1bc6-4660-8601-e84eee79a6cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:14.980427 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-5a95ebd8-1bc6-4660-8601-e84eee79a6cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:14.983542 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 925/1818] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:03:14 2022] DELETE /identity/v3/projects/8765465a0c144fa1b88dbdf014f96719 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:03:14.988249 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b756753-63c2-4741-96dd-3bdd1880e46a None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:14.996963 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:03:15.012459 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b756753-63c2-4741-96dd-3bdd1880e46a None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:15.203478 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04af9fc-69b1-4c32-b889-61a2569109f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:15.205049 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04af9fc-69b1-4c32-b889-61a2569109f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:15.205447 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04af9fc-69b1-4c32-b889-61a2569109f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:15.205920 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04af9fc-69b1-4c32-b889-61a2569109f0 admin admin] PATH_INFO: `/v3/users/0343900ed31d47a187aea1a982f2d9a3` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:15.226081 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04af9fc-69b1-4c32-b889-61a2569109f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0343900ed31d47a187aea1a982f2d9a3)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:15.230684 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04af9fc-69b1-4c32-b889-61a2569109f0 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:15.397870 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a95ebd8-1bc6-4660-8601-e84eee79a6cc admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:15.400837 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-d04af9fc-69b1-4c32-b889-61a2569109f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0343900ed31d47a187aea1a982f2d9a3'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:15.403585 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-5a95ebd8-1bc6-4660-8601-e84eee79a6cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:15.421383 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-d04af9fc-69b1-4c32-b889-61a2569109f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0343900ed31d47a187aea1a982f2d9a3'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:15.423142 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-d04af9fc-69b1-4c32-b889-61a2569109f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0343900ed31d47a187aea1a982f2d9a3'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:15.446845 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-d04af9fc-69b1-4c32-b889-61a2569109f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0343900ed31d47a187aea1a982f2d9a3'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:15.481978 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:03:15.500036 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-d04af9fc-69b1-4c32-b889-61a2569109f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0343900ed31d47a187aea1a982f2d9a3'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:15.571458 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 894/1819] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:03:14 2022] DELETE /identity/v3/users/0343900ed31d47a187aea1a982f2d9a3 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:03:15.646403 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a95ebd8-1bc6-4660-8601-e84eee79a6cc admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:15.771868 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f0de9a-1fd4-4fd9-9fb0-1a0cc5dc3a40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a005d8f0c46d44c7b6f2201a54717b12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:15.773257 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f0de9a-1fd4-4fd9-9fb0-1a0cc5dc3a40 service nova] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:15.774099 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f0de9a-1fd4-4fd9-9fb0-1a0cc5dc3a40 service nova] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:15.774909 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f0de9a-1fd4-4fd9-9fb0-1a0cc5dc3a40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:15.777010 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-75f0de9a-1fd4-4fd9-9fb0-1a0cc5dc3a40 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:15.802141 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f0de9a-1fd4-4fd9-9fb0-1a0cc5dc3a40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:15.813710 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f0de9a-1fd4-4fd9-9fb0-1a0cc5dc3a40 service nova] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:15.861463 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 926/1820] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:03:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 11:03:16.340319 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04af9fc-69b1-4c32-b889-61a2569109f0 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:16.342185 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-d04af9fc-69b1-4c32-b889-61a2569109f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:16.425830 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04af9fc-69b1-4c32-b889-61a2569109f0 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:16.431271 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ea487f-c68b-43eb-90c0-cff6ef5922e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:16.431924 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ea487f-c68b-43eb-90c0-cff6ef5922e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:16.432204 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ea487f-c68b-43eb-90c0-cff6ef5922e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:16.432477 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ea487f-c68b-43eb-90c0-cff6ef5922e3 admin admin] PATH_INFO: `/v3/users/696d1305d948460d876ad41ebda6e794` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:16.433715 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ea487f-c68b-43eb-90c0-cff6ef5922e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=696d1305d948460d876ad41ebda6e794)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:16.435824 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ea487f-c68b-43eb-90c0-cff6ef5922e3 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:16.469292 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:03:16.499669 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-21ea487f-c68b-43eb-90c0-cff6ef5922e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '696d1305d948460d876ad41ebda6e794'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:16.513751 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-21ea487f-c68b-43eb-90c0-cff6ef5922e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '696d1305d948460d876ad41ebda6e794'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:16.514741 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-21ea487f-c68b-43eb-90c0-cff6ef5922e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '696d1305d948460d876ad41ebda6e794'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:16.515481 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-21ea487f-c68b-43eb-90c0-cff6ef5922e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '696d1305d948460d876ad41ebda6e794'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:16.525640 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-21ea487f-c68b-43eb-90c0-cff6ef5922e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '696d1305d948460d876ad41ebda6e794'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:16.551505 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f0de9a-1fd4-4fd9-9fb0-1a0cc5dc3a40 service nova] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:16.552990 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-75f0de9a-1fd4-4fd9-9fb0-1a0cc5dc3a40 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:16.555770 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 895/1821] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:03:16 2022] DELETE /identity/v3/users/696d1305d948460d876ad41ebda6e794 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:03:16.564425 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf64f3f-dce9-44cb-928e-9228127bd654 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:16.564819 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf64f3f-dce9-44cb-928e-9228127bd654 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:16.566397 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf64f3f-dce9-44cb-928e-9228127bd654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:16.581018 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f0de9a-1fd4-4fd9-9fb0-1a0cc5dc3a40 service nova] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:16.625345 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-2cf64f3f-dce9-44cb-928e-9228127bd654 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:03:16.626814 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-2cf64f3f-dce9-44cb-928e-9228127bd654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:16.702842 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baec0a8-e570-407f-bb0d-94aa94b0a6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:16.703359 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baec0a8-e570-407f-bb0d-94aa94b0a6b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:16.703861 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baec0a8-e570-407f-bb0d-94aa94b0a6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:16.704333 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baec0a8-e570-407f-bb0d-94aa94b0a6b8 admin admin] PATH_INFO: `/v3/users/1c576ca635654768a1c2b18e05b034ff` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:16.705812 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baec0a8-e570-407f-bb0d-94aa94b0a6b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c576ca635654768a1c2b18e05b034ff)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:16.709671 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baec0a8-e570-407f-bb0d-94aa94b0a6b8 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:16.769789 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:03:16.778132 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 896/1822] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:03:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:03:16.791650 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-1baec0a8-e570-407f-bb0d-94aa94b0a6b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c576ca635654768a1c2b18e05b034ff'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:16.793053 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-1baec0a8-e570-407f-bb0d-94aa94b0a6b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c576ca635654768a1c2b18e05b034ff'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:16.797662 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf64f3f-dce9-44cb-928e-9228127bd654 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:16.799775 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-2cf64f3f-dce9-44cb-928e-9228127bd654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:16.810563 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-1baec0a8-e570-407f-bb0d-94aa94b0a6b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c576ca635654768a1c2b18e05b034ff'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:16.832614 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-1baec0a8-e570-407f-bb0d-94aa94b0a6b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c576ca635654768a1c2b18e05b034ff'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:16.849602 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-1baec0a8-e570-407f-bb0d-94aa94b0a6b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c576ca635654768a1c2b18e05b034ff'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:16.873433 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 927/1823] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:03:16 2022] DELETE /identity/v3/users/1c576ca635654768a1c2b18e05b034ff => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:03:16.936508 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf64f3f-dce9-44cb-928e-9228127bd654 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:16.991026 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baec0a8-e570-407f-bb0d-94aa94b0a6b8 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:16.994545 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-1baec0a8-e570-407f-bb0d-94aa94b0a6b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:17.047086 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fbf3ef-66c0-4b7e-a747-7eaa370cec2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:17.048533 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fbf3ef-66c0-4b7e-a747-7eaa370cec2f service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:17.049252 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fbf3ef-66c0-4b7e-a747-7eaa370cec2f service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:17.049755 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fbf3ef-66c0-4b7e-a747-7eaa370cec2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:17.052995 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-51fbf3ef-66c0-4b7e-a747-7eaa370cec2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:17.095506 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:03:17.157216 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baec0a8-e570-407f-bb0d-94aa94b0a6b8 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:17.166030 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c5da32-8608-4e6e-827b-8193d854e157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:17.167438 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c5da32-8608-4e6e-827b-8193d854e157 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:17.167874 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c5da32-8608-4e6e-827b-8193d854e157 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:17.168159 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c5da32-8608-4e6e-827b-8193d854e157 admin admin] PATH_INFO: `/v3/projects/768b8aefc21d45bfbccee8ee11dd0906` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:17.171241 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c5da32-8608-4e6e-827b-8193d854e157 admin admin] RBAC: Authorizing `identity:delete_project(project_id=768b8aefc21d45bfbccee8ee11dd0906)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:17.175509 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c5da32-8608-4e6e-827b-8193d854e157 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:17.232100 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fbf3ef-66c0-4b7e-a747-7eaa370cec2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:17.233583 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fbf3ef-66c0-4b7e-a747-7eaa370cec2f service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:17.258234 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 897/1824] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:03:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:03:17.287578 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-94c5da32-8608-4e6e-827b-8193d854e157 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '768b8aefc21d45bfbccee8ee11dd0906', 'request_id': 'req-94c5da32-8608-4e6e-827b-8193d854e157'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:17.311747 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-94c5da32-8608-4e6e-827b-8193d854e157 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '768b8aefc21d45bfbccee8ee11dd0906', 'request_id': 'req-94c5da32-8608-4e6e-827b-8193d854e157'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:17.332845 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-94c5da32-8608-4e6e-827b-8193d854e157 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '768b8aefc21d45bfbccee8ee11dd0906', 'request_id': 'req-94c5da32-8608-4e6e-827b-8193d854e157'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:17.357936 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-94c5da32-8608-4e6e-827b-8193d854e157 admin admin] The token cache is being invalidate because project 768b8aefc21d45bfbccee8ee11dd0906 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:03:17.358400 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-94c5da32-8608-4e6e-827b-8193d854e157 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:17.359092 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-94c5da32-8608-4e6e-827b-8193d854e157 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:17.361664 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 928/1825] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:03:16 2022] DELETE /identity/v3/projects/768b8aefc21d45bfbccee8ee11dd0906 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:03:17.368154 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd462510-e17f-4102-b4bd-8efea3fd8602 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:17.368670 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd462510-e17f-4102-b4bd-8efea3fd8602 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:17.369403 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd462510-e17f-4102-b4bd-8efea3fd8602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:17.412812 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-bd462510-e17f-4102-b4bd-8efea3fd8602 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:03:17.416077 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-bd462510-e17f-4102-b4bd-8efea3fd8602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:17.539741 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 898/1826] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:03:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:03:17.540704 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b2ec2-0a67-4c34-a6c6-ebc0ec10c82f None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:17.540995 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b2ec2-0a67-4c34-a6c6-ebc0ec10c82f None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:17.541436 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b2ec2-0a67-4c34-a6c6-ebc0ec10c82f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:17.573985 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-723b2ec2-0a67-4c34-a6c6-ebc0ec10c82f None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:03:17.573985 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-723b2ec2-0a67-4c34-a6c6-ebc0ec10c82f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:17.588020 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 929/1827] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:03:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:03:17.599754 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd462510-e17f-4102-b4bd-8efea3fd8602 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:17.615799 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd462510-e17f-4102-b4bd-8efea3fd8602 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:17.622941 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723b2ec2-0a67-4c34-a6c6-ebc0ec10c82f None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:17.624457 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-723b2ec2-0a67-4c34-a6c6-ebc0ec10c82f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:17.628635 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dac7cf-0990-4977-a103-d80b0c7ef855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:17.630495 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dac7cf-0990-4977-a103-d80b0c7ef855 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:17.631319 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dac7cf-0990-4977-a103-d80b0c7ef855 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:17.631846 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dac7cf-0990-4977-a103-d80b0c7ef855 admin admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:17.639549 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dac7cf-0990-4977-a103-d80b0c7ef855 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:03:17.640075 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dac7cf-0990-4977-a103-d80b0c7ef855 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:17.640935 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723b2ec2-0a67-4c34-a6c6-ebc0ec10c82f None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:17.641942 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dac7cf-0990-4977-a103-d80b0c7ef855 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:17.646982 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d76ad26-ccfa-4992-bed5-47f71acebce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:17.647772 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d76ad26-ccfa-4992-bed5-47f71acebce7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:17.648253 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d76ad26-ccfa-4992-bed5-47f71acebce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:17.648658 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d76ad26-ccfa-4992-bed5-47f71acebce7 admin admin] PATH_INFO: `/v3/projects/45a09864d9cb4a31980b223bdaa379bc` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:17.650391 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d76ad26-ccfa-4992-bed5-47f71acebce7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45a09864d9cb4a31980b223bdaa379bc)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:17.652727 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d76ad26-ccfa-4992-bed5-47f71acebce7 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:17.656673 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 899/1828] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Aug 18 11:03:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:03:17.661974 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dac7cf-0990-4977-a103-d80b0c7ef855 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:17.678864 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dac7cf-0990-4977-a103-d80b0c7ef855 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:17.685072 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6905163f-4a2a-487b-a840-6355a38214c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:17.685882 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6905163f-4a2a-487b-a840-6355a38214c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:17.686234 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6905163f-4a2a-487b-a840-6355a38214c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:17.686617 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6905163f-4a2a-487b-a840-6355a38214c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:17.687496 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6905163f-4a2a-487b-a840-6355a38214c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:17.692146 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6905163f-4a2a-487b-a840-6355a38214c1 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:17.721497 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:03:17.739679 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 900/1829] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:03:17 2022] POST /identity/v3/projects => generated 385 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:03:17.745682 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6905163f-4a2a-487b-a840-6355a38214c1 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:17.752700 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-2d76ad26-ccfa-4992-bed5-47f71acebce7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45a09864d9cb4a31980b223bdaa379bc', 'request_id': 'req-2d76ad26-ccfa-4992-bed5-47f71acebce7'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:17.765348 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-2d76ad26-ccfa-4992-bed5-47f71acebce7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45a09864d9cb4a31980b223bdaa379bc', 'request_id': 'req-2d76ad26-ccfa-4992-bed5-47f71acebce7'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:17.777086 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-2d76ad26-ccfa-4992-bed5-47f71acebce7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45a09864d9cb4a31980b223bdaa379bc', 'request_id': 'req-2d76ad26-ccfa-4992-bed5-47f71acebce7'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:17.799696 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-2d76ad26-ccfa-4992-bed5-47f71acebce7 admin admin] The token cache is being invalidate because project 45a09864d9cb4a31980b223bdaa379bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:03:17.799823 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-2d76ad26-ccfa-4992-bed5-47f71acebce7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:17.801062 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-2d76ad26-ccfa-4992-bed5-47f71acebce7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:17.806853 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 930/1830] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:03:17 2022] DELETE /identity/v3/projects/45a09864d9cb4a31980b223bdaa379bc => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:03:17.808328 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d76ad26-ccfa-4992-bed5-47f71acebce7 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:17.810390 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-2d76ad26-ccfa-4992-bed5-47f71acebce7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:17.834537 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6905163f-4a2a-487b-a840-6355a38214c1 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:17.839829 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad3fde1-e826-44e7-abfa-a6cc26e76915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:17.840513 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad3fde1-e826-44e7-abfa-a6cc26e76915 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:17.840797 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad3fde1-e826-44e7-abfa-a6cc26e76915 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:17.841072 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad3fde1-e826-44e7-abfa-a6cc26e76915 admin admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:17.841744 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad3fde1-e826-44e7-abfa-a6cc26e76915 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:17.843702 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad3fde1-e826-44e7-abfa-a6cc26e76915 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:17.906723 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 901/1831] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:03:17 2022] POST /identity/v3/users => generated 293 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:03:17.906968 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d76ad26-ccfa-4992-bed5-47f71acebce7 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:17.912191 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad3fde1-e826-44e7-abfa-a6cc26e76915 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:17.912623 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6300095-c003-484c-9242-b2689b6be077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:17.913952 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6300095-c003-484c-9242-b2689b6be077 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:17.914519 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6300095-c003-484c-9242-b2689b6be077 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:17.914939 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6300095-c003-484c-9242-b2689b6be077 admin admin] PATH_INFO: `/v3/users/e27c22cb606f435e9fe4bcf97fa13763` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:17.915448 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-3ad3fde1-e826-44e7-abfa-a6cc26e76915 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:17.917058 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6300095-c003-484c-9242-b2689b6be077 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e27c22cb606f435e9fe4bcf97fa13763)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:17.919600 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6300095-c003-484c-9242-b2689b6be077 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:17.932137 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:03:17.938041 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad3fde1-e826-44e7-abfa-a6cc26e76915 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:17.948089 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e050c76-311b-4c95-ba53-9c1975aed797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:17.948089 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e050c76-311b-4c95-ba53-9c1975aed797 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:17.948089 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e050c76-311b-4c95-ba53-9c1975aed797 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:17.948089 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e050c76-311b-4c95-ba53-9c1975aed797 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:17.948655 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e050c76-311b-4c95-ba53-9c1975aed797 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:17.950971 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e050c76-311b-4c95-ba53-9c1975aed797 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:17.977812 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 902/1832] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:03:17 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 11:03:17.979056 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e050c76-311b-4c95-ba53-9c1975aed797 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:17.999007 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e050c76-311b-4c95-ba53-9c1975aed797 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:18.007159 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a04c7-59c8-4309-a01b-229bf0a46e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:18.007910 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a04c7-59c8-4309-a01b-229bf0a46e59 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:18.008198 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a04c7-59c8-4309-a01b-229bf0a46e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:18.009037 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a04c7-59c8-4309-a01b-229bf0a46e59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:18.009732 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17a04c7-59c8-4309-a01b-229bf0a46e59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:18.011918 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17a04c7-59c8-4309-a01b-229bf0a46e59 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:18.014250 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-c6300095-c003-484c-9242-b2689b6be077 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e27c22cb606f435e9fe4bcf97fa13763'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:18.015033 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-c6300095-c003-484c-9242-b2689b6be077 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e27c22cb606f435e9fe4bcf97fa13763'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:18.026167 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-c6300095-c003-484c-9242-b2689b6be077 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e27c22cb606f435e9fe4bcf97fa13763'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:18.026314 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 903/1833] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:03:17 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:03:18.030484 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a04c7-59c8-4309-a01b-229bf0a46e59 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:18.042272 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a04c7-59c8-4309-a01b-229bf0a46e59 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:18.046487 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-c6300095-c003-484c-9242-b2689b6be077 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e27c22cb606f435e9fe4bcf97fa13763'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:18.049619 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967fb357-b444-4a91-b669-f0f8820e428e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:18.051035 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967fb357-b444-4a91-b669-f0f8820e428e admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:18.051468 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967fb357-b444-4a91-b669-f0f8820e428e admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:18.052957 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967fb357-b444-4a91-b669-f0f8820e428e admin admin] PATH_INFO: `/v3/projects/fd89794b02274d42bc0bef8f9fe01228/users/82c60c2e72ab48889f5b75f997816105/roles/719e5c62188d4f8a838987d6e72ca8f7` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:18.059367 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-c6300095-c003-484c-9242-b2689b6be077 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e27c22cb606f435e9fe4bcf97fa13763'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:18.077010 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 931/1834] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:03:17 2022] DELETE /identity/v3/users/e27c22cb606f435e9fe4bcf97fa13763 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:03:18.081579 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967fb357-b444-4a91-b669-f0f8820e428e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd89794b02274d42bc0bef8f9fe01228, user_id=82c60c2e72ab48889f5b75f997816105, role_id=719e5c62188d4f8a838987d6e72ca8f7)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:18.084713 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967fb357-b444-4a91-b669-f0f8820e428e admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:18.117413 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 904/1835] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:03:18 2022] PUT /identity/v3/projects/fd89794b02274d42bc0bef8f9fe01228/users/82c60c2e72ab48889f5b75f997816105/roles/719e5c62188d4f8a838987d6e72ca8f7 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:03:18.119316 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2951bc-ad58-46c3-a85d-fc94913588f0 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:18.119604 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2951bc-ad58-46c3-a85d-fc94913588f0 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:18.119882 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2951bc-ad58-46c3-a85d-fc94913588f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:18.150913 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-ef2951bc-ad58-46c3-a85d-fc94913588f0 None None] MFA Rules not processed for user `82c60c2e72ab48889f5b75f997816105`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:03:18.151250 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-ef2951bc-ad58-46c3-a85d-fc94913588f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:18.201506 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:03:18.262405 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967fb357-b444-4a91-b669-f0f8820e428e admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:18.264767 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-967fb357-b444-4a91-b669-f0f8820e428e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:18.288831 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 932/1836] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:03:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:03:18.295568 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2951bc-ad58-46c3-a85d-fc94913588f0 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:18.297364 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-ef2951bc-ad58-46c3-a85d-fc94913588f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:18.356845 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967fb357-b444-4a91-b669-f0f8820e428e admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:18.362420 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe30b0d2-e160-4403-ae20-40c9d5dfe48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:18.363064 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe30b0d2-e160-4403-ae20-40c9d5dfe48b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:18.363348 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe30b0d2-e160-4403-ae20-40c9d5dfe48b admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:18.363630 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe30b0d2-e160-4403-ae20-40c9d5dfe48b admin admin] PATH_INFO: `/v3/projects/0aa16bfcb70448c2b0bdfb30c120fa97` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:18.366135 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe30b0d2-e160-4403-ae20-40c9d5dfe48b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0aa16bfcb70448c2b0bdfb30c120fa97)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:18.368106 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe30b0d2-e160-4403-ae20-40c9d5dfe48b admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:18.386496 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2951bc-ad58-46c3-a85d-fc94913588f0 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:18.392566 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b98b0c4-f954-46dc-ab1a-b4a05cd74b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:18.393251 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b98b0c4-f954-46dc-ab1a-b4a05cd74b9b admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:18.393551 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b98b0c4-f954-46dc-ab1a-b4a05cd74b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:18.393845 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b98b0c4-f954-46dc-ab1a-b4a05cd74b9b admin admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:18.394599 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b98b0c4-f954-46dc-ab1a-b4a05cd74b9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:18.397591 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b98b0c4-f954-46dc-ab1a-b4a05cd74b9b admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:18.433787 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 933/1837] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:03:18 2022] POST /identity/v3/projects => generated 387 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:03:18.433787 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b98b0c4-f954-46dc-ab1a-b4a05cd74b9b admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:18.435031 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-3b98b0c4-f954-46dc-ab1a-b4a05cd74b9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:18.435245 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-fe30b0d2-e160-4403-ae20-40c9d5dfe48b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0aa16bfcb70448c2b0bdfb30c120fa97', 'request_id': 'req-fe30b0d2-e160-4403-ae20-40c9d5dfe48b'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:18.443982 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-fe30b0d2-e160-4403-ae20-40c9d5dfe48b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0aa16bfcb70448c2b0bdfb30c120fa97', 'request_id': 'req-fe30b0d2-e160-4403-ae20-40c9d5dfe48b'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:18.451608 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-fe30b0d2-e160-4403-ae20-40c9d5dfe48b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0aa16bfcb70448c2b0bdfb30c120fa97', 'request_id': 'req-fe30b0d2-e160-4403-ae20-40c9d5dfe48b'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:18.463581 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-fe30b0d2-e160-4403-ae20-40c9d5dfe48b admin admin] The token cache is being invalidate because project 0aa16bfcb70448c2b0bdfb30c120fa97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:03:18.463869 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-fe30b0d2-e160-4403-ae20-40c9d5dfe48b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:18.464660 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-fe30b0d2-e160-4403-ae20-40c9d5dfe48b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:18.466231 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 905/1838] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:03:18 2022] DELETE /identity/v3/projects/0aa16bfcb70448c2b0bdfb30c120fa97 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:03:18.469196 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe30b0d2-e160-4403-ae20-40c9d5dfe48b admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:18.469196 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-fe30b0d2-e160-4403-ae20-40c9d5dfe48b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:18.505881 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b98b0c4-f954-46dc-ab1a-b4a05cd74b9b admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:18.510763 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e922918-7b90-4a7d-b767-0fe8e2b62b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:18.511466 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e922918-7b90-4a7d-b767-0fe8e2b62b07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:18.511750 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e922918-7b90-4a7d-b767-0fe8e2b62b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:18.512029 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e922918-7b90-4a7d-b767-0fe8e2b62b07 admin admin] PATH_INFO: `/v3/projects/b639a55bb8fb48959a70ae9048e14a19` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:18.513165 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e922918-7b90-4a7d-b767-0fe8e2b62b07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b639a55bb8fb48959a70ae9048e14a19)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:18.515134 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e922918-7b90-4a7d-b767-0fe8e2b62b07 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:18.521544 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:03:18.538091 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe30b0d2-e160-4403-ae20-40c9d5dfe48b admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:18.543154 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1dbdc8-2ee3-46ca-af27-0b5ed663e9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:18.543770 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1dbdc8-2ee3-46ca-af27-0b5ed663e9b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:18.544052 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1dbdc8-2ee3-46ca-af27-0b5ed663e9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:18.544327 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1dbdc8-2ee3-46ca-af27-0b5ed663e9b6 admin admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:18.544956 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1dbdc8-2ee3-46ca-af27-0b5ed663e9b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:18.546904 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1dbdc8-2ee3-46ca-af27-0b5ed663e9b6 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:18.568761 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-2e922918-7b90-4a7d-b767-0fe8e2b62b07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b639a55bb8fb48959a70ae9048e14a19', 'request_id': 'req-2e922918-7b90-4a7d-b767-0fe8e2b62b07'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:18.568972 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 906/1839] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:03:18 2022] POST /identity/v3/users => generated 300 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:03:18.569904 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1dbdc8-2ee3-46ca-af27-0b5ed663e9b6 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:18.571652 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-0b1dbdc8-2ee3-46ca-af27-0b5ed663e9b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:18.573054 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:03:18.577833 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-2e922918-7b90-4a7d-b767-0fe8e2b62b07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b639a55bb8fb48959a70ae9048e14a19', 'request_id': 'req-2e922918-7b90-4a7d-b767-0fe8e2b62b07'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:18.585374 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1dbdc8-2ee3-46ca-af27-0b5ed663e9b6 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:18.587233 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-2e922918-7b90-4a7d-b767-0fe8e2b62b07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b639a55bb8fb48959a70ae9048e14a19', 'request_id': 'req-2e922918-7b90-4a7d-b767-0fe8e2b62b07'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:18.604022 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-2e922918-7b90-4a7d-b767-0fe8e2b62b07 admin admin] The token cache is being invalidate because project b639a55bb8fb48959a70ae9048e14a19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:03:18.604322 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-2e922918-7b90-4a7d-b767-0fe8e2b62b07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:18.605804 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-2e922918-7b90-4a7d-b767-0fe8e2b62b07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:18.608557 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 934/1840] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:03:18 2022] DELETE /identity/v3/projects/b639a55bb8fb48959a70ae9048e14a19 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:03:18.610403 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e922918-7b90-4a7d-b767-0fe8e2b62b07 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:18.611840 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-2e922918-7b90-4a7d-b767-0fe8e2b62b07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:18.645625 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37528800-7b79-4110-be07-e836dbee0f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:18.646254 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37528800-7b79-4110-be07-e836dbee0f78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:18.646545 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37528800-7b79-4110-be07-e836dbee0f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:18.646812 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37528800-7b79-4110-be07-e836dbee0f78 admin admin] PATH_INFO: `/v3/users/61ae887498014989af26c138858fb472` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:18.647959 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37528800-7b79-4110-be07-e836dbee0f78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61ae887498014989af26c138858fb472)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:18.649915 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37528800-7b79-4110-be07-e836dbee0f78 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:18.681338 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e922918-7b90-4a7d-b767-0fe8e2b62b07 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:18.686114 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e212b-2bcc-4087-9bd9-8dbac80130a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:18.686976 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e212b-2bcc-4087-9bd9-8dbac80130a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:18.687259 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e212b-2bcc-4087-9bd9-8dbac80130a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:18.687536 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e212b-2bcc-4087-9bd9-8dbac80130a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:18.688182 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5e212b-2bcc-4087-9bd9-8dbac80130a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:18.689812 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5e212b-2bcc-4087-9bd9-8dbac80130a2 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:18.699792 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-37528800-7b79-4110-be07-e836dbee0f78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61ae887498014989af26c138858fb472'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:18.703472 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 935/1841] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:03:18 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:03:18.703472 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c644d203-6200-4f17-b9f0-3ec1670b12f8 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:18.703472 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c644d203-6200-4f17-b9f0-3ec1670b12f8 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:18.703472 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c644d203-6200-4f17-b9f0-3ec1670b12f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:18.709151 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-37528800-7b79-4110-be07-e836dbee0f78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61ae887498014989af26c138858fb472'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:18.709939 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-37528800-7b79-4110-be07-e836dbee0f78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61ae887498014989af26c138858fb472'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:18.711459 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-37528800-7b79-4110-be07-e836dbee0f78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61ae887498014989af26c138858fb472'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:18.718971 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-37528800-7b79-4110-be07-e836dbee0f78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61ae887498014989af26c138858fb472'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:18.721154 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-c644d203-6200-4f17-b9f0-3ec1670b12f8 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:03:18.722397 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-c644d203-6200-4f17-b9f0-3ec1670b12f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:18.730762 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 936/1842] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:03:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:03:18.731519 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c644d203-6200-4f17-b9f0-3ec1670b12f8 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:18.732785 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-c644d203-6200-4f17-b9f0-3ec1670b12f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:18.738064 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 907/1843] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:03:18 2022] DELETE /identity/v3/users/61ae887498014989af26c138858fb472 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:03:18.739537 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c90f8-92dc-40b4-b72d-6048980158a8 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:18.739775 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c90f8-92dc-40b4-b72d-6048980158a8 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:18.739990 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c90f8-92dc-40b4-b72d-6048980158a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:18.750180 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c644d203-6200-4f17-b9f0-3ec1670b12f8 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:18.761828 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-782c90f8-92dc-40b4-b72d-6048980158a8 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:03:18.763043 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-782c90f8-92dc-40b4-b72d-6048980158a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:18.821065 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafbf98b-4229-4539-b451-eeaaf4d6d540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:18.821945 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafbf98b-4229-4539-b451-eeaaf4d6d540 admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:18.822232 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafbf98b-4229-4539-b451-eeaaf4d6d540 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:18.822510 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafbf98b-4229-4539-b451-eeaaf4d6d540 admin admin] PATH_INFO: `/v3/projects/a631141318444d2ab19c80b86e319562/users/fb9f69e4a04f48c1bd2d2270a9d1241a/roles/127fdc7ef05b4e0b98a940b334e5fcab` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:18.824421 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:03:18.838170 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 908/1844] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:03:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:03:18.842103 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782c90f8-92dc-40b4-b72d-6048980158a8 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:18.846338 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafbf98b-4229-4539-b451-eeaaf4d6d540 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a631141318444d2ab19c80b86e319562, user_id=fb9f69e4a04f48c1bd2d2270a9d1241a, role_id=127fdc7ef05b4e0b98a940b334e5fcab)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:18.849867 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafbf98b-4229-4539-b451-eeaaf4d6d540 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:18.853180 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782c90f8-92dc-40b4-b72d-6048980158a8 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:18.859566 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365b6fe7-1c24-4e59-a1ec-1865f51a01a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:18.860295 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365b6fe7-1c24-4e59-a1ec-1865f51a01a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:18.860645 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365b6fe7-1c24-4e59-a1ec-1865f51a01a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:18.861113 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365b6fe7-1c24-4e59-a1ec-1865f51a01a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:18.861906 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365b6fe7-1c24-4e59-a1ec-1865f51a01a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:03:18.862281 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365b6fe7-1c24-4e59-a1ec-1865f51a01a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:18.863997 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365b6fe7-1c24-4e59-a1ec-1865f51a01a4 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:18.866419 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 937/1845] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:03:18 2022] PUT /identity/v3/projects/a631141318444d2ab19c80b86e319562/users/fb9f69e4a04f48c1bd2d2270a9d1241a/roles/127fdc7ef05b4e0b98a940b334e5fcab => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:03:18.870191 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafbf98b-4229-4539-b451-eeaaf4d6d540 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:18.877800 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 909/1846] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Aug 18 11:03:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:03:18.885768 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365b6fe7-1c24-4e59-a1ec-1865f51a01a4 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:18.900755 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365b6fe7-1c24-4e59-a1ec-1865f51a01a4 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:18.955298 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:03:18.961804 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafbf98b-4229-4539-b451-eeaaf4d6d540 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:18.970245 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95375554-0f18-4023-a7d5-28b070a30e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:18.971373 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95375554-0f18-4023-a7d5-28b070a30e83 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:18.972139 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95375554-0f18-4023-a7d5-28b070a30e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:18.972601 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95375554-0f18-4023-a7d5-28b070a30e83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:18.973418 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95375554-0f18-4023-a7d5-28b070a30e83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:18.975448 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95375554-0f18-4023-a7d5-28b070a30e83 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:18.980444 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0013ff-54af-4135-9e9d-c1c7eaad796a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:18.981085 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0013ff-54af-4135-9e9d-c1c7eaad796a admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:18.981364 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0013ff-54af-4135-9e9d-c1c7eaad796a admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:18.981690 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0013ff-54af-4135-9e9d-c1c7eaad796a admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:18.982730 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0013ff-54af-4135-9e9d-c1c7eaad796a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:18.984423 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0013ff-54af-4135-9e9d-c1c7eaad796a admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:18.988434 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 938/1847] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:03:18 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 11:03:18.992665 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95375554-0f18-4023-a7d5-28b070a30e83 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:19.005978 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95375554-0f18-4023-a7d5-28b070a30e83 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:19.012265 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188d59bb-ab86-45d2-869c-dc1900c82acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:19.013121 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d59bb-ab86-45d2-869c-dc1900c82acf admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:19.013363 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d59bb-ab86-45d2-869c-dc1900c82acf admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:19.013833 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d59bb-ab86-45d2-869c-dc1900c82acf admin admin] PATH_INFO: `/v3/projects/a631141318444d2ab19c80b86e319562/users/fb9f69e4a04f48c1bd2d2270a9d1241a/roles/127fdc7ef05b4e0b98a940b334e5fcab` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:19.016099 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188d59bb-ab86-45d2-869c-dc1900c82acf admin admin] RBAC: Authorizing `identity:create_grant(project_id=a631141318444d2ab19c80b86e319562, user_id=fb9f69e4a04f48c1bd2d2270a9d1241a, role_id=127fdc7ef05b4e0b98a940b334e5fcab)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:19.019247 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188d59bb-ab86-45d2-869c-dc1900c82acf admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:19.032327 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 939/1848] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:03:18 2022] PUT /identity/v3/projects/a631141318444d2ab19c80b86e319562/users/fb9f69e4a04f48c1bd2d2270a9d1241a/roles/127fdc7ef05b4e0b98a940b334e5fcab => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:03:19.034111 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 910/1849] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:03:18 2022] POST /identity/v3/projects => generated 363 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 11:03:19.038390 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188d59bb-ab86-45d2-869c-dc1900c82acf admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:19.043581 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb6e740-7cca-4aab-9f2d-4f823400008d None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:19.044020 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb6e740-7cca-4aab-9f2d-4f823400008d None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:19.044442 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb6e740-7cca-4aab-9f2d-4f823400008d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:19.078642 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-8eb6e740-7cca-4aab-9f2d-4f823400008d None None] MFA Rules not processed for user `fb9f69e4a04f48c1bd2d2270a9d1241a`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:03:19.079894 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-8eb6e740-7cca-4aab-9f2d-4f823400008d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:19.116408 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188d59bb-ab86-45d2-869c-dc1900c82acf admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:19.202181 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 911/1850] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:03:19 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:03:19.202181 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb6e740-7cca-4aab-9f2d-4f823400008d None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:19.211575 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-8eb6e740-7cca-4aab-9f2d-4f823400008d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:19.255585 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49512944-8527-4cbb-969b-f58d8d56dbfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:19.257466 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49512944-8527-4cbb-969b-f58d8d56dbfb admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:19.257466 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49512944-8527-4cbb-969b-f58d8d56dbfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:19.257466 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49512944-8527-4cbb-969b-f58d8d56dbfb admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:19.257466 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49512944-8527-4cbb-969b-f58d8d56dbfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:19.264203 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49512944-8527-4cbb-969b-f58d8d56dbfb admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:19.288912 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:03:19.297412 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb6e740-7cca-4aab-9f2d-4f823400008d None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:19.298811 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 940/1851] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:03:19 2022] POST /identity/v3/users => generated 282 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:03:19.299729 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49512944-8527-4cbb-969b-f58d8d56dbfb admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:19.302436 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-49512944-8527-4cbb-969b-f58d8d56dbfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:19.308472 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fed069c-c3c0-4637-859a-62de473e0588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:19.309131 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed069c-c3c0-4637-859a-62de473e0588 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:19.309414 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed069c-c3c0-4637-859a-62de473e0588 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:19.309729 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed069c-c3c0-4637-859a-62de473e0588 admin admin] PATH_INFO: `/v3/projects/fd03c0233d8f4d3eb7963b37877b7fbd` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:19.314249 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fed069c-c3c0-4637-859a-62de473e0588 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd03c0233d8f4d3eb7963b37877b7fbd)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:19.316499 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fed069c-c3c0-4637-859a-62de473e0588 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:19.379652 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-3fed069c-c3c0-4637-859a-62de473e0588 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd03c0233d8f4d3eb7963b37877b7fbd', 'request_id': 'req-3fed069c-c3c0-4637-859a-62de473e0588'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:19.383569 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49512944-8527-4cbb-969b-f58d8d56dbfb admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:19.390445 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-3fed069c-c3c0-4637-859a-62de473e0588 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd03c0233d8f4d3eb7963b37877b7fbd', 'request_id': 'req-3fed069c-c3c0-4637-859a-62de473e0588'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:19.400190 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-3fed069c-c3c0-4637-859a-62de473e0588 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd03c0233d8f4d3eb7963b37877b7fbd', 'request_id': 'req-3fed069c-c3c0-4637-859a-62de473e0588'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:19.414553 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-3fed069c-c3c0-4637-859a-62de473e0588 admin admin] The token cache is being invalidate because project fd03c0233d8f4d3eb7963b37877b7fbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:03:19.414927 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-3fed069c-c3c0-4637-859a-62de473e0588 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:19.415565 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-3fed069c-c3c0-4637-859a-62de473e0588 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:19.417195 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 912/1852] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:03:19 2022] DELETE /identity/v3/projects/fd03c0233d8f4d3eb7963b37877b7fbd => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:03:19.418014 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fed069c-c3c0-4637-859a-62de473e0588 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:19.419343 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-3fed069c-c3c0-4637-859a-62de473e0588 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:19.419493 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:03:19.447303 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4d9d6a-9177-4b85-a660-1b8a78467355 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b8a09704b9b4ab2bffb813796ec6e77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:19.448237 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d9d6a-9177-4b85-a660-1b8a78467355 service cinder] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:19.448596 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d9d6a-9177-4b85-a660-1b8a78467355 service cinder] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:19.448875 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d9d6a-9177-4b85-a660-1b8a78467355 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:19.451359 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-4c4d9d6a-9177-4b85-a660-1b8a78467355 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:19.492867 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fed069c-c3c0-4637-859a-62de473e0588 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:19.498014 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853d52d4-1b87-446f-b4af-eb604845e9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:19.498559 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d52d4-1b87-446f-b4af-eb604845e9cf admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:19.498964 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d52d4-1b87-446f-b4af-eb604845e9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:19.499237 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d52d4-1b87-446f-b4af-eb604845e9cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:19.499893 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853d52d4-1b87-446f-b4af-eb604845e9cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:19.501461 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853d52d4-1b87-446f-b4af-eb604845e9cf admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:19.511709 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 913/1853] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:03:19 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:03:19.512925 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759af9e9-6dbe-4b45-96f5-07007f6b122c None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:19.513203 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759af9e9-6dbe-4b45-96f5-07007f6b122c None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:19.513471 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759af9e9-6dbe-4b45-96f5-07007f6b122c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:19.527539 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4d9d6a-9177-4b85-a660-1b8a78467355 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:19.528974 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4d9d6a-9177-4b85-a660-1b8a78467355 service cinder] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:19.532424 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-759af9e9-6dbe-4b45-96f5-07007f6b122c None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:03:19.533644 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-759af9e9-6dbe-4b45-96f5-07007f6b122c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:19.539674 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 941/1854] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:03:19 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:03:19.540568 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4d9d6a-9177-4b85-a660-1b8a78467355 service cinder] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:19.542329 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 914/1855] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:03:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:03:19.550021 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a140dce5-7091-44f6-98c6-754ce49d09d5 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:19.550307 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a140dce5-7091-44f6-98c6-754ce49d09d5 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:19.550583 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a140dce5-7091-44f6-98c6-754ce49d09d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:19.551364 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4d9d6a-9177-4b85-a660-1b8a78467355 service cinder] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:19.556661 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08ba838-1954-41b7-b4c8-8a92bf29ca2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:19.557300 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ba838-1954-41b7-b4c8-8a92bf29ca2a admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:19.557625 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ba838-1954-41b7-b4c8-8a92bf29ca2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:19.557895 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ba838-1954-41b7-b4c8-8a92bf29ca2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:19.558535 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08ba838-1954-41b7-b4c8-8a92bf29ca2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:19.560353 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08ba838-1954-41b7-b4c8-8a92bf29ca2a admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:19.573123 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-a140dce5-7091-44f6-98c6-754ce49d09d5 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:03:19.576801 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 942/1856] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:03:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:03:19.576889 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-a140dce5-7091-44f6-98c6-754ce49d09d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:19.577755 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08ba838-1954-41b7-b4c8-8a92bf29ca2a admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:19.582874 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 915/1857] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:03:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:03:19.587054 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a140dce5-7091-44f6-98c6-754ce49d09d5 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:19.590522 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08ba838-1954-41b7-b4c8-8a92bf29ca2a admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:19.595598 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef98491-7b1e-4fd3-a48e-48b88fcf6d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:19.596272 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef98491-7b1e-4fd3-a48e-48b88fcf6d13 admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:19.596555 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef98491-7b1e-4fd3-a48e-48b88fcf6d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:19.596826 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef98491-7b1e-4fd3-a48e-48b88fcf6d13 admin admin] PATH_INFO: `/v3/projects/498e457716db4bdd995893b30836af5d/users/cfdfd58ef08642b29160889bc1f53b04/roles/719e5c62188d4f8a838987d6e72ca8f7` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:19.597548 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a140dce5-7091-44f6-98c6-754ce49d09d5 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:19.604397 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17409a4-ea60-4d96-9504-9a2a01e81fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:19.605576 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17409a4-ea60-4d96-9504-9a2a01e81fad admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:19.606169 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17409a4-ea60-4d96-9504-9a2a01e81fad admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:19.606676 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17409a4-ea60-4d96-9504-9a2a01e81fad admin admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:19.608503 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17409a4-ea60-4d96-9504-9a2a01e81fad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:03:19.609243 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17409a4-ea60-4d96-9504-9a2a01e81fad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:19.613123 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17409a4-ea60-4d96-9504-9a2a01e81fad admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:19.615373 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef98491-7b1e-4fd3-a48e-48b88fcf6d13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=498e457716db4bdd995893b30836af5d, user_id=cfdfd58ef08642b29160889bc1f53b04, role_id=719e5c62188d4f8a838987d6e72ca8f7)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:19.618389 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef98491-7b1e-4fd3-a48e-48b88fcf6d13 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:19.633305 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 943/1858] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:03:19 2022] PUT /identity/v3/projects/498e457716db4bdd995893b30836af5d/users/cfdfd58ef08642b29160889bc1f53b04/roles/719e5c62188d4f8a838987d6e72ca8f7 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:03:19.640521 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 916/1859] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Aug 18 11:03:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:03:19.644767 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef98491-7b1e-4fd3-a48e-48b88fcf6d13 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:19.656766 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d20d6ac-cf50-47b7-aa10-30afbf04aed6 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:19.657301 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d20d6ac-cf50-47b7-aa10-30afbf04aed6 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:19.657468 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d20d6ac-cf50-47b7-aa10-30afbf04aed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:19.711585 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-6d20d6ac-cf50-47b7-aa10-30afbf04aed6 None None] MFA Rules not processed for user `cfdfd58ef08642b29160889bc1f53b04`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:03:19.713489 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-6d20d6ac-cf50-47b7-aa10-30afbf04aed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:19.737997 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef98491-7b1e-4fd3-a48e-48b88fcf6d13 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:19.745312 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac28f9aa-ccb7-49dd-a682-357ba760064c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:19.746281 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28f9aa-ccb7-49dd-a682-357ba760064c admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:19.746725 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28f9aa-ccb7-49dd-a682-357ba760064c admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:19.747167 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28f9aa-ccb7-49dd-a682-357ba760064c admin admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:19.748275 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac28f9aa-ccb7-49dd-a682-357ba760064c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:19.752006 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac28f9aa-ccb7-49dd-a682-357ba760064c admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:19.767989 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:03:19.794181 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 944/1860] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:03:19 2022] POST /identity/v3/projects => generated 375 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 11:03:19.799564 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 917/1861] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:03:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:03:19.800435 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac28f9aa-ccb7-49dd-a682-357ba760064c admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:19.804705 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d20d6ac-cf50-47b7-aa10-30afbf04aed6 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:19.815866 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d20d6ac-cf50-47b7-aa10-30afbf04aed6 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:19.857887 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:03:19.888764 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1eee76-6484-498e-ab70-02b41dedabc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:19.889388 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1eee76-6484-498e-ab70-02b41dedabc3 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:19.889719 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1eee76-6484-498e-ab70-02b41dedabc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:19.889985 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1eee76-6484-498e-ab70-02b41dedabc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:19.890903 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1eee76-6484-498e-ab70-02b41dedabc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:19.893494 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1eee76-6484-498e-ab70-02b41dedabc3 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:19.898046 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac28f9aa-ccb7-49dd-a682-357ba760064c admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:19.904215 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b5f859-97cb-440e-9105-0e3939fa9f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:19.904841 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b5f859-97cb-440e-9105-0e3939fa9f4c admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:19.905149 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b5f859-97cb-440e-9105-0e3939fa9f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:19.905387 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b5f859-97cb-440e-9105-0e3939fa9f4c admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:19.910472 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b5f859-97cb-440e-9105-0e3939fa9f4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:19.910472 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b5f859-97cb-440e-9105-0e3939fa9f4c admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:19.929353 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 918/1862] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:03:19 2022] POST /identity/v3/projects => generated 361 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:03:19.933564 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 945/1863] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:03:19 2022] POST /identity/v3/users => generated 288 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 11:03:19.936344 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1eee76-6484-498e-ab70-02b41dedabc3 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:19.936465 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b5f859-97cb-440e-9105-0e3939fa9f4c admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:19.948720 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b5f859-97cb-440e-9105-0e3939fa9f4c admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:20.013048 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1eee76-6484-498e-ab70-02b41dedabc3 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:20.016424 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7272e5-a983-44a3-9b74-6821be0a4621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:20.017070 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7272e5-a983-44a3-9b74-6821be0a4621 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:20.017347 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7272e5-a983-44a3-9b74-6821be0a4621 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:20.017642 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7272e5-a983-44a3-9b74-6821be0a4621 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:20.018286 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7272e5-a983-44a3-9b74-6821be0a4621 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:20.018411 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821f6a78-2ef0-4512-8710-9995bb694a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:20.018910 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821f6a78-2ef0-4512-8710-9995bb694a00 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:20.019192 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821f6a78-2ef0-4512-8710-9995bb694a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:20.019467 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821f6a78-2ef0-4512-8710-9995bb694a00 admin admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:20.019952 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7272e5-a983-44a3-9b74-6821be0a4621 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:20.020070 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821f6a78-2ef0-4512-8710-9995bb694a00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:20.022275 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821f6a78-2ef0-4512-8710-9995bb694a00 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:20.041055 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 946/1864] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:03:19 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 11:03:20.045269 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7272e5-a983-44a3-9b74-6821be0a4621 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:20.055957 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 919/1865] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:03:19 2022] POST /identity/v3/users => generated 287 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 11:03:20.059896 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7272e5-a983-44a3-9b74-6821be0a4621 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:20.062454 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821f6a78-2ef0-4512-8710-9995bb694a00 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:20.064875 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbc1c5e-0fb8-4e9b-9ccb-dbd65224ed19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:20.065479 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbc1c5e-0fb8-4e9b-9ccb-dbd65224ed19 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:20.065786 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbc1c5e-0fb8-4e9b-9ccb-dbd65224ed19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:20.066059 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbc1c5e-0fb8-4e9b-9ccb-dbd65224ed19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:20.066705 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbc1c5e-0fb8-4e9b-9ccb-dbd65224ed19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:20.069006 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbc1c5e-0fb8-4e9b-9ccb-dbd65224ed19 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:20.074459 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821f6a78-2ef0-4512-8710-9995bb694a00 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:20.079901 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6996ed87-1899-42d0-8546-c3e1cbabe2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:20.080782 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6996ed87-1899-42d0-8546-c3e1cbabe2e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:20.080889 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 947/1866] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:03:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:03:20.080979 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6996ed87-1899-42d0-8546-c3e1cbabe2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:20.081309 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6996ed87-1899-42d0-8546-c3e1cbabe2e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:20.082082 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6996ed87-1899-42d0-8546-c3e1cbabe2e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:20.083723 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6996ed87-1899-42d0-8546-c3e1cbabe2e5 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:20.085283 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbc1c5e-0fb8-4e9b-9ccb-dbd65224ed19 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:20.095577 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbc1c5e-0fb8-4e9b-9ccb-dbd65224ed19 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:20.096732 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 920/1867] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:03:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 11:03:20.101599 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6996ed87-1899-42d0-8546-c3e1cbabe2e5 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:20.103932 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e4b944-5e2c-4541-8136-bdbc364feefd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:20.104704 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e4b944-5e2c-4541-8136-bdbc364feefd admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:20.105061 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e4b944-5e2c-4541-8136-bdbc364feefd admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:20.105402 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e4b944-5e2c-4541-8136-bdbc364feefd admin admin] PATH_INFO: `/v3/projects/8700aae079914c34a43725b5e670ebfe/users/cd6c278e04a143afb345166552b0bc2e/roles/719e5c62188d4f8a838987d6e72ca8f7` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:20.114423 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6996ed87-1899-42d0-8546-c3e1cbabe2e5 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:20.119851 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fad055-7eee-4adf-afdf-96fb10f71608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:20.120524 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fad055-7eee-4adf-afdf-96fb10f71608 admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:20.120808 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fad055-7eee-4adf-afdf-96fb10f71608 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:20.121084 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fad055-7eee-4adf-afdf-96fb10f71608 admin admin] PATH_INFO: `/v3/projects/aa79e1f0a44b42caa0638ab1557acf57/users/57b81a2b4ceb45a786ed72202c5050eb/roles/127fdc7ef05b4e0b98a940b334e5fcab` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:20.121688 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e4b944-5e2c-4541-8136-bdbc364feefd admin admin] RBAC: Authorizing `identity:create_grant(project_id=8700aae079914c34a43725b5e670ebfe, user_id=cd6c278e04a143afb345166552b0bc2e, role_id=719e5c62188d4f8a838987d6e72ca8f7)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:20.124318 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e4b944-5e2c-4541-8136-bdbc364feefd admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:20.138567 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fad055-7eee-4adf-afdf-96fb10f71608 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa79e1f0a44b42caa0638ab1557acf57, user_id=57b81a2b4ceb45a786ed72202c5050eb, role_id=127fdc7ef05b4e0b98a940b334e5fcab)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:20.141432 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fad055-7eee-4adf-afdf-96fb10f71608 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:20.141993 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 948/1868] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:03:20 2022] PUT /identity/v3/projects/8700aae079914c34a43725b5e670ebfe/users/cd6c278e04a143afb345166552b0bc2e/roles/719e5c62188d4f8a838987d6e72ca8f7 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:03:20.152996 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4173831-8e45-47de-8851-e5617d0c0007 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:20.153494 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4173831-8e45-47de-8851-e5617d0c0007 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:20.153635 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4173831-8e45-47de-8851-e5617d0c0007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:20.158357 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 921/1869] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:03:20 2022] PUT /identity/v3/projects/aa79e1f0a44b42caa0638ab1557acf57/users/57b81a2b4ceb45a786ed72202c5050eb/roles/127fdc7ef05b4e0b98a940b334e5fcab => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:03:20.164211 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fad055-7eee-4adf-afdf-96fb10f71608 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:20.194096 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-c4173831-8e45-47de-8851-e5617d0c0007 None None] MFA Rules not processed for user `cd6c278e04a143afb345166552b0bc2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:03:20.195486 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-c4173831-8e45-47de-8851-e5617d0c0007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:20.204662 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:03:20.265731 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fad055-7eee-4adf-afdf-96fb10f71608 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:20.272649 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a4ead2-554c-4dcd-bc98-e266479f3e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:20.273472 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a4ead2-554c-4dcd-bc98-e266479f3e00 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:20.273795 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a4ead2-554c-4dcd-bc98-e266479f3e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:20.274096 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a4ead2-554c-4dcd-bc98-e266479f3e00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:20.274796 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a4ead2-554c-4dcd-bc98-e266479f3e00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:20.279962 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a4ead2-554c-4dcd-bc98-e266479f3e00 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:20.286887 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 949/1870] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:03:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:03:20.298477 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4173831-8e45-47de-8851-e5617d0c0007 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:20.299323 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 922/1871] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:03:20 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:03:20.300226 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a4ead2-554c-4dcd-bc98-e266479f3e00 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:20.314603 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4173831-8e45-47de-8851-e5617d0c0007 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:20.316812 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a4ead2-554c-4dcd-bc98-e266479f3e00 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:20.320664 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d969318b-a8e6-4e97-bdad-23c9c82de400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:20.321287 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d969318b-a8e6-4e97-bdad-23c9c82de400 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:20.321607 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d969318b-a8e6-4e97-bdad-23c9c82de400 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:20.321893 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d969318b-a8e6-4e97-bdad-23c9c82de400 admin admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:20.322535 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d969318b-a8e6-4e97-bdad-23c9c82de400 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:20.323934 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e34d0-8ce4-406b-8956-fe688cf3b064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:20.324583 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d969318b-a8e6-4e97-bdad-23c9c82de400 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:20.325067 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e34d0-8ce4-406b-8956-fe688cf3b064 admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:20.325820 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e34d0-8ce4-406b-8956-fe688cf3b064 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:20.326447 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e34d0-8ce4-406b-8956-fe688cf3b064 admin admin] PATH_INFO: `/v3/projects/aa79e1f0a44b42caa0638ab1557acf57/users/57b81a2b4ceb45a786ed72202c5050eb/roles/127fdc7ef05b4e0b98a940b334e5fcab` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:20.328581 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5e34d0-8ce4-406b-8956-fe688cf3b064 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa79e1f0a44b42caa0638ab1557acf57, user_id=57b81a2b4ceb45a786ed72202c5050eb, role_id=127fdc7ef05b4e0b98a940b334e5fcab)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:20.332041 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5e34d0-8ce4-406b-8956-fe688cf3b064 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:20.341054 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:03:20.348004 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 923/1872] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:03:20 2022] PUT /identity/v3/projects/aa79e1f0a44b42caa0638ab1557acf57/users/57b81a2b4ceb45a786ed72202c5050eb/roles/127fdc7ef05b4e0b98a940b334e5fcab => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:03:20.349192 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e34d0-8ce4-406b-8956-fe688cf3b064 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:20.351151 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-9a5e34d0-8ce4-406b-8956-fe688cf3b064 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:20.378658 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 950/1873] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:03:20 2022] POST /identity/v3/projects => generated 375 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:03:20.383254 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f325ea11-69aa-43be-a8b7-7a31658ebc7f None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:20.383611 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f325ea11-69aa-43be-a8b7-7a31658ebc7f None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:20.384000 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f325ea11-69aa-43be-a8b7-7a31658ebc7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:20.419381 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-f325ea11-69aa-43be-a8b7-7a31658ebc7f None None] MFA Rules not processed for user `57b81a2b4ceb45a786ed72202c5050eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:03:20.421351 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-f325ea11-69aa-43be-a8b7-7a31658ebc7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:20.460954 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e34d0-8ce4-406b-8956-fe688cf3b064 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:20.531405 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 951/1874] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:03:20 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:03:20.534383 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f325ea11-69aa-43be-a8b7-7a31658ebc7f None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:20.597633 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fd9804-2d98-4048-9ca9-ed0947fd109c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:20.598449 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fd9804-2d98-4048-9ca9-ed0947fd109c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:20.600294 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fd9804-2d98-4048-9ca9-ed0947fd109c admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:20.600658 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fd9804-2d98-4048-9ca9-ed0947fd109c admin admin] PATH_INFO: `/v3/users/82c60c2e72ab48889f5b75f997816105` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:20.602826 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fd9804-2d98-4048-9ca9-ed0947fd109c admin admin] RBAC: Authorizing `identity:delete_user(user_id=82c60c2e72ab48889f5b75f997816105)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:20.604917 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fd9804-2d98-4048-9ca9-ed0947fd109c admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:20.700464 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-52fd9804-2d98-4048-9ca9-ed0947fd109c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82c60c2e72ab48889f5b75f997816105'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:20.720442 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-52fd9804-2d98-4048-9ca9-ed0947fd109c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82c60c2e72ab48889f5b75f997816105'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:20.721147 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-52fd9804-2d98-4048-9ca9-ed0947fd109c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82c60c2e72ab48889f5b75f997816105'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:20.721931 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-52fd9804-2d98-4048-9ca9-ed0947fd109c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82c60c2e72ab48889f5b75f997816105'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:20.730674 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f325ea11-69aa-43be-a8b7-7a31658ebc7f None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:20.734596 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:03:20.738315 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-52fd9804-2d98-4048-9ca9-ed0947fd109c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82c60c2e72ab48889f5b75f997816105'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:20.744148 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e223047-6d7e-4538-b001-8ce12ef7a0a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:20.744850 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e223047-6d7e-4538-b001-8ce12ef7a0a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:20.745134 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e223047-6d7e-4538-b001-8ce12ef7a0a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:20.745418 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e223047-6d7e-4538-b001-8ce12ef7a0a7 admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:20.746095 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e223047-6d7e-4538-b001-8ce12ef7a0a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:20.748129 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e223047-6d7e-4538-b001-8ce12ef7a0a7 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:20.790983 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 924/1875] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:03:20 2022] DELETE /identity/v3/users/82c60c2e72ab48889f5b75f997816105 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:03:20.792690 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fd9804-2d98-4048-9ca9-ed0947fd109c admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:20.795999 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-52fd9804-2d98-4048-9ca9-ed0947fd109c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:20.809141 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 952/1876] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:03:20 2022] POST /identity/v3/users => generated 294 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:03:20.810613 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3722e2fe-82c0-4c47-ba4d-1d8a18a7c3d1 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:20.810902 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3722e2fe-82c0-4c47-ba4d-1d8a18a7c3d1 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:20.812253 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3722e2fe-82c0-4c47-ba4d-1d8a18a7c3d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:20.842127 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-3722e2fe-82c0-4c47-ba4d-1d8a18a7c3d1 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:03:20.851598 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-3722e2fe-82c0-4c47-ba4d-1d8a18a7c3d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:20.931815 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fd9804-2d98-4048-9ca9-ed0947fd109c admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:20.938369 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc03aef-01b1-4551-a742-64395fcc5a8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b8a09704b9b4ab2bffb813796ec6e77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:20.938856 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc03aef-01b1-4551-a742-64395fcc5a8f service cinder] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:20.939134 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc03aef-01b1-4551-a742-64395fcc5a8f service cinder] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:20.939410 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc03aef-01b1-4551-a742-64395fcc5a8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:20.941372 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-4dc03aef-01b1-4551-a742-64395fcc5a8f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:21.013110 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 953/1877] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:03:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:03:21.019086 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3722e2fe-82c0-4c47-ba4d-1d8a18a7c3d1 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:21.030502 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-3722e2fe-82c0-4c47-ba4d-1d8a18a7c3d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:21.077318 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:03:21.086340 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3722e2fe-82c0-4c47-ba4d-1d8a18a7c3d1 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:21.094683 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927ddc4e-005b-4a8c-a63b-f4988180e24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:21.096934 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ddc4e-005b-4a8c-a63b-f4988180e24c admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:21.097391 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ddc4e-005b-4a8c-a63b-f4988180e24c admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:21.097833 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ddc4e-005b-4a8c-a63b-f4988180e24c admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:21.098917 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927ddc4e-005b-4a8c-a63b-f4988180e24c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:21.102755 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927ddc4e-005b-4a8c-a63b-f4988180e24c admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:21.134786 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 954/1878] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:03:21 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:03:21.138214 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927ddc4e-005b-4a8c-a63b-f4988180e24c admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:21.140545 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-927ddc4e-005b-4a8c-a63b-f4988180e24c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:21.167562 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc03aef-01b1-4551-a742-64395fcc5a8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:21.170831 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc03aef-01b1-4551-a742-64395fcc5a8f service cinder] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:21.190155 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 925/1879] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:03:20 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:03:21.191726 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc03aef-01b1-4551-a742-64395fcc5a8f service cinder] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:21.205448 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc03aef-01b1-4551-a742-64395fcc5a8f service cinder] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:21.211384 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63ea039-f35f-4c8f-9a95-237bd9e88828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:21.212505 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ea039-f35f-4c8f-9a95-237bd9e88828 admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:21.212505 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ea039-f35f-4c8f-9a95-237bd9e88828 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:21.212805 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ea039-f35f-4c8f-9a95-237bd9e88828 admin admin] PATH_INFO: `/v3/projects/8448fdfc07cb4eb0aa3bbcf5d3311061/users/529389c59d394e7ba6c93a38e44546e3/roles/127fdc7ef05b4e0b98a940b334e5fcab` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:21.246976 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63ea039-f35f-4c8f-9a95-237bd9e88828 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8448fdfc07cb4eb0aa3bbcf5d3311061, user_id=529389c59d394e7ba6c93a38e44546e3, role_id=127fdc7ef05b4e0b98a940b334e5fcab)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:21.252786 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63ea039-f35f-4c8f-9a95-237bd9e88828 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:21.276293 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927ddc4e-005b-4a8c-a63b-f4988180e24c admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:21.286650 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee03142-921f-4dd7-864e-c6c89ea372ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:21.287701 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee03142-921f-4dd7-864e-c6c89ea372ba service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:21.290692 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee03142-921f-4dd7-864e-c6c89ea372ba service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:21.291570 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee03142-921f-4dd7-864e-c6c89ea372ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:21.305868 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 926/1880] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:03:21 2022] PUT /identity/v3/projects/8448fdfc07cb4eb0aa3bbcf5d3311061/users/529389c59d394e7ba6c93a38e44546e3/roles/127fdc7ef05b4e0b98a940b334e5fcab => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:03:21.307940 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63ea039-f35f-4c8f-9a95-237bd9e88828 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:21.323158 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee03142-921f-4dd7-864e-c6c89ea372ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:21.343841 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee03142-921f-4dd7-864e-c6c89ea372ba service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:21.371659 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 955/1881] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:03:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:03:21.372535 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee03142-921f-4dd7-864e-c6c89ea372ba service neutron] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:21.391603 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee03142-921f-4dd7-864e-c6c89ea372ba service neutron] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:21.415084 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63ea039-f35f-4c8f-9a95-237bd9e88828 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:21.431358 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd44f624-6df7-40f0-9e64-1907b8f75be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:21.433326 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd44f624-6df7-40f0-9e64-1907b8f75be9 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:21.435101 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd44f624-6df7-40f0-9e64-1907b8f75be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:21.435479 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd44f624-6df7-40f0-9e64-1907b8f75be9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:21.436974 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd44f624-6df7-40f0-9e64-1907b8f75be9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:21.444368 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd44f624-6df7-40f0-9e64-1907b8f75be9 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:21.448404 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:03:21.481960 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 927/1882] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:03:21 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:03:21.484893 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd44f624-6df7-40f0-9e64-1907b8f75be9 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:21.502127 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd44f624-6df7-40f0-9e64-1907b8f75be9 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:21.529188 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868732ff-121c-42d5-afdf-8ab9b61a5f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:21.529911 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868732ff-121c-42d5-afdf-8ab9b61a5f1d admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:21.535646 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868732ff-121c-42d5-afdf-8ab9b61a5f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:21.536848 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868732ff-121c-42d5-afdf-8ab9b61a5f1d admin admin] PATH_INFO: `/v3/projects/8448fdfc07cb4eb0aa3bbcf5d3311061/users/529389c59d394e7ba6c93a38e44546e3/roles/127fdc7ef05b4e0b98a940b334e5fcab` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:21.547834 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868732ff-121c-42d5-afdf-8ab9b61a5f1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8448fdfc07cb4eb0aa3bbcf5d3311061, user_id=529389c59d394e7ba6c93a38e44546e3, role_id=127fdc7ef05b4e0b98a940b334e5fcab)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:21.550194 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e932d48-49bd-4d42-8dd6-38e61359a7dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b8a09704b9b4ab2bffb813796ec6e77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:21.550804 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868732ff-121c-42d5-afdf-8ab9b61a5f1d admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:21.550925 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e932d48-49bd-4d42-8dd6-38e61359a7dc service cinder] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:21.551087 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e932d48-49bd-4d42-8dd6-38e61359a7dc service cinder] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:21.551368 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e932d48-49bd-4d42-8dd6-38e61359a7dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:21.553979 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-5e932d48-49bd-4d42-8dd6-38e61359a7dc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:21.585476 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 928/1883] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:03:21 2022] PUT /identity/v3/projects/8448fdfc07cb4eb0aa3bbcf5d3311061/users/529389c59d394e7ba6c93a38e44546e3/roles/127fdc7ef05b4e0b98a940b334e5fcab => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:03:21.588476 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cac597-3f1e-4bca-a319-58a73374d46c None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:21.588476 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cac597-3f1e-4bca-a319-58a73374d46c None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:21.588476 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cac597-3f1e-4bca-a319-58a73374d46c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:21.657103 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e932d48-49bd-4d42-8dd6-38e61359a7dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:21.658833 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e932d48-49bd-4d42-8dd6-38e61359a7dc service cinder] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:21.670504 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 956/1884] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:03:21 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:03:21.692812 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-a3cac597-3f1e-4bca-a319-58a73374d46c None None] MFA Rules not processed for user `529389c59d394e7ba6c93a38e44546e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:03:21.698819 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-a3cac597-3f1e-4bca-a319-58a73374d46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:21.930539 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 929/1885] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:03:21 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:03:21.981642 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e932d48-49bd-4d42-8dd6-38e61359a7dc service cinder] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:21.986884 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-5e932d48-49bd-4d42-8dd6-38e61359a7dc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:21.999290 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e932d48-49bd-4d42-8dd6-38e61359a7dc service cinder] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:22.146169 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2515a8d-6474-4fd8-9e07-744ac3d6417c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b8a09704b9b4ab2bffb813796ec6e77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:22.146811 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2515a8d-6474-4fd8-9e07-744ac3d6417c service cinder] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:22.147088 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2515a8d-6474-4fd8-9e07-744ac3d6417c service cinder] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:22.147360 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2515a8d-6474-4fd8-9e07-744ac3d6417c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:22.149174 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-c2515a8d-6474-4fd8-9e07-744ac3d6417c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:22.164039 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:03:22.303309 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2515a8d-6474-4fd8-9e07-744ac3d6417c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:22.306946 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2515a8d-6474-4fd8-9e07-744ac3d6417c service cinder] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:22.343357 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 957/1886] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:03:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:03:22.810748 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cac597-3f1e-4bca-a319-58a73374d46c None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:22.812931 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-a3cac597-3f1e-4bca-a319-58a73374d46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:23.116231 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cac597-3f1e-4bca-a319-58a73374d46c None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:23.128440 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d4b59-2a68-4789-932e-49559a7e2f21 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:23.128937 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d4b59-2a68-4789-932e-49559a7e2f21 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:23.129052 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d4b59-2a68-4789-932e-49559a7e2f21 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:23.131419 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 958/1887] 10.222.0.15 () {54 vars in 921 bytes} [Thu Aug 18 11:03:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:03:23.132130 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f6d0d-fc35-4439-8d78-4ce65c68e119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:23.134249 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f6d0d-fc35-4439-8d78-4ce65c68e119 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:23.135290 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f6d0d-fc35-4439-8d78-4ce65c68e119 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:23.136673 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f6d0d-fc35-4439-8d78-4ce65c68e119 admin admin] PATH_INFO: `/v3/projects/fd89794b02274d42bc0bef8f9fe01228` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:23.140342 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279f6d0d-fc35-4439-8d78-4ce65c68e119 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd89794b02274d42bc0bef8f9fe01228)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:23.143346 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279f6d0d-fc35-4439-8d78-4ce65c68e119 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:23.149011 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e99bc-431f-4231-9ce9-8aea8780376e None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:23.149296 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e99bc-431f-4231-9ce9-8aea8780376e None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:23.149665 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e99bc-431f-4231-9ce9-8aea8780376e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:23.190725 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-583e99bc-431f-4231-9ce9-8aea8780376e None None] MFA Rules not processed for user `a005d8f0c46d44c7b6f2201a54717b12`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:03:23.195665 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-583e99bc-431f-4231-9ce9-8aea8780376e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:23.306870 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-279f6d0d-fc35-4439-8d78-4ce65c68e119 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd89794b02274d42bc0bef8f9fe01228', 'request_id': 'req-279f6d0d-fc35-4439-8d78-4ce65c68e119'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:23.318651 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-279f6d0d-fc35-4439-8d78-4ce65c68e119 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd89794b02274d42bc0bef8f9fe01228', 'request_id': 'req-279f6d0d-fc35-4439-8d78-4ce65c68e119'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:23.328933 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-279f6d0d-fc35-4439-8d78-4ce65c68e119 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd89794b02274d42bc0bef8f9fe01228', 'request_id': 'req-279f6d0d-fc35-4439-8d78-4ce65c68e119'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:23.344666 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:03:23.352264 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-279f6d0d-fc35-4439-8d78-4ce65c68e119 admin admin] The token cache is being invalidate because project fd89794b02274d42bc0bef8f9fe01228 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:03:23.354111 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-279f6d0d-fc35-4439-8d78-4ce65c68e119 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:23.355258 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-279f6d0d-fc35-4439-8d78-4ce65c68e119 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:23.362368 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 930/1888] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:03:22 2022] DELETE /identity/v3/projects/fd89794b02274d42bc0bef8f9fe01228 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:03:23.364134 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f6d0d-fc35-4439-8d78-4ce65c68e119 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:23.368801 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-279f6d0d-fc35-4439-8d78-4ce65c68e119 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:23.448017 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 959/1889] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Aug 18 11:03:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:03:23.499921 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f6d0d-fc35-4439-8d78-4ce65c68e119 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:23.507658 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34df41b3-2bed-41b5-85ac-e3c9d83e324a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:23.508519 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df41b3-2bed-41b5-85ac-e3c9d83e324a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:23.508932 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df41b3-2bed-41b5-85ac-e3c9d83e324a admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:23.509395 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df41b3-2bed-41b5-85ac-e3c9d83e324a admin admin] PATH_INFO: `/v3/users/fb9f69e4a04f48c1bd2d2270a9d1241a` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:23.511551 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34df41b3-2bed-41b5-85ac-e3c9d83e324a admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb9f69e4a04f48c1bd2d2270a9d1241a)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:23.514122 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34df41b3-2bed-41b5-85ac-e3c9d83e324a admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:23.643657 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-34df41b3-2bed-41b5-85ac-e3c9d83e324a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb9f69e4a04f48c1bd2d2270a9d1241a'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:23.674205 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-34df41b3-2bed-41b5-85ac-e3c9d83e324a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb9f69e4a04f48c1bd2d2270a9d1241a'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:23.675362 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-34df41b3-2bed-41b5-85ac-e3c9d83e324a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb9f69e4a04f48c1bd2d2270a9d1241a'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:23.678695 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-34df41b3-2bed-41b5-85ac-e3c9d83e324a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb9f69e4a04f48c1bd2d2270a9d1241a'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:23.694170 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-34df41b3-2bed-41b5-85ac-e3c9d83e324a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb9f69e4a04f48c1bd2d2270a9d1241a'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:23.742105 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583e99bc-431f-4231-9ce9-8aea8780376e None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:23.747431 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-583e99bc-431f-4231-9ce9-8aea8780376e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:23.764025 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 931/1890] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:03:23 2022] DELETE /identity/v3/users/fb9f69e4a04f48c1bd2d2270a9d1241a => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:03:23.775743 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583e99bc-431f-4231-9ce9-8aea8780376e None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:23.948960 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc18161d-63b3-4d34-b8e0-565d4c1ce03b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a005d8f0c46d44c7b6f2201a54717b12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:23.951489 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc18161d-63b3-4d34-b8e0-565d4c1ce03b service nova] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:23.952737 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc18161d-63b3-4d34-b8e0-565d4c1ce03b service nova] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:23.953122 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc18161d-63b3-4d34-b8e0-565d4c1ce03b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:23.959656 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-bc18161d-63b3-4d34-b8e0-565d4c1ce03b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:23.984490 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc18161d-63b3-4d34-b8e0-565d4c1ce03b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:23.986746 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc18161d-63b3-4d34-b8e0-565d4c1ce03b service nova] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:24.008508 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 960/1891] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:03:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 11:03:24.757189 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34df41b3-2bed-41b5-85ac-e3c9d83e324a admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:24.760455 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-34df41b3-2bed-41b5-85ac-e3c9d83e324a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:24.908447 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34df41b3-2bed-41b5-85ac-e3c9d83e324a admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:24.917400 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963748fc-826c-4692-8682-346cd5a662d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:24.918203 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963748fc-826c-4692-8682-346cd5a662d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:24.918559 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963748fc-826c-4692-8682-346cd5a662d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:24.918924 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963748fc-826c-4692-8682-346cd5a662d0 admin admin] PATH_INFO: `/v3/projects/a631141318444d2ab19c80b86e319562` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:24.920578 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963748fc-826c-4692-8682-346cd5a662d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a631141318444d2ab19c80b86e319562)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:24.922439 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963748fc-826c-4692-8682-346cd5a662d0 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:24.967192 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:03:25.072146 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-963748fc-826c-4692-8682-346cd5a662d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a631141318444d2ab19c80b86e319562', 'request_id': 'req-963748fc-826c-4692-8682-346cd5a662d0'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:25.085258 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-963748fc-826c-4692-8682-346cd5a662d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a631141318444d2ab19c80b86e319562', 'request_id': 'req-963748fc-826c-4692-8682-346cd5a662d0'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:25.096453 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-963748fc-826c-4692-8682-346cd5a662d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a631141318444d2ab19c80b86e319562', 'request_id': 'req-963748fc-826c-4692-8682-346cd5a662d0'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:25.141555 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-963748fc-826c-4692-8682-346cd5a662d0 admin admin] The token cache is being invalidate because project a631141318444d2ab19c80b86e319562 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:03:25.141953 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-963748fc-826c-4692-8682-346cd5a662d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:25.142938 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-963748fc-826c-4692-8682-346cd5a662d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:25.150816 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 932/1892] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:03:24 2022] DELETE /identity/v3/projects/a631141318444d2ab19c80b86e319562 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:03:25.151473 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817c2a75-00c5-4e26-93d9-ec9622f8993a None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:25.151981 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817c2a75-00c5-4e26-93d9-ec9622f8993a None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:25.152279 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817c2a75-00c5-4e26-93d9-ec9622f8993a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:25.177602 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-817c2a75-00c5-4e26-93d9-ec9622f8993a None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:03:25.179318 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-817c2a75-00c5-4e26-93d9-ec9622f8993a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:25.213288 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:03:25.236730 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963748fc-826c-4692-8682-346cd5a662d0 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:25.238947 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-963748fc-826c-4692-8682-346cd5a662d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:25.281748 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 961/1893] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:03:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:03:25.290974 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c56b9-d233-481c-bee1-ddf375dbd459 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:25.291351 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c56b9-d233-481c-bee1-ddf375dbd459 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:25.291629 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c56b9-d233-481c-bee1-ddf375dbd459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:25.311171 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-c67c56b9-d233-481c-bee1-ddf375dbd459 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:03:25.312369 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-c67c56b9-d233-481c-bee1-ddf375dbd459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:25.315465 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963748fc-826c-4692-8682-346cd5a662d0 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:25.320565 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0624a8fb-3d5a-428a-9929-768ec037e48f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:25.320774 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 962/1894] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:03:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:03:25.321339 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0624a8fb-3d5a-428a-9929-768ec037e48f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:25.321665 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0624a8fb-3d5a-428a-9929-768ec037e48f admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:25.321940 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0624a8fb-3d5a-428a-9929-768ec037e48f admin admin] PATH_INFO: `/v3/users/cfdfd58ef08642b29160889bc1f53b04` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:25.323114 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0624a8fb-3d5a-428a-9929-768ec037e48f admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfdfd58ef08642b29160889bc1f53b04)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:25.325110 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0624a8fb-3d5a-428a-9929-768ec037e48f admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:25.325322 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67c56b9-d233-481c-bee1-ddf375dbd459 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:25.335315 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67c56b9-d233-481c-bee1-ddf375dbd459 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:25.340235 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140a199c-3988-4dfd-9323-0547db072663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:25.340875 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140a199c-3988-4dfd-9323-0547db072663 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:25.341154 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140a199c-3988-4dfd-9323-0547db072663 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:25.341449 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140a199c-3988-4dfd-9323-0547db072663 admin admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:25.342153 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140a199c-3988-4dfd-9323-0547db072663 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:03:25.342455 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140a199c-3988-4dfd-9323-0547db072663 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:25.344038 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140a199c-3988-4dfd-9323-0547db072663 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:25.360442 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 963/1895] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Aug 18 11:03:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:03:25.361563 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140a199c-3988-4dfd-9323-0547db072663 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:25.372038 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140a199c-3988-4dfd-9323-0547db072663 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:25.376350 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-0624a8fb-3d5a-428a-9929-768ec037e48f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfdfd58ef08642b29160889bc1f53b04'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:25.377303 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc21c878-f185-4456-a40e-4ae9c78ce657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:25.378140 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc21c878-f185-4456-a40e-4ae9c78ce657 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:25.378618 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc21c878-f185-4456-a40e-4ae9c78ce657 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:25.378910 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc21c878-f185-4456-a40e-4ae9c78ce657 admin admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:25.380168 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc21c878-f185-4456-a40e-4ae9c78ce657 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:25.383054 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc21c878-f185-4456-a40e-4ae9c78ce657 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:25.384147 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-0624a8fb-3d5a-428a-9929-768ec037e48f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfdfd58ef08642b29160889bc1f53b04'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:25.384816 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-0624a8fb-3d5a-428a-9929-768ec037e48f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfdfd58ef08642b29160889bc1f53b04'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:25.385435 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-0624a8fb-3d5a-428a-9929-768ec037e48f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfdfd58ef08642b29160889bc1f53b04'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:25.392761 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-0624a8fb-3d5a-428a-9929-768ec037e48f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfdfd58ef08642b29160889bc1f53b04'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:25.412547 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 933/1896] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:03:25 2022] DELETE /identity/v3/users/cfdfd58ef08642b29160889bc1f53b04 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:03:25.413127 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 964/1897] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:03:25 2022] POST /identity/v3/projects => generated 381 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:03:25.417080 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc21c878-f185-4456-a40e-4ae9c78ce657 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:25.417492 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7773ce-ae92-4035-ad48-ef8574d13ae8 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:25.417808 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7773ce-ae92-4035-ad48-ef8574d13ae8 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:25.418084 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7773ce-ae92-4035-ad48-ef8574d13ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:25.418758 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-bc21c878-f185-4456-a40e-4ae9c78ce657 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:25.437803 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-ed7773ce-ae92-4035-ad48-ef8574d13ae8 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:03:25.439006 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-ed7773ce-ae92-4035-ad48-ef8574d13ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:25.458692 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:03:25.492419 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc21c878-f185-4456-a40e-4ae9c78ce657 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:25.502676 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 934/1898] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:03:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:03:25.513004 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7773ce-ae92-4035-ad48-ef8574d13ae8 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:25.514416 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-ed7773ce-ae92-4035-ad48-ef8574d13ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:25.554788 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d9d35d-e5ef-4e1d-891a-19aee7aa08f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:25.554788 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d9d35d-e5ef-4e1d-891a-19aee7aa08f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:25.554788 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d9d35d-e5ef-4e1d-891a-19aee7aa08f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:25.554788 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d9d35d-e5ef-4e1d-891a-19aee7aa08f7 admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:25.555151 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d9d35d-e5ef-4e1d-891a-19aee7aa08f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:25.555151 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d9d35d-e5ef-4e1d-891a-19aee7aa08f7 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:25.579049 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 965/1899] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:03:25 2022] POST /identity/v3/users => generated 291 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:03:25.583054 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d9d35d-e5ef-4e1d-891a-19aee7aa08f7 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:25.588092 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7773ce-ae92-4035-ad48-ef8574d13ae8 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:25.591950 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdd9bc5-8c78-41fa-903d-958ec56710bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:25.592745 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdd9bc5-8c78-41fa-903d-958ec56710bb service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:25.593167 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdd9bc5-8c78-41fa-903d-958ec56710bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:25.593604 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdd9bc5-8c78-41fa-903d-958ec56710bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:25.594188 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d9d35d-e5ef-4e1d-891a-19aee7aa08f7 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:25.600233 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8474461-0456-49b4-9428-1e1ed8e335df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:25.600873 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8474461-0456-49b4-9428-1e1ed8e335df admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:25.601128 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8474461-0456-49b4-9428-1e1ed8e335df admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:25.601406 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8474461-0456-49b4-9428-1e1ed8e335df admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:25.602200 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8474461-0456-49b4-9428-1e1ed8e335df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:25.603828 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8474461-0456-49b4-9428-1e1ed8e335df admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:25.605595 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdd9bc5-8c78-41fa-903d-958ec56710bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:25.607290 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdd9bc5-8c78-41fa-903d-958ec56710bb service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:25.618418 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 966/1900] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:03:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:03:25.618903 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 935/1901] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:03:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 11:03:25.619607 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8474461-0456-49b4-9428-1e1ed8e335df admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:25.630905 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8474461-0456-49b4-9428-1e1ed8e335df admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:25.636440 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205cd6d8-3811-409c-b614-b9ff7fb1bee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:25.637066 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205cd6d8-3811-409c-b614-b9ff7fb1bee8 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:25.637341 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205cd6d8-3811-409c-b614-b9ff7fb1bee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:25.637649 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205cd6d8-3811-409c-b614-b9ff7fb1bee8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:25.638316 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205cd6d8-3811-409c-b614-b9ff7fb1bee8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:25.639906 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205cd6d8-3811-409c-b614-b9ff7fb1bee8 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:25.641651 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:03:25.653560 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 967/1902] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:03:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:03:25.657843 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdd9bc5-8c78-41fa-903d-958ec56710bb service neutron] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:25.670371 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdd9bc5-8c78-41fa-903d-958ec56710bb service neutron] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:25.675338 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711e828c-82d4-4050-8680-e706d21217b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:25.676015 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e828c-82d4-4050-8680-e706d21217b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:25.677438 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e828c-82d4-4050-8680-e706d21217b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:25.677825 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e828c-82d4-4050-8680-e706d21217b0 admin admin] PATH_INFO: `/v3/projects/5d9ec8ae6275487b82d966289f49498a/users/6f9e115179734117b4ae649b83be9166/roles/719e5c62188d4f8a838987d6e72ca8f7` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:25.713548 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711e828c-82d4-4050-8680-e706d21217b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d9ec8ae6275487b82d966289f49498a, user_id=6f9e115179734117b4ae649b83be9166, role_id=719e5c62188d4f8a838987d6e72ca8f7)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:25.721478 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711e828c-82d4-4050-8680-e706d21217b0 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:25.748114 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 936/1903] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:03:25 2022] PUT /identity/v3/projects/5d9ec8ae6275487b82d966289f49498a/users/6f9e115179734117b4ae649b83be9166/roles/719e5c62188d4f8a838987d6e72ca8f7 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:03:25.760354 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8fb81d-3528-4cb2-b74d-c632ec3d2833 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:25.760643 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8fb81d-3528-4cb2-b74d-c632ec3d2833 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:25.760940 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8fb81d-3528-4cb2-b74d-c632ec3d2833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:25.808648 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-af8fb81d-3528-4cb2-b74d-c632ec3d2833 None None] MFA Rules not processed for user `6f9e115179734117b4ae649b83be9166`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:03:25.810102 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-af8fb81d-3528-4cb2-b74d-c632ec3d2833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:25.879622 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 968/1904] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:03:25 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:03:25.884273 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711e828c-82d4-4050-8680-e706d21217b0 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:25.965321 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711e828c-82d4-4050-8680-e706d21217b0 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:25.970059 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcd2fc0-20f4-46ca-af98-73182ee8129a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:25.970818 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd2fc0-20f4-46ca-af98-73182ee8129a admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:25.971177 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd2fc0-20f4-46ca-af98-73182ee8129a admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:25.971476 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd2fc0-20f4-46ca-af98-73182ee8129a admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:25.972111 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcd2fc0-20f4-46ca-af98-73182ee8129a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:25.974681 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcd2fc0-20f4-46ca-af98-73182ee8129a admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:26.001939 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 937/1905] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:03:25 2022] POST /identity/v3/projects => generated 379 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:03:26.006166 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8fb81d-3528-4cb2-b74d-c632ec3d2833 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:26.018049 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8fb81d-3528-4cb2-b74d-c632ec3d2833 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:26.019097 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcd2fc0-20f4-46ca-af98-73182ee8129a admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:26.021343 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-5bcd2fc0-20f4-46ca-af98-73182ee8129a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:26.088539 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:03:26.118816 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889e80ac-9ec9-4a2b-83f7-58b4ea03315f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:26.119547 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e80ac-9ec9-4a2b-83f7-58b4ea03315f admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:26.120134 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e80ac-9ec9-4a2b-83f7-58b4ea03315f admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:26.120487 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e80ac-9ec9-4a2b-83f7-58b4ea03315f admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:26.121353 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889e80ac-9ec9-4a2b-83f7-58b4ea03315f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:26.124204 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889e80ac-9ec9-4a2b-83f7-58b4ea03315f admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:26.134422 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcd2fc0-20f4-46ca-af98-73182ee8129a admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:26.138746 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0b6455-096f-403e-b9e9-36acf5f8b4a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:26.139390 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b6455-096f-403e-b9e9-36acf5f8b4a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:26.139719 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b6455-096f-403e-b9e9-36acf5f8b4a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:26.139991 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b6455-096f-403e-b9e9-36acf5f8b4a9 admin admin] PATH_INFO: `/v3/projects/498e457716db4bdd995893b30836af5d` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:26.141223 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0b6455-096f-403e-b9e9-36acf5f8b4a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=498e457716db4bdd995893b30836af5d)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:26.143380 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0b6455-096f-403e-b9e9-36acf5f8b4a9 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:26.159312 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 969/1906] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:03:26 2022] POST /identity/v3/users => generated 296 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:03:26.173991 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889e80ac-9ec9-4a2b-83f7-58b4ea03315f admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:26.190024 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889e80ac-9ec9-4a2b-83f7-58b4ea03315f admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:26.210328 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-8d0b6455-096f-403e-b9e9-36acf5f8b4a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '498e457716db4bdd995893b30836af5d', 'request_id': 'req-8d0b6455-096f-403e-b9e9-36acf5f8b4a9'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:26.224872 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-8d0b6455-096f-403e-b9e9-36acf5f8b4a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '498e457716db4bdd995893b30836af5d', 'request_id': 'req-8d0b6455-096f-403e-b9e9-36acf5f8b4a9'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:26.233097 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-8d0b6455-096f-403e-b9e9-36acf5f8b4a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '498e457716db4bdd995893b30836af5d', 'request_id': 'req-8d0b6455-096f-403e-b9e9-36acf5f8b4a9'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:26.260637 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-8d0b6455-096f-403e-b9e9-36acf5f8b4a9 admin admin] The token cache is being invalidate because project 498e457716db4bdd995893b30836af5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:03:26.261093 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-8d0b6455-096f-403e-b9e9-36acf5f8b4a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:26.262038 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-8d0b6455-096f-403e-b9e9-36acf5f8b4a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:26.263875 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 938/1907] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:03:26 2022] DELETE /identity/v3/projects/498e457716db4bdd995893b30836af5d => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:03:26.267507 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0b6455-096f-403e-b9e9-36acf5f8b4a9 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:26.268888 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-8d0b6455-096f-403e-b9e9-36acf5f8b4a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:26.284740 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800296b0-9051-4203-a95c-ab30adf8192d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:26.285507 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800296b0-9051-4203-a95c-ab30adf8192d admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:26.286523 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800296b0-9051-4203-a95c-ab30adf8192d admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:26.287349 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800296b0-9051-4203-a95c-ab30adf8192d admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:26.287879 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800296b0-9051-4203-a95c-ab30adf8192d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:26.289743 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800296b0-9051-4203-a95c-ab30adf8192d admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:26.305009 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 970/1908] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:03:26 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:03:26.306630 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800296b0-9051-4203-a95c-ab30adf8192d admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:26.308809 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-800296b0-9051-4203-a95c-ab30adf8192d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:26.323335 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800296b0-9051-4203-a95c-ab30adf8192d admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:26.328728 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad26961-1b87-4458-a97d-9d19dacc30ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:26.329534 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad26961-1b87-4458-a97d-9d19dacc30ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:26.329887 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad26961-1b87-4458-a97d-9d19dacc30ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:26.330283 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad26961-1b87-4458-a97d-9d19dacc30ab admin admin] PATH_INFO: `/v3/projects/381eaa16993a403c86e8104a85aaa3c4/users/1c3d7818b239484194c9cec4b5c3f9d7/roles/127fdc7ef05b4e0b98a940b334e5fcab` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:26.340634 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:03:26.348075 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad26961-1b87-4458-a97d-9d19dacc30ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=381eaa16993a403c86e8104a85aaa3c4, user_id=1c3d7818b239484194c9cec4b5c3f9d7, role_id=127fdc7ef05b4e0b98a940b334e5fcab)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:26.349507 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0b6455-096f-403e-b9e9-36acf5f8b4a9 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:26.351441 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad26961-1b87-4458-a97d-9d19dacc30ab admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:26.354608 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f15d39-1d9b-4832-aa1a-8e118d044d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:26.355279 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f15d39-1d9b-4832-aa1a-8e118d044d55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:26.355559 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f15d39-1d9b-4832-aa1a-8e118d044d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:26.355841 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f15d39-1d9b-4832-aa1a-8e118d044d55 admin admin] PATH_INFO: `/v3/users/57b81a2b4ceb45a786ed72202c5050eb` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:26.357212 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f15d39-1d9b-4832-aa1a-8e118d044d55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57b81a2b4ceb45a786ed72202c5050eb)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:26.359848 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f15d39-1d9b-4832-aa1a-8e118d044d55 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:26.366063 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 971/1909] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:03:26 2022] PUT /identity/v3/projects/381eaa16993a403c86e8104a85aaa3c4/users/1c3d7818b239484194c9cec4b5c3f9d7/roles/127fdc7ef05b4e0b98a940b334e5fcab => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:03:26.369998 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad26961-1b87-4458-a97d-9d19dacc30ab admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:26.409497 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-b3f15d39-1d9b-4832-aa1a-8e118d044d55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57b81a2b4ceb45a786ed72202c5050eb'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:26.419405 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-b3f15d39-1d9b-4832-aa1a-8e118d044d55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57b81a2b4ceb45a786ed72202c5050eb'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:26.420067 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-b3f15d39-1d9b-4832-aa1a-8e118d044d55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57b81a2b4ceb45a786ed72202c5050eb'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:26.420713 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-b3f15d39-1d9b-4832-aa1a-8e118d044d55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57b81a2b4ceb45a786ed72202c5050eb'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:26.428203 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-b3f15d39-1d9b-4832-aa1a-8e118d044d55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57b81a2b4ceb45a786ed72202c5050eb'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:26.429276 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:03:26.436951 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad26961-1b87-4458-a97d-9d19dacc30ab admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:26.442761 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d8743b-39cb-46ce-bc71-14f9762f9ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:26.443610 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d8743b-39cb-46ce-bc71-14f9762f9ac6 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:26.443923 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d8743b-39cb-46ce-bc71-14f9762f9ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:26.444202 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d8743b-39cb-46ce-bc71-14f9762f9ac6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:26.444857 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d8743b-39cb-46ce-bc71-14f9762f9ac6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:26.446507 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d8743b-39cb-46ce-bc71-14f9762f9ac6 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:26.448256 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 939/1910] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:03:26 2022] DELETE /identity/v3/users/57b81a2b4ceb45a786ed72202c5050eb => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:03:26.457076 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 972/1911] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:03:26 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 11:03:26.461770 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f15d39-1d9b-4832-aa1a-8e118d044d55 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:26.463257 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-b3f15d39-1d9b-4832-aa1a-8e118d044d55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:26.533676 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f15d39-1d9b-4832-aa1a-8e118d044d55 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:26.538446 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccedb08b-1d56-4c52-92de-7bfd63c0144b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:26.539356 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccedb08b-1d56-4c52-92de-7bfd63c0144b admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:26.539637 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccedb08b-1d56-4c52-92de-7bfd63c0144b admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:26.539913 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccedb08b-1d56-4c52-92de-7bfd63c0144b admin admin] PATH_INFO: `/v3/projects/381eaa16993a403c86e8104a85aaa3c4/users/1c3d7818b239484194c9cec4b5c3f9d7/roles/127fdc7ef05b4e0b98a940b334e5fcab` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:26.541945 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccedb08b-1d56-4c52-92de-7bfd63c0144b admin admin] RBAC: Authorizing `identity:create_grant(project_id=381eaa16993a403c86e8104a85aaa3c4, user_id=1c3d7818b239484194c9cec4b5c3f9d7, role_id=127fdc7ef05b4e0b98a940b334e5fcab)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:26.544598 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccedb08b-1d56-4c52-92de-7bfd63c0144b admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:26.556031 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 940/1912] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:03:26 2022] PUT /identity/v3/projects/381eaa16993a403c86e8104a85aaa3c4/users/1c3d7818b239484194c9cec4b5c3f9d7/roles/127fdc7ef05b4e0b98a940b334e5fcab => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:03:26.566452 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429337f9-df35-40de-951d-208539ebd70c None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:26.566687 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429337f9-df35-40de-951d-208539ebd70c None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:26.566966 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429337f9-df35-40de-951d-208539ebd70c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:26.596977 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-429337f9-df35-40de-951d-208539ebd70c None None] MFA Rules not processed for user `1c3d7818b239484194c9cec4b5c3f9d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:03:26.598247 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-429337f9-df35-40de-951d-208539ebd70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:26.673082 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 973/1913] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:03:26 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:03:26.684813 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccedb08b-1d56-4c52-92de-7bfd63c0144b admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:26.686856 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-ccedb08b-1d56-4c52-92de-7bfd63c0144b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:26.760808 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccedb08b-1d56-4c52-92de-7bfd63c0144b admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:26.765006 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776636e3-a23f-4621-a7b9-958dbe0554c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b8a09704b9b4ab2bffb813796ec6e77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:26.768249 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776636e3-a23f-4621-a7b9-958dbe0554c6 service cinder] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:26.768249 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776636e3-a23f-4621-a7b9-958dbe0554c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:26.768249 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776636e3-a23f-4621-a7b9-958dbe0554c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:26.770266 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429337f9-df35-40de-951d-208539ebd70c None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:26.773246 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-429337f9-df35-40de-951d-208539ebd70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:26.781864 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776636e3-a23f-4621-a7b9-958dbe0554c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:26.784123 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776636e3-a23f-4621-a7b9-958dbe0554c6 service cinder] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:26.801792 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 941/1914] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:03:26 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:03:26.887949 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429337f9-df35-40de-951d-208539ebd70c None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:26.909677 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5ca94c-1629-42b3-b7c5-17aaa2f3965a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:26.915242 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ca94c-1629-42b3-b7c5-17aaa2f3965a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:26.918278 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ca94c-1629-42b3-b7c5-17aaa2f3965a admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:26.918775 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ca94c-1629-42b3-b7c5-17aaa2f3965a admin admin] PATH_INFO: `/v3/projects/aa79e1f0a44b42caa0638ab1557acf57` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:26.920762 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5ca94c-1629-42b3-b7c5-17aaa2f3965a admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa79e1f0a44b42caa0638ab1557acf57)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:26.924185 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5ca94c-1629-42b3-b7c5-17aaa2f3965a admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:26.943236 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:03:27.023532 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-5d5ca94c-1629-42b3-b7c5-17aaa2f3965a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa79e1f0a44b42caa0638ab1557acf57', 'request_id': 'req-5d5ca94c-1629-42b3-b7c5-17aaa2f3965a'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:27.033417 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-5d5ca94c-1629-42b3-b7c5-17aaa2f3965a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa79e1f0a44b42caa0638ab1557acf57', 'request_id': 'req-5d5ca94c-1629-42b3-b7c5-17aaa2f3965a'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:27.045204 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-5d5ca94c-1629-42b3-b7c5-17aaa2f3965a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa79e1f0a44b42caa0638ab1557acf57', 'request_id': 'req-5d5ca94c-1629-42b3-b7c5-17aaa2f3965a'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:27.064681 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-5d5ca94c-1629-42b3-b7c5-17aaa2f3965a admin admin] The token cache is being invalidate because project aa79e1f0a44b42caa0638ab1557acf57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:03:27.065165 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-5d5ca94c-1629-42b3-b7c5-17aaa2f3965a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:27.066133 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-5d5ca94c-1629-42b3-b7c5-17aaa2f3965a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:27.070843 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 974/1915] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:03:26 2022] DELETE /identity/v3/projects/aa79e1f0a44b42caa0638ab1557acf57 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:03:27.075596 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed58c94-3c59-4cad-8569-88959eea5f41 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:27.076063 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed58c94-3c59-4cad-8569-88959eea5f41 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:27.076166 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed58c94-3c59-4cad-8569-88959eea5f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:27.100577 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-0ed58c94-3c59-4cad-8569-88959eea5f41 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:03:27.101841 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-0ed58c94-3c59-4cad-8569-88959eea5f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:27.179364 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 942/1916] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:03:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:03:27.186893 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc47c56e-800e-477b-90ef-67ce5f762cf0 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:27.187375 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc47c56e-800e-477b-90ef-67ce5f762cf0 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:27.187571 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc47c56e-800e-477b-90ef-67ce5f762cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:27.211988 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-dc47c56e-800e-477b-90ef-67ce5f762cf0 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:03:27.213216 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-dc47c56e-800e-477b-90ef-67ce5f762cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:27.227165 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 975/1917] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:03:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:03:27.228558 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed58c94-3c59-4cad-8569-88959eea5f41 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:27.242468 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed58c94-3c59-4cad-8569-88959eea5f41 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:27.248145 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f6c4a9-9fed-4cd2-bafd-9ecb91b362ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:27.249541 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f6c4a9-9fed-4cd2-bafd-9ecb91b362ab admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:27.249903 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f6c4a9-9fed-4cd2-bafd-9ecb91b362ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:27.250348 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f6c4a9-9fed-4cd2-bafd-9ecb91b362ab admin admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:27.250943 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f6c4a9-9fed-4cd2-bafd-9ecb91b362ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:03:27.251249 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f6c4a9-9fed-4cd2-bafd-9ecb91b362ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:27.253579 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f6c4a9-9fed-4cd2-bafd-9ecb91b362ab admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:27.268569 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 943/1918] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Aug 18 11:03:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:03:27.273703 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc47c56e-800e-477b-90ef-67ce5f762cf0 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:27.286910 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc47c56e-800e-477b-90ef-67ce5f762cf0 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:27.306728 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b893ae0-7f46-4639-99f5-e0c856d8a709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:27.307726 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b893ae0-7f46-4639-99f5-e0c856d8a709 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:27.308148 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b893ae0-7f46-4639-99f5-e0c856d8a709 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:27.308560 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b893ae0-7f46-4639-99f5-e0c856d8a709 admin admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:27.309329 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b893ae0-7f46-4639-99f5-e0c856d8a709 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:27.311516 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b893ae0-7f46-4639-99f5-e0c856d8a709 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:27.320865 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f6c4a9-9fed-4cd2-bafd-9ecb91b362ab admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:27.322692 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-d9f6c4a9-9fed-4cd2-bafd-9ecb91b362ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:27.336571 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:03:27.343291 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f6c4a9-9fed-4cd2-bafd-9ecb91b362ab admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:27.351163 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd1758-c5e9-43a3-986f-b76ea54a8384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:27.352162 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd1758-c5e9-43a3-986f-b76ea54a8384 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:27.352448 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd1758-c5e9-43a3-986f-b76ea54a8384 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:27.352734 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd1758-c5e9-43a3-986f-b76ea54a8384 admin admin] PATH_INFO: `/v3/users/6f9e115179734117b4ae649b83be9166` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:27.354635 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cd1758-c5e9-43a3-986f-b76ea54a8384 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f9e115179734117b4ae649b83be9166)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:27.357709 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cd1758-c5e9-43a3-986f-b76ea54a8384 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:27.371175 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 976/1919] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:03:27 2022] POST /identity/v3/projects => generated 381 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:03:27.375107 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b893ae0-7f46-4639-99f5-e0c856d8a709 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:27.452778 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-46cd1758-c5e9-43a3-986f-b76ea54a8384 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f9e115179734117b4ae649b83be9166'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:27.462637 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-46cd1758-c5e9-43a3-986f-b76ea54a8384 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f9e115179734117b4ae649b83be9166'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:27.463492 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-46cd1758-c5e9-43a3-986f-b76ea54a8384 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f9e115179734117b4ae649b83be9166'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:27.464614 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-46cd1758-c5e9-43a3-986f-b76ea54a8384 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f9e115179734117b4ae649b83be9166'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:27.476765 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-46cd1758-c5e9-43a3-986f-b76ea54a8384 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f9e115179734117b4ae649b83be9166'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:27.501636 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 944/1920] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:03:27 2022] DELETE /identity/v3/users/6f9e115179734117b4ae649b83be9166 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:03:27.508988 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb88450-789a-4265-ba00-f69bbcbca30c None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:27.511183 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb88450-789a-4265-ba00-f69bbcbca30c None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:27.511467 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb88450-789a-4265-ba00-f69bbcbca30c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:27.533971 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b893ae0-7f46-4639-99f5-e0c856d8a709 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:27.545688 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-eeb88450-789a-4265-ba00-f69bbcbca30c None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:03:27.546975 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-eeb88450-789a-4265-ba00-f69bbcbca30c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:27.693959 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 945/1921] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:03:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:03:27.698069 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb88450-789a-4265-ba00-f69bbcbca30c None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:27.700179 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-eeb88450-789a-4265-ba00-f69bbcbca30c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:27.702299 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f6463e-95b3-4457-8443-4f5946bd5691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:27.702928 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f6463e-95b3-4457-8443-4f5946bd5691 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:27.703225 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f6463e-95b3-4457-8443-4f5946bd5691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:27.703502 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f6463e-95b3-4457-8443-4f5946bd5691 admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:27.704295 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f6463e-95b3-4457-8443-4f5946bd5691 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:27.707128 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f6463e-95b3-4457-8443-4f5946bd5691 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:27.750913 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 977/1922] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:03:27 2022] POST /identity/v3/users => generated 291 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:03:27.751872 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f6463e-95b3-4457-8443-4f5946bd5691 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:27.753852 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-28f6463e-95b3-4457-8443-4f5946bd5691 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:27.766648 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:03:27.836511 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb88450-789a-4265-ba00-f69bbcbca30c None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:27.840711 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc2ceaa-fdce-487d-ae71-6d965470e39f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b8a09704b9b4ab2bffb813796ec6e77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:27.841338 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc2ceaa-fdce-487d-ae71-6d965470e39f service cinder] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:27.841852 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc2ceaa-fdce-487d-ae71-6d965470e39f service cinder] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:27.842000 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc2ceaa-fdce-487d-ae71-6d965470e39f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:27.843844 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-3fc2ceaa-fdce-487d-ae71-6d965470e39f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:27.876265 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f6463e-95b3-4457-8443-4f5946bd5691 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:27.881609 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7a5cae-a1a2-4bf8-a6a2-5f89ce0c70e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:27.882729 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a5cae-a1a2-4bf8-a6a2-5f89ce0c70e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:27.883229 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a5cae-a1a2-4bf8-a6a2-5f89ce0c70e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:27.883820 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a5cae-a1a2-4bf8-a6a2-5f89ce0c70e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:27.915079 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:03:27.916646 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7a5cae-a1a2-4bf8-a6a2-5f89ce0c70e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:27.918560 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7a5cae-a1a2-4bf8-a6a2-5f89ce0c70e9 service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:27.952875 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 978/1923] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:03:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:03:27.954119 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7a5cae-a1a2-4bf8-a6a2-5f89ce0c70e9 service neutron] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:27.957609 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-6a7a5cae-a1a2-4bf8-a6a2-5f89ce0c70e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:27.971432 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc2ceaa-fdce-487d-ae71-6d965470e39f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:27.972867 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc2ceaa-fdce-487d-ae71-6d965470e39f service cinder] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:27.987573 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 946/1924] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:03:27 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:03:28.000685 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7a5cae-a1a2-4bf8-a6a2-5f89ce0c70e9 service neutron] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:28.010119 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697d75ff-0bee-4ceb-809d-f303eee3bb6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:28.010817 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d75ff-0bee-4ceb-809d-f303eee3bb6e admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:28.011143 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d75ff-0bee-4ceb-809d-f303eee3bb6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:28.011418 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d75ff-0bee-4ceb-809d-f303eee3bb6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:28.012063 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697d75ff-0bee-4ceb-809d-f303eee3bb6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:28.013753 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697d75ff-0bee-4ceb-809d-f303eee3bb6e admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:28.030484 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 979/1925] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:03:27 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:03:28.034567 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc2ceaa-fdce-487d-ae71-6d965470e39f service cinder] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:28.048593 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc2ceaa-fdce-487d-ae71-6d965470e39f service cinder] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:28.056125 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1f8c14-e7d9-4b2e-a3e2-465dc8f9d9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:28.056938 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1f8c14-e7d9-4b2e-a3e2-465dc8f9d9b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:28.057445 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1f8c14-e7d9-4b2e-a3e2-465dc8f9d9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:28.057969 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1f8c14-e7d9-4b2e-a3e2-465dc8f9d9b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:28.058741 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1f8c14-e7d9-4b2e-a3e2-465dc8f9d9b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:28.060699 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1f8c14-e7d9-4b2e-a3e2-465dc8f9d9b3 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:28.081498 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 947/1926] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:03:28 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 11:03:28.087157 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697d75ff-0bee-4ceb-809d-f303eee3bb6e admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:28.108457 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697d75ff-0bee-4ceb-809d-f303eee3bb6e admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:28.122364 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447f84c6-87be-4d09-a7b9-35932435ed6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:28.123006 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447f84c6-87be-4d09-a7b9-35932435ed6f admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:28.123291 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447f84c6-87be-4d09-a7b9-35932435ed6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:28.123551 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447f84c6-87be-4d09-a7b9-35932435ed6f admin admin] PATH_INFO: `/v3/projects/3053ece3219d4fa69975489d321650db/users/61cf6fe425e9425eb8a6ce74fb3512b2/roles/719e5c62188d4f8a838987d6e72ca8f7` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:28.158773 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447f84c6-87be-4d09-a7b9-35932435ed6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3053ece3219d4fa69975489d321650db, user_id=61cf6fe425e9425eb8a6ce74fb3512b2, role_id=719e5c62188d4f8a838987d6e72ca8f7)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:28.164334 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447f84c6-87be-4d09-a7b9-35932435ed6f admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:28.199174 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 980/1927] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:03:28 2022] PUT /identity/v3/projects/3053ece3219d4fa69975489d321650db/users/61cf6fe425e9425eb8a6ce74fb3512b2/roles/719e5c62188d4f8a838987d6e72ca8f7 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:03:28.212218 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86afa18-54d6-4d71-9877-5d23a743198d None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:28.212726 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86afa18-54d6-4d71-9877-5d23a743198d None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:28.213926 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86afa18-54d6-4d71-9877-5d23a743198d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:28.310711 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-f86afa18-54d6-4d71-9877-5d23a743198d None None] MFA Rules not processed for user `61cf6fe425e9425eb8a6ce74fb3512b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:03:28.311840 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-f86afa18-54d6-4d71-9877-5d23a743198d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:28.488289 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 948/1928] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:03:28 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:03:28.493791 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447f84c6-87be-4d09-a7b9-35932435ed6f admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:28.629036 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447f84c6-87be-4d09-a7b9-35932435ed6f admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:28.638352 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d86088a-b2fe-49cc-bc6c-faf0f2933f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:28.640098 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d86088a-b2fe-49cc-bc6c-faf0f2933f1e admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:28.641675 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d86088a-b2fe-49cc-bc6c-faf0f2933f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:28.642457 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d86088a-b2fe-49cc-bc6c-faf0f2933f1e admin admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:28.649172 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d86088a-b2fe-49cc-bc6c-faf0f2933f1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:28.652669 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d86088a-b2fe-49cc-bc6c-faf0f2933f1e admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:28.689563 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 981/1929] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:03:28 2022] POST /identity/v3/projects => generated 383 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:03:28.692953 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86afa18-54d6-4d71-9877-5d23a743198d None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:28.704345 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86afa18-54d6-4d71-9877-5d23a743198d None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:28.796664 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cdc678-5b38-4ca8-9837-93fad8d587a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:28.798215 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cdc678-5b38-4ca8-9837-93fad8d587a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:28.798505 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cdc678-5b38-4ca8-9837-93fad8d587a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:28.798776 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cdc678-5b38-4ca8-9837-93fad8d587a5 admin admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:28.799558 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cdc678-5b38-4ca8-9837-93fad8d587a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:28.802209 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cdc678-5b38-4ca8-9837-93fad8d587a5 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:28.828410 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 949/1930] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:03:28 2022] POST /identity/v3/users => generated 298 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:03:28.845155 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d86088a-b2fe-49cc-bc6c-faf0f2933f1e admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:28.857482 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d86088a-b2fe-49cc-bc6c-faf0f2933f1e admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:28.862545 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2198b7-7277-401d-8e85-2df3b265e525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:28.863150 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2198b7-7277-401d-8e85-2df3b265e525 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:28.863433 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2198b7-7277-401d-8e85-2df3b265e525 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:28.863712 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2198b7-7277-401d-8e85-2df3b265e525 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:28.864749 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2198b7-7277-401d-8e85-2df3b265e525 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:28.866962 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2198b7-7277-401d-8e85-2df3b265e525 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:28.881612 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 982/1931] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:03:28 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:03:28.884988 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cdc678-5b38-4ca8-9837-93fad8d587a5 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:28.898696 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cdc678-5b38-4ca8-9837-93fad8d587a5 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:28.904938 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57bab69-92c3-4d9b-aae7-6a3bc5eda435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:28.906138 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57bab69-92c3-4d9b-aae7-6a3bc5eda435 admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:28.906570 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57bab69-92c3-4d9b-aae7-6a3bc5eda435 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:28.907026 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57bab69-92c3-4d9b-aae7-6a3bc5eda435 admin admin] PATH_INFO: `/v3/projects/827bf9f4ed5940fba5c3a1f551b1cd6f/users/6930363c45844d11851057d0cbabbebe/roles/127fdc7ef05b4e0b98a940b334e5fcab` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:28.928895 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57bab69-92c3-4d9b-aae7-6a3bc5eda435 admin admin] RBAC: Authorizing `identity:create_grant(project_id=827bf9f4ed5940fba5c3a1f551b1cd6f, user_id=6930363c45844d11851057d0cbabbebe, role_id=127fdc7ef05b4e0b98a940b334e5fcab)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:28.931869 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2198b7-7277-401d-8e85-2df3b265e525 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:28.933050 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57bab69-92c3-4d9b-aae7-6a3bc5eda435 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:28.935510 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-6f2198b7-7277-401d-8e85-2df3b265e525 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:28.954034 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 950/1932] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:03:28 2022] PUT /identity/v3/projects/827bf9f4ed5940fba5c3a1f551b1cd6f/users/6930363c45844d11851057d0cbabbebe/roles/127fdc7ef05b4e0b98a940b334e5fcab => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:03:28.957136 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57bab69-92c3-4d9b-aae7-6a3bc5eda435 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:28.981386 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:03:28.990896 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2198b7-7277-401d-8e85-2df3b265e525 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:29.053323 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57bab69-92c3-4d9b-aae7-6a3bc5eda435 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:29.058424 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8005b68-a885-4338-b5b4-9dfb9bebddde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:29.059045 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8005b68-a885-4338-b5b4-9dfb9bebddde admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:29.059327 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8005b68-a885-4338-b5b4-9dfb9bebddde admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:29.059605 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8005b68-a885-4338-b5b4-9dfb9bebddde admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:29.060257 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8005b68-a885-4338-b5b4-9dfb9bebddde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:29.061114 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:03:29.061908 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8005b68-a885-4338-b5b4-9dfb9bebddde admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:29.073978 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 951/1933] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:03:28 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:03:29.078123 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8005b68-a885-4338-b5b4-9dfb9bebddde admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:29.078397 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23303fd7-33b8-4ebe-8c27-d9f3e1cfdfd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:29.079054 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23303fd7-33b8-4ebe-8c27-d9f3e1cfdfd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:29.079330 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23303fd7-33b8-4ebe-8c27-d9f3e1cfdfd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:29.079603 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23303fd7-33b8-4ebe-8c27-d9f3e1cfdfd1 admin admin] PATH_INFO: `/v3/projects/5d9ec8ae6275487b82d966289f49498a` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:29.080736 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23303fd7-33b8-4ebe-8c27-d9f3e1cfdfd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d9ec8ae6275487b82d966289f49498a)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:29.084292 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23303fd7-33b8-4ebe-8c27-d9f3e1cfdfd1 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:29.091140 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8005b68-a885-4338-b5b4-9dfb9bebddde admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:29.096042 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf7dc3e-087f-42cf-9b3d-ed5962ca34ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:29.096699 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7dc3e-087f-42cf-9b3d-ed5962ca34ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:29.096975 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7dc3e-087f-42cf-9b3d-ed5962ca34ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:29.097246 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7dc3e-087f-42cf-9b3d-ed5962ca34ce admin admin] PATH_INFO: `/v3/projects/827bf9f4ed5940fba5c3a1f551b1cd6f/users/6930363c45844d11851057d0cbabbebe/roles/127fdc7ef05b4e0b98a940b334e5fcab` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:29.099447 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf7dc3e-087f-42cf-9b3d-ed5962ca34ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=827bf9f4ed5940fba5c3a1f551b1cd6f, user_id=6930363c45844d11851057d0cbabbebe, role_id=127fdc7ef05b4e0b98a940b334e5fcab)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:29.102272 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf7dc3e-087f-42cf-9b3d-ed5962ca34ce admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:29.113345 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 952/1934] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:03:29 2022] PUT /identity/v3/projects/827bf9f4ed5940fba5c3a1f551b1cd6f/users/6930363c45844d11851057d0cbabbebe/roles/127fdc7ef05b4e0b98a940b334e5fcab => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:03:29.126754 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0788622-9b2f-4804-8072-4dc90522b633 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:29.127067 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0788622-9b2f-4804-8072-4dc90522b633 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:29.127344 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0788622-9b2f-4804-8072-4dc90522b633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:29.143035 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-23303fd7-33b8-4ebe-8c27-d9f3e1cfdfd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d9ec8ae6275487b82d966289f49498a', 'request_id': 'req-23303fd7-33b8-4ebe-8c27-d9f3e1cfdfd1'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:29.158337 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-23303fd7-33b8-4ebe-8c27-d9f3e1cfdfd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d9ec8ae6275487b82d966289f49498a', 'request_id': 'req-23303fd7-33b8-4ebe-8c27-d9f3e1cfdfd1'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:29.166139 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-b0788622-9b2f-4804-8072-4dc90522b633 None None] MFA Rules not processed for user `6930363c45844d11851057d0cbabbebe`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:03:29.167520 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-23303fd7-33b8-4ebe-8c27-d9f3e1cfdfd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d9ec8ae6275487b82d966289f49498a', 'request_id': 'req-23303fd7-33b8-4ebe-8c27-d9f3e1cfdfd1'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:29.167654 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-b0788622-9b2f-4804-8072-4dc90522b633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:29.180800 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-23303fd7-33b8-4ebe-8c27-d9f3e1cfdfd1 admin admin] The token cache is being invalidate because project 5d9ec8ae6275487b82d966289f49498a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:03:29.181143 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-23303fd7-33b8-4ebe-8c27-d9f3e1cfdfd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:29.181930 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-23303fd7-33b8-4ebe-8c27-d9f3e1cfdfd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:29.183636 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 983/1935] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:03:28 2022] DELETE /identity/v3/projects/5d9ec8ae6275487b82d966289f49498a => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:03:29.187666 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23303fd7-33b8-4ebe-8c27-d9f3e1cfdfd1 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:29.189537 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-23303fd7-33b8-4ebe-8c27-d9f3e1cfdfd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:29.251729 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 953/1936] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:03:29 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:03:29.261101 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23303fd7-33b8-4ebe-8c27-d9f3e1cfdfd1 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:29.264017 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0788622-9b2f-4804-8072-4dc90522b633 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:29.265638 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-b0788622-9b2f-4804-8072-4dc90522b633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:29.265953 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a67278-3e33-4496-9ba3-f3580807b1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:29.266590 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a67278-3e33-4496-9ba3-f3580807b1e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:29.266871 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a67278-3e33-4496-9ba3-f3580807b1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:29.267145 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a67278-3e33-4496-9ba3-f3580807b1e1 admin admin] PATH_INFO: `/v3/users/1c3d7818b239484194c9cec4b5c3f9d7` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:29.268319 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a67278-3e33-4496-9ba3-f3580807b1e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c3d7818b239484194c9cec4b5c3f9d7)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:29.270285 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a67278-3e33-4496-9ba3-f3580807b1e1 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:29.323458 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-a3a67278-3e33-4496-9ba3-f3580807b1e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c3d7818b239484194c9cec4b5c3f9d7'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:29.324107 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-a3a67278-3e33-4496-9ba3-f3580807b1e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c3d7818b239484194c9cec4b5c3f9d7'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:29.325855 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0788622-9b2f-4804-8072-4dc90522b633 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:29.329655 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa9b31d-98a0-4859-8fa7-7f571e44e5f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b8a09704b9b4ab2bffb813796ec6e77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:29.330267 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa9b31d-98a0-4859-8fa7-7f571e44e5f1 service cinder] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:29.330538 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa9b31d-98a0-4859-8fa7-7f571e44e5f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:29.330809 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa9b31d-98a0-4859-8fa7-7f571e44e5f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:29.331693 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-a3a67278-3e33-4496-9ba3-f3580807b1e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c3d7818b239484194c9cec4b5c3f9d7'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:29.340828 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa9b31d-98a0-4859-8fa7-7f571e44e5f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:29.342279 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa9b31d-98a0-4859-8fa7-7f571e44e5f1 service cinder] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:29.344274 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-a3a67278-3e33-4496-9ba3-f3580807b1e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c3d7818b239484194c9cec4b5c3f9d7'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:29.352740 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-a3a67278-3e33-4496-9ba3-f3580807b1e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c3d7818b239484194c9cec4b5c3f9d7'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:29.353128 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 954/1937] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:03:29 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 11:03:29.358860 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:03:29.364777 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 984/1938] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:03:29 2022] DELETE /identity/v3/users/1c3d7818b239484194c9cec4b5c3f9d7 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:03:29.460335 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa9b31d-98a0-4859-8fa7-7f571e44e5f1 service cinder] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:29.472792 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa9b31d-98a0-4859-8fa7-7f571e44e5f1 service cinder] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:29.496244 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:03:29.530743 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded2d9a8-aaed-4b95-9a1d-ebac2f4c30c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b8a09704b9b4ab2bffb813796ec6e77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:29.531361 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded2d9a8-aaed-4b95-9a1d-ebac2f4c30c8 service cinder] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:29.531654 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded2d9a8-aaed-4b95-9a1d-ebac2f4c30c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:29.531928 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded2d9a8-aaed-4b95-9a1d-ebac2f4c30c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:29.533755 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-ded2d9a8-aaed-4b95-9a1d-ebac2f4c30c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:29.618686 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded2d9a8-aaed-4b95-9a1d-ebac2f4c30c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:29.620141 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded2d9a8-aaed-4b95-9a1d-ebac2f4c30c8 service cinder] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:29.631294 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 955/1939] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:03:29 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:03:29.714413 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a67278-3e33-4496-9ba3-f3580807b1e1 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:29.715902 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-a3a67278-3e33-4496-9ba3-f3580807b1e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:29.835403 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a67278-3e33-4496-9ba3-f3580807b1e1 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:29.843250 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47545415-6eb5-40c5-b752-fbb1675effbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:29.845935 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47545415-6eb5-40c5-b752-fbb1675effbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:29.846235 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47545415-6eb5-40c5-b752-fbb1675effbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:29.846529 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47545415-6eb5-40c5-b752-fbb1675effbe admin admin] PATH_INFO: `/v3/projects/381eaa16993a403c86e8104a85aaa3c4` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:29.849953 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47545415-6eb5-40c5-b752-fbb1675effbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=381eaa16993a403c86e8104a85aaa3c4)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:29.856582 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47545415-6eb5-40c5-b752-fbb1675effbe admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:29.979046 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-47545415-6eb5-40c5-b752-fbb1675effbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '381eaa16993a403c86e8104a85aaa3c4', 'request_id': 'req-47545415-6eb5-40c5-b752-fbb1675effbe'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:29.999864 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-47545415-6eb5-40c5-b752-fbb1675effbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '381eaa16993a403c86e8104a85aaa3c4', 'request_id': 'req-47545415-6eb5-40c5-b752-fbb1675effbe'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:30.024450 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-47545415-6eb5-40c5-b752-fbb1675effbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '381eaa16993a403c86e8104a85aaa3c4', 'request_id': 'req-47545415-6eb5-40c5-b752-fbb1675effbe'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:30.051761 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-47545415-6eb5-40c5-b752-fbb1675effbe admin admin] The token cache is being invalidate because project 381eaa16993a403c86e8104a85aaa3c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:03:30.053926 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-47545415-6eb5-40c5-b752-fbb1675effbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:30.057149 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-47545415-6eb5-40c5-b752-fbb1675effbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:30.060195 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 985/1940] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:03:29 2022] DELETE /identity/v3/projects/381eaa16993a403c86e8104a85aaa3c4 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:03:30.065063 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d4e25d-eb42-4135-9875-b2a73ee02510 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:30.065599 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d4e25d-eb42-4135-9875-b2a73ee02510 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:30.065719 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d4e25d-eb42-4135-9875-b2a73ee02510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:30.096179 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-52d4e25d-eb42-4135-9875-b2a73ee02510 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:03:30.098969 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-52d4e25d-eb42-4135-9875-b2a73ee02510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:30.139746 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47545415-6eb5-40c5-b752-fbb1675effbe admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:30.141321 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-47545415-6eb5-40c5-b752-fbb1675effbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:30.249442 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47545415-6eb5-40c5-b752-fbb1675effbe admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:30.254729 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98c26df-539f-4177-b1f9-4934a5d6cdfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:30.256017 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c26df-539f-4177-b1f9-4934a5d6cdfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:30.256323 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c26df-539f-4177-b1f9-4934a5d6cdfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:30.256567 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c26df-539f-4177-b1f9-4934a5d6cdfb admin admin] PATH_INFO: `/v3/users/61cf6fe425e9425eb8a6ce74fb3512b2` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:30.258202 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98c26df-539f-4177-b1f9-4934a5d6cdfb admin admin] RBAC: Authorizing `identity:delete_user(user_id=61cf6fe425e9425eb8a6ce74fb3512b2)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:30.260357 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98c26df-539f-4177-b1f9-4934a5d6cdfb admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:30.283021 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 956/1941] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:03:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:03:30.298533 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f03664-0820-46e7-97ee-efe2d64ea7a8 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:30.298533 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f03664-0820-46e7-97ee-efe2d64ea7a8 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:30.298533 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f03664-0820-46e7-97ee-efe2d64ea7a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:30.315671 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:03:30.336197 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-a98c26df-539f-4177-b1f9-4934a5d6cdfb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61cf6fe425e9425eb8a6ce74fb3512b2'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:30.337252 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-a98c26df-539f-4177-b1f9-4934a5d6cdfb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61cf6fe425e9425eb8a6ce74fb3512b2'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:30.345834 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-a98c26df-539f-4177-b1f9-4934a5d6cdfb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61cf6fe425e9425eb8a6ce74fb3512b2'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:30.349292 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-c3f03664-0820-46e7-97ee-efe2d64ea7a8 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:03:30.350651 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-c3f03664-0820-46e7-97ee-efe2d64ea7a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:30.363880 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 957/1942] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:03:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:03:30.365128 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-a98c26df-539f-4177-b1f9-4934a5d6cdfb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61cf6fe425e9425eb8a6ce74fb3512b2'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:30.370033 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f03664-0820-46e7-97ee-efe2d64ea7a8 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:30.376156 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-a98c26df-539f-4177-b1f9-4934a5d6cdfb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61cf6fe425e9425eb8a6ce74fb3512b2'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:30.384622 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 986/1943] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:03:30 2022] DELETE /identity/v3/users/61cf6fe425e9425eb8a6ce74fb3512b2 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:03:30.387873 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f03664-0820-46e7-97ee-efe2d64ea7a8 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:30.389739 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b7433-5379-4342-a5b4-d10fb6722189 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:30.390214 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b7433-5379-4342-a5b4-d10fb6722189 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:30.390794 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b7433-5379-4342-a5b4-d10fb6722189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:30.412589 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-329b7433-5379-4342-a5b4-d10fb6722189 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:03:30.414112 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-329b7433-5379-4342-a5b4-d10fb6722189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:30.478391 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250fec84-5285-4db5-a2e9-1c11d1ffd4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:30.479331 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250fec84-5285-4db5-a2e9-1c11d1ffd4ba admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:30.479763 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250fec84-5285-4db5-a2e9-1c11d1ffd4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:30.480224 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250fec84-5285-4db5-a2e9-1c11d1ffd4ba admin admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:30.481028 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250fec84-5285-4db5-a2e9-1c11d1ffd4ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:03:30.481544 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250fec84-5285-4db5-a2e9-1c11d1ffd4ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:30.483540 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250fec84-5285-4db5-a2e9-1c11d1ffd4ba admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:30.487164 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 987/1944] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:03:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:03:30.503758 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 958/1945] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Aug 18 11:03:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:03:30.507134 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329b7433-5379-4342-a5b4-d10fb6722189 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:30.508737 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-329b7433-5379-4342-a5b4-d10fb6722189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:30.510992 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250fec84-5285-4db5-a2e9-1c11d1ffd4ba admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:30.512794 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-250fec84-5285-4db5-a2e9-1c11d1ffd4ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:30.522935 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:03:30.527198 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250fec84-5285-4db5-a2e9-1c11d1ffd4ba admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:30.532651 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5958750-64b3-42a3-bf61-a0e53c2fbb62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:30.533285 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5958750-64b3-42a3-bf61-a0e53c2fbb62 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:30.533600 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5958750-64b3-42a3-bf61-a0e53c2fbb62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:30.533864 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5958750-64b3-42a3-bf61-a0e53c2fbb62 admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:30.534496 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5958750-64b3-42a3-bf61-a0e53c2fbb62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:30.536526 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5958750-64b3-42a3-bf61-a0e53c2fbb62 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:30.572031 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 959/1946] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:03:30 2022] POST /identity/v3/projects => generated 375 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:03:30.577304 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5958750-64b3-42a3-bf61-a0e53c2fbb62 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:30.583271 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329b7433-5379-4342-a5b4-d10fb6722189 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:30.640737 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac04dfe-fefc-4d59-9c3b-06a8fe668104 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:30.641266 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac04dfe-fefc-4d59-9c3b-06a8fe668104 service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:30.641593 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac04dfe-fefc-4d59-9c3b-06a8fe668104 service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:30.641878 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac04dfe-fefc-4d59-9c3b-06a8fe668104 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:30.649157 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5958750-64b3-42a3-bf61-a0e53c2fbb62 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:30.651332 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac04dfe-fefc-4d59-9c3b-06a8fe668104 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:30.652813 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac04dfe-fefc-4d59-9c3b-06a8fe668104 service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:30.654200 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5882d4e-5ce6-4a71-849e-3f00168aa1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:30.654869 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5882d4e-5ce6-4a71-849e-3f00168aa1f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:30.655150 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5882d4e-5ce6-4a71-849e-3f00168aa1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:30.655488 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5882d4e-5ce6-4a71-849e-3f00168aa1f1 admin admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:30.656130 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5882d4e-5ce6-4a71-849e-3f00168aa1f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:30.658197 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5882d4e-5ce6-4a71-849e-3f00168aa1f1 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:30.662974 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 988/1947] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:03:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:03:30.688352 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 960/1948] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:03:30 2022] POST /identity/v3/users => generated 288 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:03:30.689508 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac04dfe-fefc-4d59-9c3b-06a8fe668104 service neutron] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:30.699863 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac04dfe-fefc-4d59-9c3b-06a8fe668104 service neutron] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:30.706033 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c73af8-2774-4359-8b37-3719881d80ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:30.706648 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c73af8-2774-4359-8b37-3719881d80ec admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:30.706952 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c73af8-2774-4359-8b37-3719881d80ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:30.707228 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c73af8-2774-4359-8b37-3719881d80ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:30.707925 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c73af8-2774-4359-8b37-3719881d80ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:30.709641 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c73af8-2774-4359-8b37-3719881d80ec admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:30.711452 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:03:30.732794 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 989/1949] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:03:30 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:03:30.734100 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5882d4e-5ce6-4a71-849e-3f00168aa1f1 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:30.745327 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5882d4e-5ce6-4a71-849e-3f00168aa1f1 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:30.750198 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff48cf3-6664-47d5-a72f-d74faf8668a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:30.750810 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff48cf3-6664-47d5-a72f-d74faf8668a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:30.751092 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff48cf3-6664-47d5-a72f-d74faf8668a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:30.751371 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff48cf3-6664-47d5-a72f-d74faf8668a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:30.752019 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff48cf3-6664-47d5-a72f-d74faf8668a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:30.753660 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff48cf3-6664-47d5-a72f-d74faf8668a8 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:30.765054 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 961/1950] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:03:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:03:30.771332 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c73af8-2774-4359-8b37-3719881d80ec admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:30.782912 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c73af8-2774-4359-8b37-3719881d80ec admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:30.791041 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c35d5d1-6fb5-4d10-b638-36f62adfa826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:30.791976 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c35d5d1-6fb5-4d10-b638-36f62adfa826 admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:30.792377 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c35d5d1-6fb5-4d10-b638-36f62adfa826 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:30.792785 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c35d5d1-6fb5-4d10-b638-36f62adfa826 admin admin] PATH_INFO: `/v3/projects/163c3e93d5cb457fa60326ea9ae9de53/users/b829511c846e4366b148f6ee7c39009c/roles/719e5c62188d4f8a838987d6e72ca8f7` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:30.812506 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c35d5d1-6fb5-4d10-b638-36f62adfa826 admin admin] RBAC: Authorizing `identity:create_grant(project_id=163c3e93d5cb457fa60326ea9ae9de53, user_id=b829511c846e4366b148f6ee7c39009c, role_id=719e5c62188d4f8a838987d6e72ca8f7)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:30.815220 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c35d5d1-6fb5-4d10-b638-36f62adfa826 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:30.831297 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 990/1951] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:03:30 2022] PUT /identity/v3/projects/163c3e93d5cb457fa60326ea9ae9de53/users/b829511c846e4366b148f6ee7c39009c/roles/719e5c62188d4f8a838987d6e72ca8f7 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:03:30.846757 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efca34c5-4487-424d-b87c-99b9822c4fac None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:30.847038 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efca34c5-4487-424d-b87c-99b9822c4fac None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:30.847321 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efca34c5-4487-424d-b87c-99b9822c4fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:30.881043 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-efca34c5-4487-424d-b87c-99b9822c4fac None None] MFA Rules not processed for user `b829511c846e4366b148f6ee7c39009c`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:03:30.882386 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-efca34c5-4487-424d-b87c-99b9822c4fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:30.955994 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 962/1952] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:03:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:03:30.961404 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c35d5d1-6fb5-4d10-b638-36f62adfa826 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:31.032983 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efca34c5-4487-424d-b87c-99b9822c4fac None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:31.034706 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-efca34c5-4487-424d-b87c-99b9822c4fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:31.038342 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c35d5d1-6fb5-4d10-b638-36f62adfa826 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:31.043519 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872e6fe7-2a3e-431a-acd3-1470d8d1d4e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:31.044141 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e6fe7-2a3e-431a-acd3-1470d8d1d4e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:31.044439 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e6fe7-2a3e-431a-acd3-1470d8d1d4e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:31.044699 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e6fe7-2a3e-431a-acd3-1470d8d1d4e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:31.045349 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872e6fe7-2a3e-431a-acd3-1470d8d1d4e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:31.047335 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872e6fe7-2a3e-431a-acd3-1470d8d1d4e5 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:31.055967 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efca34c5-4487-424d-b87c-99b9822c4fac None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:31.060617 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a5fc9f-462e-4a33-a4da-475e082bead4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:31.062194 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5fc9f-462e-4a33-a4da-475e082bead4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:31.062485 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5fc9f-462e-4a33-a4da-475e082bead4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:31.062785 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5fc9f-462e-4a33-a4da-475e082bead4 admin admin] PATH_INFO: `/v3/projects/3053ece3219d4fa69975489d321650db` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:31.063921 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a5fc9f-462e-4a33-a4da-475e082bead4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3053ece3219d4fa69975489d321650db)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:31.065859 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a5fc9f-462e-4a33-a4da-475e082bead4 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:31.079518 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 991/1953] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:03:30 2022] POST /identity/v3/projects => generated 373 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:03:31.084071 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872e6fe7-2a3e-431a-acd3-1470d8d1d4e5 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:31.121697 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:03:31.127329 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-c5a5fc9f-462e-4a33-a4da-475e082bead4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3053ece3219d4fa69975489d321650db', 'request_id': 'req-c5a5fc9f-462e-4a33-a4da-475e082bead4'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:31.140181 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-c5a5fc9f-462e-4a33-a4da-475e082bead4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3053ece3219d4fa69975489d321650db', 'request_id': 'req-c5a5fc9f-462e-4a33-a4da-475e082bead4'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:31.148890 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-c5a5fc9f-462e-4a33-a4da-475e082bead4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3053ece3219d4fa69975489d321650db', 'request_id': 'req-c5a5fc9f-462e-4a33-a4da-475e082bead4'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:31.164226 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-c5a5fc9f-462e-4a33-a4da-475e082bead4 admin admin] The token cache is being invalidate because project 3053ece3219d4fa69975489d321650db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:03:31.164621 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-c5a5fc9f-462e-4a33-a4da-475e082bead4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:31.165183 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-c5a5fc9f-462e-4a33-a4da-475e082bead4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:31.165724 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872e6fe7-2a3e-431a-acd3-1470d8d1d4e5 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:31.168618 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 963/1954] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:03:31 2022] DELETE /identity/v3/projects/3053ece3219d4fa69975489d321650db => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:03:31.173543 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a5fc9f-462e-4a33-a4da-475e082bead4 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:31.175234 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-c5a5fc9f-462e-4a33-a4da-475e082bead4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:31.249560 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb14ea64-3a6e-42de-849b-8b4ab34a34fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:31.250891 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb14ea64-3a6e-42de-849b-8b4ab34a34fe admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:31.251178 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb14ea64-3a6e-42de-849b-8b4ab34a34fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:31.251470 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb14ea64-3a6e-42de-849b-8b4ab34a34fe admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:31.257509 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb14ea64-3a6e-42de-849b-8b4ab34a34fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:31.268488 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb14ea64-3a6e-42de-849b-8b4ab34a34fe admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:31.283957 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:03:31.296335 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a5fc9f-462e-4a33-a4da-475e082bead4 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:31.299045 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 992/1955] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:03:31 2022] POST /identity/v3/users => generated 293 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 11:03:31.303821 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb14ea64-3a6e-42de-849b-8b4ab34a34fe admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:31.305627 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-bb14ea64-3a6e-42de-849b-8b4ab34a34fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:31.311924 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4ce4c4-1363-41ba-861e-316266b32093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:31.312584 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ce4c4-1363-41ba-861e-316266b32093 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:31.312875 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ce4c4-1363-41ba-861e-316266b32093 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:31.313143 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ce4c4-1363-41ba-861e-316266b32093 admin admin] PATH_INFO: `/v3/users/6930363c45844d11851057d0cbabbebe` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:31.319777 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb14ea64-3a6e-42de-849b-8b4ab34a34fe admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:31.321674 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4ce4c4-1363-41ba-861e-316266b32093 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6930363c45844d11851057d0cbabbebe)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:31.323644 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4ce4c4-1363-41ba-861e-316266b32093 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:31.325139 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46883a8-d414-4c7e-a191-f6dc91f8eeb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:31.325995 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46883a8-d414-4c7e-a191-f6dc91f8eeb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:31.326415 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46883a8-d414-4c7e-a191-f6dc91f8eeb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:31.326793 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46883a8-d414-4c7e-a191-f6dc91f8eeb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:31.327543 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46883a8-d414-4c7e-a191-f6dc91f8eeb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:31.329260 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46883a8-d414-4c7e-a191-f6dc91f8eeb8 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:31.344688 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 993/1956] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:03:31 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 11:03:31.353543 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46883a8-d414-4c7e-a191-f6dc91f8eeb8 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:31.375975 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46883a8-d414-4c7e-a191-f6dc91f8eeb8 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:31.380933 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07e26ba-bc70-40b5-bba3-b761d0f7ddae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:31.381629 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07e26ba-bc70-40b5-bba3-b761d0f7ddae admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:31.381908 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07e26ba-bc70-40b5-bba3-b761d0f7ddae admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:31.382183 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07e26ba-bc70-40b5-bba3-b761d0f7ddae admin admin] PATH_INFO: `/v3/projects/4d26a10acbe749a6ae7d04a42a02392a/users/288fa0d77f3245b6b73ad1314bde5e29/roles/127fdc7ef05b4e0b98a940b334e5fcab` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:31.390009 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-ba4ce4c4-1363-41ba-861e-316266b32093 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6930363c45844d11851057d0cbabbebe'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:31.398848 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-ba4ce4c4-1363-41ba-861e-316266b32093 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6930363c45844d11851057d0cbabbebe'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:31.399552 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-ba4ce4c4-1363-41ba-861e-316266b32093 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6930363c45844d11851057d0cbabbebe'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:31.400214 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-ba4ce4c4-1363-41ba-861e-316266b32093 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6930363c45844d11851057d0cbabbebe'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:31.404901 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07e26ba-bc70-40b5-bba3-b761d0f7ddae admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d26a10acbe749a6ae7d04a42a02392a, user_id=288fa0d77f3245b6b73ad1314bde5e29, role_id=127fdc7ef05b4e0b98a940b334e5fcab)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:31.407686 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07e26ba-bc70-40b5-bba3-b761d0f7ddae admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:31.407897 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-ba4ce4c4-1363-41ba-861e-316266b32093 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6930363c45844d11851057d0cbabbebe'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:31.422168 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 994/1957] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:03:31 2022] PUT /identity/v3/projects/4d26a10acbe749a6ae7d04a42a02392a/users/288fa0d77f3245b6b73ad1314bde5e29/roles/127fdc7ef05b4e0b98a940b334e5fcab => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:03:31.426637 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07e26ba-bc70-40b5-bba3-b761d0f7ddae admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:31.429000 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-b07e26ba-bc70-40b5-bba3-b761d0f7ddae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:31.429986 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 964/1958] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:03:31 2022] DELETE /identity/v3/users/6930363c45844d11851057d0cbabbebe => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:03:31.497182 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07e26ba-bc70-40b5-bba3-b761d0f7ddae admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:31.583204 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3cd092-f298-4bce-9824-8e1d23b8fc8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:31.584203 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3cd092-f298-4bce-9824-8e1d23b8fc8e admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:31.584492 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3cd092-f298-4bce-9824-8e1d23b8fc8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:31.584762 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3cd092-f298-4bce-9824-8e1d23b8fc8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:31.585425 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3cd092-f298-4bce-9824-8e1d23b8fc8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:31.588623 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3cd092-f298-4bce-9824-8e1d23b8fc8e admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:31.607774 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 995/1959] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:03:31 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 11:03:31.608155 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4ce4c4-1363-41ba-861e-316266b32093 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:31.620573 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4ce4c4-1363-41ba-861e-316266b32093 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:31.627590 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853de133-4c93-47b4-a2d4-59c81d6dca89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:31.628657 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853de133-4c93-47b4-a2d4-59c81d6dca89 admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:31.628871 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853de133-4c93-47b4-a2d4-59c81d6dca89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:31.629189 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853de133-4c93-47b4-a2d4-59c81d6dca89 admin admin] PATH_INFO: `/v3/projects/4d26a10acbe749a6ae7d04a42a02392a/users/288fa0d77f3245b6b73ad1314bde5e29/roles/127fdc7ef05b4e0b98a940b334e5fcab` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:31.631563 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853de133-4c93-47b4-a2d4-59c81d6dca89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d26a10acbe749a6ae7d04a42a02392a, user_id=288fa0d77f3245b6b73ad1314bde5e29, role_id=127fdc7ef05b4e0b98a940b334e5fcab)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:31.652119 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853de133-4c93-47b4-a2d4-59c81d6dca89 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:31.669604 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 965/1960] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:03:31 2022] PUT /identity/v3/projects/4d26a10acbe749a6ae7d04a42a02392a/users/288fa0d77f3245b6b73ad1314bde5e29/roles/127fdc7ef05b4e0b98a940b334e5fcab => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:03:31.690277 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4141ffe-2ca0-4505-a7df-518d256c0c83 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:31.690277 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4141ffe-2ca0-4505-a7df-518d256c0c83 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:31.690277 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4141ffe-2ca0-4505-a7df-518d256c0c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:31.711692 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-d4141ffe-2ca0-4505-a7df-518d256c0c83 None None] MFA Rules not processed for user `288fa0d77f3245b6b73ad1314bde5e29`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:03:31.713354 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-d4141ffe-2ca0-4505-a7df-518d256c0c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:31.787783 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:03:31.798374 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853de133-4c93-47b4-a2d4-59c81d6dca89 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:31.800414 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-853de133-4c93-47b4-a2d4-59c81d6dca89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:31.842071 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 996/1961] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:03:31 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:03:31.860073 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4141ffe-2ca0-4505-a7df-518d256c0c83 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:31.860073 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-d4141ffe-2ca0-4505-a7df-518d256c0c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:31.900365 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:03:31.938654 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853de133-4c93-47b4-a2d4-59c81d6dca89 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:31.947424 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7033c9-94a2-4320-9425-460421831f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:31.948569 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7033c9-94a2-4320-9425-460421831f19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:31.949027 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7033c9-94a2-4320-9425-460421831f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:31.949317 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7033c9-94a2-4320-9425-460421831f19 admin admin] PATH_INFO: `/v3/projects/827bf9f4ed5940fba5c3a1f551b1cd6f` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:31.951362 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7033c9-94a2-4320-9425-460421831f19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=827bf9f4ed5940fba5c3a1f551b1cd6f)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:31.953366 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7033c9-94a2-4320-9425-460421831f19 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:31.956852 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4141ffe-2ca0-4505-a7df-518d256c0c83 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:31.961264 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11384c6b-e7bf-4878-a58e-514893047e33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b8a09704b9b4ab2bffb813796ec6e77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:31.961906 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11384c6b-e7bf-4878-a58e-514893047e33 service cinder] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:31.962209 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11384c6b-e7bf-4878-a58e-514893047e33 service cinder] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:31.962484 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11384c6b-e7bf-4878-a58e-514893047e33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:31.964209 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-11384c6b-e7bf-4878-a58e-514893047e33 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:32.006806 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-9a7033c9-94a2-4320-9425-460421831f19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '827bf9f4ed5940fba5c3a1f551b1cd6f', 'request_id': 'req-9a7033c9-94a2-4320-9425-460421831f19'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:32.014897 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-9a7033c9-94a2-4320-9425-460421831f19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '827bf9f4ed5940fba5c3a1f551b1cd6f', 'request_id': 'req-9a7033c9-94a2-4320-9425-460421831f19'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:32.022684 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-9a7033c9-94a2-4320-9425-460421831f19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '827bf9f4ed5940fba5c3a1f551b1cd6f', 'request_id': 'req-9a7033c9-94a2-4320-9425-460421831f19'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:32.037441 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-9a7033c9-94a2-4320-9425-460421831f19 admin admin] The token cache is being invalidate because project 827bf9f4ed5940fba5c3a1f551b1cd6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:03:32.037779 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-9a7033c9-94a2-4320-9425-460421831f19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:32.038686 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-9a7033c9-94a2-4320-9425-460421831f19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:32.040403 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11384c6b-e7bf-4878-a58e-514893047e33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:32.044560 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 966/1962] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:03:31 2022] DELETE /identity/v3/projects/827bf9f4ed5940fba5c3a1f551b1cd6f => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:03:32.044712 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11384c6b-e7bf-4878-a58e-514893047e33 service cinder] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:32.046637 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d2afb1-6c87-42d4-97ea-4e51df029fd0 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:32.047686 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d2afb1-6c87-42d4-97ea-4e51df029fd0 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:32.047991 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d2afb1-6c87-42d4-97ea-4e51df029fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:32.053120 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 997/1963] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:03:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:03:32.072894 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-80d2afb1-6c87-42d4-97ea-4e51df029fd0 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:03:32.074223 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-80d2afb1-6c87-42d4-97ea-4e51df029fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:32.153655 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 967/1964] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:03:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:03:32.159543 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc819dae-8f5c-473a-be8e-b002115b820c None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:32.160060 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc819dae-8f5c-473a-be8e-b002115b820c None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:32.160577 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc819dae-8f5c-473a-be8e-b002115b820c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:32.201795 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-dc819dae-8f5c-473a-be8e-b002115b820c None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:03:32.203821 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-dc819dae-8f5c-473a-be8e-b002115b820c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:32.228880 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 998/1965] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:03:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:03:32.233759 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d2afb1-6c87-42d4-97ea-4e51df029fd0 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:32.245979 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d2afb1-6c87-42d4-97ea-4e51df029fd0 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:32.252006 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d609d9ca-2607-4838-bf99-69116bf49508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:32.252691 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609d9ca-2607-4838-bf99-69116bf49508 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:32.252982 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609d9ca-2607-4838-bf99-69116bf49508 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:32.253267 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609d9ca-2607-4838-bf99-69116bf49508 admin admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:32.254114 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d609d9ca-2607-4838-bf99-69116bf49508 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:03:32.254431 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d609d9ca-2607-4838-bf99-69116bf49508 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:32.256959 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d609d9ca-2607-4838-bf99-69116bf49508 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:32.269967 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 968/1966] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Aug 18 11:03:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:03:32.276902 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc819dae-8f5c-473a-be8e-b002115b820c None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:32.288477 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc819dae-8f5c-473a-be8e-b002115b820c None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:32.295144 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c720e18-0832-480d-be9b-c0afed04be7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:32.295762 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c720e18-0832-480d-be9b-c0afed04be7a admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:32.296093 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c720e18-0832-480d-be9b-c0afed04be7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:32.296410 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c720e18-0832-480d-be9b-c0afed04be7a admin admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:32.297027 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c720e18-0832-480d-be9b-c0afed04be7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:32.299841 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c720e18-0832-480d-be9b-c0afed04be7a admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:32.349148 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 999/1967] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:03:32 2022] POST /identity/v3/projects => generated 385 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:03:32.354030 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d609d9ca-2607-4838-bf99-69116bf49508 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:32.366731 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d609d9ca-2607-4838-bf99-69116bf49508 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:32.530419 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:03:32.553257 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f57f7a7-30f6-46d6-8665-479b19ff3068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:32.555450 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f57f7a7-30f6-46d6-8665-479b19ff3068 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:32.556021 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f57f7a7-30f6-46d6-8665-479b19ff3068 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:32.556538 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f57f7a7-30f6-46d6-8665-479b19ff3068 admin admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:32.557451 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f57f7a7-30f6-46d6-8665-479b19ff3068 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:32.560374 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f57f7a7-30f6-46d6-8665-479b19ff3068 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:32.611508 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 969/1968] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:03:32 2022] POST /identity/v3/users => generated 293 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 11:03:32.615835 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c720e18-0832-480d-be9b-c0afed04be7a admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:32.627795 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c720e18-0832-480d-be9b-c0afed04be7a admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:32.644584 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ceeea5-d815-49de-8204-6cf10eff9eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:32.646774 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ceeea5-d815-49de-8204-6cf10eff9eb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:32.649035 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ceeea5-d815-49de-8204-6cf10eff9eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:32.649473 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ceeea5-d815-49de-8204-6cf10eff9eb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:32.650356 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ceeea5-d815-49de-8204-6cf10eff9eb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:32.652125 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ceeea5-d815-49de-8204-6cf10eff9eb6 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:32.679888 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1000/1969] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:03:32 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:03:32.684486 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f57f7a7-30f6-46d6-8665-479b19ff3068 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:32.729496 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f57f7a7-30f6-46d6-8665-479b19ff3068 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:32.745684 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce00372a-85c0-492d-8554-866d791011da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:32.746560 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce00372a-85c0-492d-8554-866d791011da admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:32.747244 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce00372a-85c0-492d-8554-866d791011da admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:32.752061 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce00372a-85c0-492d-8554-866d791011da admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:32.753148 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce00372a-85c0-492d-8554-866d791011da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:32.755317 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce00372a-85c0-492d-8554-866d791011da admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:32.778608 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 970/1970] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:03:32 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:03:32.779803 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ceeea5-d815-49de-8204-6cf10eff9eb6 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:32.796743 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ceeea5-d815-49de-8204-6cf10eff9eb6 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:32.802195 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311fada9-ca72-4b32-974c-ad62f4f5ff89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:32.802949 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311fada9-ca72-4b32-974c-ad62f4f5ff89 admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:32.803296 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311fada9-ca72-4b32-974c-ad62f4f5ff89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:32.803634 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311fada9-ca72-4b32-974c-ad62f4f5ff89 admin admin] PATH_INFO: `/v3/projects/8c4c7dde07f94fbf8976eb7fcbbd2524/users/53dadcbf6abe4b389aae730b73f1e486/roles/719e5c62188d4f8a838987d6e72ca8f7` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:32.824290 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311fada9-ca72-4b32-974c-ad62f4f5ff89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c4c7dde07f94fbf8976eb7fcbbd2524, user_id=53dadcbf6abe4b389aae730b73f1e486, role_id=719e5c62188d4f8a838987d6e72ca8f7)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:32.829205 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311fada9-ca72-4b32-974c-ad62f4f5ff89 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:32.862340 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1001/1971] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:03:32 2022] PUT /identity/v3/projects/8c4c7dde07f94fbf8976eb7fcbbd2524/users/53dadcbf6abe4b389aae730b73f1e486/roles/719e5c62188d4f8a838987d6e72ca8f7 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:03:32.865153 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c43d41-b6da-4199-9e84-9f7d9b847084 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:32.865762 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c43d41-b6da-4199-9e84-9f7d9b847084 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:32.866229 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c43d41-b6da-4199-9e84-9f7d9b847084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:32.903993 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-94c43d41-b6da-4199-9e84-9f7d9b847084 None None] MFA Rules not processed for user `53dadcbf6abe4b389aae730b73f1e486`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:03:32.905578 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-94c43d41-b6da-4199-9e84-9f7d9b847084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:33.000586 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 971/1972] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:03:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:03:33.068024 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311fada9-ca72-4b32-974c-ad62f4f5ff89 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:33.069911 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-311fada9-ca72-4b32-974c-ad62f4f5ff89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:33.142006 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:03:33.168448 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311fada9-ca72-4b32-974c-ad62f4f5ff89 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:33.172519 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b8f397-af89-4d4b-b1d8-44cf8d442fd8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b8a09704b9b4ab2bffb813796ec6e77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:33.173315 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b8f397-af89-4d4b-b1d8-44cf8d442fd8 service cinder] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:33.173740 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b8f397-af89-4d4b-b1d8-44cf8d442fd8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:33.174092 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b8f397-af89-4d4b-b1d8-44cf8d442fd8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:33.185271 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b8f397-af89-4d4b-b1d8-44cf8d442fd8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:33.186808 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b8f397-af89-4d4b-b1d8-44cf8d442fd8 service cinder] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:33.215463 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1002/1973] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:03:33 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:03:33.236237 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c43d41-b6da-4199-9e84-9f7d9b847084 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:33.305324 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c43d41-b6da-4199-9e84-9f7d9b847084 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:33.310621 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b254f0-50b3-41f1-93f2-1c29a252638a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:33.310930 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b254f0-50b3-41f1-93f2-1c29a252638a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:33.311247 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b254f0-50b3-41f1-93f2-1c29a252638a admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:33.311515 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b254f0-50b3-41f1-93f2-1c29a252638a admin admin] PATH_INFO: `/v3/users/53dadcbf6abe4b389aae730b73f1e486` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:33.313065 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b254f0-50b3-41f1-93f2-1c29a252638a admin admin] RBAC: Authorizing `identity:delete_user(user_id=53dadcbf6abe4b389aae730b73f1e486)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:33.317690 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b254f0-50b3-41f1-93f2-1c29a252638a admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:33.377750 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-c9b254f0-50b3-41f1-93f2-1c29a252638a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53dadcbf6abe4b389aae730b73f1e486'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:33.386901 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-c9b254f0-50b3-41f1-93f2-1c29a252638a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53dadcbf6abe4b389aae730b73f1e486'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:33.387724 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-c9b254f0-50b3-41f1-93f2-1c29a252638a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53dadcbf6abe4b389aae730b73f1e486'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:33.388363 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-c9b254f0-50b3-41f1-93f2-1c29a252638a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53dadcbf6abe4b389aae730b73f1e486'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:33.398242 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-c9b254f0-50b3-41f1-93f2-1c29a252638a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53dadcbf6abe4b389aae730b73f1e486'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:33.406680 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:03:33.452960 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 972/1974] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:03:33 2022] DELETE /identity/v3/users/53dadcbf6abe4b389aae730b73f1e486 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:03:33.457388 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07affa5-b7a0-4c75-997c-ff87973ad8f7 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:33.458598 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07affa5-b7a0-4c75-997c-ff87973ad8f7 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:33.458598 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07affa5-b7a0-4c75-997c-ff87973ad8f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:33.478754 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-f07affa5-b7a0-4c75-997c-ff87973ad8f7 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:03:33.480033 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-f07affa5-b7a0-4c75-997c-ff87973ad8f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:33.540114 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1003/1975] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:03:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:03:33.550417 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b254f0-50b3-41f1-93f2-1c29a252638a admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:33.551938 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-c9b254f0-50b3-41f1-93f2-1c29a252638a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:33.614589 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b254f0-50b3-41f1-93f2-1c29a252638a admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:33.618698 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e88477-7485-4951-abad-e60b3b0a475d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:33.619386 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e88477-7485-4951-abad-e60b3b0a475d service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:33.619672 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e88477-7485-4951-abad-e60b3b0a475d service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:33.619948 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e88477-7485-4951-abad-e60b3b0a475d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:33.631150 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e88477-7485-4951-abad-e60b3b0a475d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:33.632615 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e88477-7485-4951-abad-e60b3b0a475d service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:33.643177 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 973/1976] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:03:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 11:03:33.992836 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07affa5-b7a0-4c75-997c-ff87973ad8f7 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:33.994615 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-f07affa5-b7a0-4c75-997c-ff87973ad8f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:34.008450 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07affa5-b7a0-4c75-997c-ff87973ad8f7 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:34.013913 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f63b71-4ca6-416a-8b46-8fade017643c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:34.015317 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f63b71-4ca6-416a-8b46-8fade017643c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:34.015317 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f63b71-4ca6-416a-8b46-8fade017643c admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:34.015317 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f63b71-4ca6-416a-8b46-8fade017643c admin admin] PATH_INFO: `/v3/projects/8c4c7dde07f94fbf8976eb7fcbbd2524` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:34.017267 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f63b71-4ca6-416a-8b46-8fade017643c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c4c7dde07f94fbf8976eb7fcbbd2524)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:34.019624 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f63b71-4ca6-416a-8b46-8fade017643c admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:34.090934 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-b9f63b71-4ca6-416a-8b46-8fade017643c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c4c7dde07f94fbf8976eb7fcbbd2524', 'request_id': 'req-b9f63b71-4ca6-416a-8b46-8fade017643c'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:34.100044 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-b9f63b71-4ca6-416a-8b46-8fade017643c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c4c7dde07f94fbf8976eb7fcbbd2524', 'request_id': 'req-b9f63b71-4ca6-416a-8b46-8fade017643c'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:34.107161 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-b9f63b71-4ca6-416a-8b46-8fade017643c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c4c7dde07f94fbf8976eb7fcbbd2524', 'request_id': 'req-b9f63b71-4ca6-416a-8b46-8fade017643c'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:34.119452 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-b9f63b71-4ca6-416a-8b46-8fade017643c admin admin] The token cache is being invalidate because project 8c4c7dde07f94fbf8976eb7fcbbd2524 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:03:34.119824 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-b9f63b71-4ca6-416a-8b46-8fade017643c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:34.121078 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-b9f63b71-4ca6-416a-8b46-8fade017643c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:34.125593 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1004/1977] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:03:33 2022] DELETE /identity/v3/projects/8c4c7dde07f94fbf8976eb7fcbbd2524 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:03:34.128090 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a83046-8187-4f09-9824-d9479ca129cb None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:34.128503 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a83046-8187-4f09-9824-d9479ca129cb None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:34.128685 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a83046-8187-4f09-9824-d9479ca129cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:34.150034 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-e9a83046-8187-4f09-9824-d9479ca129cb None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:03:34.151337 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-e9a83046-8187-4f09-9824-d9479ca129cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:34.257815 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 974/1978] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:03:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:03:34.264085 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3aed3d-dc25-4ab9-babd-ddd93cdfec48 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:34.264393 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3aed3d-dc25-4ab9-babd-ddd93cdfec48 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:34.264668 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3aed3d-dc25-4ab9-babd-ddd93cdfec48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:34.300062 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-0a3aed3d-dc25-4ab9-babd-ddd93cdfec48 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:03:34.303496 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-0a3aed3d-dc25-4ab9-babd-ddd93cdfec48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:34.312376 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1005/1979] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:03:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:03:34.316518 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a83046-8187-4f09-9824-d9479ca129cb None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:34.330412 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a83046-8187-4f09-9824-d9479ca129cb None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:34.337909 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a779a72-bb92-4405-8adb-1ab39f4a8803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:34.339816 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a779a72-bb92-4405-8adb-1ab39f4a8803 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:34.340329 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a779a72-bb92-4405-8adb-1ab39f4a8803 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:34.340856 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a779a72-bb92-4405-8adb-1ab39f4a8803 admin admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:34.341783 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a779a72-bb92-4405-8adb-1ab39f4a8803 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:03:34.342557 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a779a72-bb92-4405-8adb-1ab39f4a8803 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:34.345009 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a779a72-bb92-4405-8adb-1ab39f4a8803 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:34.365248 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 975/1980] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Aug 18 11:03:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:03:34.369883 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3aed3d-dc25-4ab9-babd-ddd93cdfec48 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:34.380823 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3aed3d-dc25-4ab9-babd-ddd93cdfec48 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:34.385901 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78455abc-66f8-4a67-947e-c215d7184f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:34.386503 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78455abc-66f8-4a67-947e-c215d7184f56 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:34.386978 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78455abc-66f8-4a67-947e-c215d7184f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:34.387085 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78455abc-66f8-4a67-947e-c215d7184f56 admin admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:34.387877 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78455abc-66f8-4a67-947e-c215d7184f56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:34.395146 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78455abc-66f8-4a67-947e-c215d7184f56 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:34.433555 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1006/1981] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:03:34 2022] POST /identity/v3/projects => generated 371 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:03:34.435530 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a779a72-bb92-4405-8adb-1ab39f4a8803 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:34.445939 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a779a72-bb92-4405-8adb-1ab39f4a8803 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:34.519763 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119e3ed9-6658-4c96-8a11-eb9a47ac594f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:34.520455 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e3ed9-6658-4c96-8a11-eb9a47ac594f admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:34.520739 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e3ed9-6658-4c96-8a11-eb9a47ac594f admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:34.521176 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e3ed9-6658-4c96-8a11-eb9a47ac594f admin admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:34.521886 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119e3ed9-6658-4c96-8a11-eb9a47ac594f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:34.524819 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119e3ed9-6658-4c96-8a11-eb9a47ac594f admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:34.562702 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 976/1982] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:03:34 2022] POST /identity/v3/users => generated 286 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:03:34.566230 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78455abc-66f8-4a67-947e-c215d7184f56 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:34.586889 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78455abc-66f8-4a67-947e-c215d7184f56 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:34.592031 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b191b05e-17eb-40d9-8561-291818e68519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:34.592654 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191b05e-17eb-40d9-8561-291818e68519 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:34.592930 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191b05e-17eb-40d9-8561-291818e68519 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:34.593202 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191b05e-17eb-40d9-8561-291818e68519 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:34.593875 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b191b05e-17eb-40d9-8561-291818e68519 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:34.595514 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b191b05e-17eb-40d9-8561-291818e68519 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:34.608100 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1007/1983] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:03:34 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:03:34.612294 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119e3ed9-6658-4c96-8a11-eb9a47ac594f admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:34.621213 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:03:34.628037 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119e3ed9-6658-4c96-8a11-eb9a47ac594f admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:34.636978 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93916c69-bafd-4350-9c9e-4dd11bd83737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:34.638301 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93916c69-bafd-4350-9c9e-4dd11bd83737 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:34.639203 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93916c69-bafd-4350-9c9e-4dd11bd83737 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:34.640075 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93916c69-bafd-4350-9c9e-4dd11bd83737 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:34.641095 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93916c69-bafd-4350-9c9e-4dd11bd83737 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:34.643112 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93916c69-bafd-4350-9c9e-4dd11bd83737 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:34.661538 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 977/1984] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:03:34 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:03:34.663358 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b191b05e-17eb-40d9-8561-291818e68519 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:34.674527 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b191b05e-17eb-40d9-8561-291818e68519 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:34.680215 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6043db-f8e4-4ed4-9af4-0459218b633d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:34.680873 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6043db-f8e4-4ed4-9af4-0459218b633d admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:34.681155 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6043db-f8e4-4ed4-9af4-0459218b633d admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:34.681434 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6043db-f8e4-4ed4-9af4-0459218b633d admin admin] PATH_INFO: `/v3/projects/d591dc6849c641888dbd28827a629d31/users/2ea5b4501d934e1bbfd6d46577d09e5d/roles/719e5c62188d4f8a838987d6e72ca8f7` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:34.698252 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6043db-f8e4-4ed4-9af4-0459218b633d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d591dc6849c641888dbd28827a629d31, user_id=2ea5b4501d934e1bbfd6d46577d09e5d, role_id=719e5c62188d4f8a838987d6e72ca8f7)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:34.700908 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6043db-f8e4-4ed4-9af4-0459218b633d admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:34.722378 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:03:34.731078 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1008/1985] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:03:34 2022] PUT /identity/v3/projects/d591dc6849c641888dbd28827a629d31/users/2ea5b4501d934e1bbfd6d46577d09e5d/roles/719e5c62188d4f8a838987d6e72ca8f7 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:03:34.738457 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba4cb40-166a-40fc-886d-5c4c5ce5b146 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:34.738748 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba4cb40-166a-40fc-886d-5c4c5ce5b146 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:34.739189 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba4cb40-166a-40fc-886d-5c4c5ce5b146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:34.761879 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-cba4cb40-166a-40fc-886d-5c4c5ce5b146 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:03:34.763605 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-cba4cb40-166a-40fc-886d-5c4c5ce5b146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:34.825141 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6043db-f8e4-4ed4-9af4-0459218b633d admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:34.826935 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-7e6043db-f8e4-4ed4-9af4-0459218b633d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:34.837557 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 978/1986] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:03:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:03:34.845595 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba4cb40-166a-40fc-886d-5c4c5ce5b146 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:34.847166 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-cba4cb40-166a-40fc-886d-5c4c5ce5b146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:34.850870 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6043db-f8e4-4ed4-9af4-0459218b633d admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:34.856123 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ca16ec-c5af-4b90-8120-b6312943eab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:34.856772 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ca16ec-c5af-4b90-8120-b6312943eab0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:34.857057 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ca16ec-c5af-4b90-8120-b6312943eab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:34.857337 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ca16ec-c5af-4b90-8120-b6312943eab0 admin admin] PATH_INFO: `/v3/users/b829511c846e4366b148f6ee7c39009c` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:34.858672 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ca16ec-c5af-4b90-8120-b6312943eab0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b829511c846e4366b148f6ee7c39009c)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:34.860607 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ca16ec-c5af-4b90-8120-b6312943eab0 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:34.917895 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-b0ca16ec-c5af-4b90-8120-b6312943eab0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b829511c846e4366b148f6ee7c39009c'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:34.918576 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-b0ca16ec-c5af-4b90-8120-b6312943eab0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b829511c846e4366b148f6ee7c39009c'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:34.921015 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba4cb40-166a-40fc-886d-5c4c5ce5b146 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:34.925104 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e6bba9-3532-49e6-91f8-d616af0c1f57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:34.926057 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e6bba9-3532-49e6-91f8-d616af0c1f57 service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:34.926556 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e6bba9-3532-49e6-91f8-d616af0c1f57 service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:34.926830 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e6bba9-3532-49e6-91f8-d616af0c1f57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:34.929661 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-b0ca16ec-c5af-4b90-8120-b6312943eab0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b829511c846e4366b148f6ee7c39009c'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:34.937406 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e6bba9-3532-49e6-91f8-d616af0c1f57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:34.938917 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e6bba9-3532-49e6-91f8-d616af0c1f57 service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:34.943478 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-b0ca16ec-c5af-4b90-8120-b6312943eab0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b829511c846e4366b148f6ee7c39009c'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:34.954457 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-b0ca16ec-c5af-4b90-8120-b6312943eab0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b829511c846e4366b148f6ee7c39009c'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:34.961467 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 979/1987] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:03:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 11:03:34.969581 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1009/1988] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:03:34 2022] DELETE /identity/v3/users/b829511c846e4366b148f6ee7c39009c => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:03:34.971088 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1803d0b2-4174-4192-a8b9-f4b5b85bed70 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:34.972081 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1803d0b2-4174-4192-a8b9-f4b5b85bed70 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:34.972554 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1803d0b2-4174-4192-a8b9-f4b5b85bed70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:34.997274 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-1803d0b2-4174-4192-a8b9-f4b5b85bed70 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:03:34.998558 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-1803d0b2-4174-4192-a8b9-f4b5b85bed70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:35.085059 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 980/1989] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:03:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:03:35.096098 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ca16ec-c5af-4b90-8120-b6312943eab0 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:35.097567 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-b0ca16ec-c5af-4b90-8120-b6312943eab0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:35.191416 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ca16ec-c5af-4b90-8120-b6312943eab0 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:35.196130 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78b9ea1-11ec-4f45-9946-e8e52e17a32e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:35.197126 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b9ea1-11ec-4f45-9946-e8e52e17a32e service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:35.197543 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b9ea1-11ec-4f45-9946-e8e52e17a32e service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:35.197922 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b9ea1-11ec-4f45-9946-e8e52e17a32e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:35.215191 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78b9ea1-11ec-4f45-9946-e8e52e17a32e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:35.216805 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78b9ea1-11ec-4f45-9946-e8e52e17a32e service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:35.231634 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1010/1990] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:03:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:03:35.867942 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1803d0b2-4174-4192-a8b9-f4b5b85bed70 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:35.869396 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-1803d0b2-4174-4192-a8b9-f4b5b85bed70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:35.882028 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1803d0b2-4174-4192-a8b9-f4b5b85bed70 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:35.886763 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50af164-7114-4911-a4ec-56d4bbe11647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:35.887594 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50af164-7114-4911-a4ec-56d4bbe11647 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:35.887875 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50af164-7114-4911-a4ec-56d4bbe11647 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:35.888146 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50af164-7114-4911-a4ec-56d4bbe11647 admin admin] PATH_INFO: `/v3/projects/163c3e93d5cb457fa60326ea9ae9de53` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:35.889428 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50af164-7114-4911-a4ec-56d4bbe11647 admin admin] RBAC: Authorizing `identity:delete_project(project_id=163c3e93d5cb457fa60326ea9ae9de53)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:35.891347 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50af164-7114-4911-a4ec-56d4bbe11647 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:35.936010 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:03:35.950628 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-c50af164-7114-4911-a4ec-56d4bbe11647 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '163c3e93d5cb457fa60326ea9ae9de53', 'request_id': 'req-c50af164-7114-4911-a4ec-56d4bbe11647'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:35.959290 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-c50af164-7114-4911-a4ec-56d4bbe11647 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '163c3e93d5cb457fa60326ea9ae9de53', 'request_id': 'req-c50af164-7114-4911-a4ec-56d4bbe11647'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:35.966776 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-c50af164-7114-4911-a4ec-56d4bbe11647 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '163c3e93d5cb457fa60326ea9ae9de53', 'request_id': 'req-c50af164-7114-4911-a4ec-56d4bbe11647'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:35.979813 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-c50af164-7114-4911-a4ec-56d4bbe11647 admin admin] The token cache is being invalidate because project 163c3e93d5cb457fa60326ea9ae9de53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:03:35.980122 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-c50af164-7114-4911-a4ec-56d4bbe11647 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:35.980830 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-c50af164-7114-4911-a4ec-56d4bbe11647 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:35.983252 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 981/1991] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:03:35 2022] DELETE /identity/v3/projects/163c3e93d5cb457fa60326ea9ae9de53 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:03:35.988243 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78b9ea1-11ec-4f45-9946-e8e52e17a32e service neutron] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:35.998960 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78b9ea1-11ec-4f45-9946-e8e52e17a32e service neutron] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:36.063553 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060e0a07-c930-4b19-b9e9-ed5c6e8874a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:36.064408 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e0a07-c930-4b19-b9e9-ed5c6e8874a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:36.064503 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e0a07-c930-4b19-b9e9-ed5c6e8874a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:36.065750 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e0a07-c930-4b19-b9e9-ed5c6e8874a1 admin admin] PATH_INFO: `/v3/users/288fa0d77f3245b6b73ad1314bde5e29` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:36.067271 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060e0a07-c930-4b19-b9e9-ed5c6e8874a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=288fa0d77f3245b6b73ad1314bde5e29)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:36.070101 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060e0a07-c930-4b19-b9e9-ed5c6e8874a1 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:36.108844 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd71ee-44d1-4146-a4ab-38540fb7fd44 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:36.109509 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd71ee-44d1-4146-a4ab-38540fb7fd44 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:36.109999 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd71ee-44d1-4146-a4ab-38540fb7fd44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:36.111538 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:03:36.144917 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-3abd71ee-44d1-4146-a4ab-38540fb7fd44 None None] MFA Rules not processed for user `2ea5b4501d934e1bbfd6d46577d09e5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:03:36.146466 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-3abd71ee-44d1-4146-a4ab-38540fb7fd44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:36.154917 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-060e0a07-c930-4b19-b9e9-ed5c6e8874a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '288fa0d77f3245b6b73ad1314bde5e29'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:36.155871 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-060e0a07-c930-4b19-b9e9-ed5c6e8874a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '288fa0d77f3245b6b73ad1314bde5e29'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:36.164277 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-060e0a07-c930-4b19-b9e9-ed5c6e8874a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '288fa0d77f3245b6b73ad1314bde5e29'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:36.179781 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-060e0a07-c930-4b19-b9e9-ed5c6e8874a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '288fa0d77f3245b6b73ad1314bde5e29'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:36.191318 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-060e0a07-c930-4b19-b9e9-ed5c6e8874a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '288fa0d77f3245b6b73ad1314bde5e29'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:36.201561 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1011/1992] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:03:35 2022] DELETE /identity/v3/users/288fa0d77f3245b6b73ad1314bde5e29 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:03:36.243584 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 982/1993] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:03:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:03:36.256541 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060e0a07-c930-4b19-b9e9-ed5c6e8874a1 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:36.258717 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-060e0a07-c930-4b19-b9e9-ed5c6e8874a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:36.329481 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060e0a07-c930-4b19-b9e9-ed5c6e8874a1 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:36.334243 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6474a5-88c1-4366-90dc-71a4e472d12b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b8a09704b9b4ab2bffb813796ec6e77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:36.334880 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6474a5-88c1-4366-90dc-71a4e472d12b service cinder] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:36.335174 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6474a5-88c1-4366-90dc-71a4e472d12b service cinder] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:36.335441 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6474a5-88c1-4366-90dc-71a4e472d12b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:36.400117 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6474a5-88c1-4366-90dc-71a4e472d12b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:36.401586 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6474a5-88c1-4366-90dc-71a4e472d12b service cinder] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:36.410961 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1012/1994] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:03:36 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:03:36.527059 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abd71ee-44d1-4146-a4ab-38540fb7fd44 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:36.528516 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-3abd71ee-44d1-4146-a4ab-38540fb7fd44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:36.566995 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abd71ee-44d1-4146-a4ab-38540fb7fd44 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:36.648104 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9000fc-dba1-45a3-8cb9-186d8f5b9bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:36.649550 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9000fc-dba1-45a3-8cb9-186d8f5b9bde admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:36.649896 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9000fc-dba1-45a3-8cb9-186d8f5b9bde admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:36.650245 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9000fc-dba1-45a3-8cb9-186d8f5b9bde admin admin] PATH_INFO: `/v3/projects/4d26a10acbe749a6ae7d04a42a02392a` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:36.652326 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9000fc-dba1-45a3-8cb9-186d8f5b9bde admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d26a10acbe749a6ae7d04a42a02392a)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:36.656065 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9000fc-dba1-45a3-8cb9-186d8f5b9bde admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:36.739143 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-3f9000fc-dba1-45a3-8cb9-186d8f5b9bde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d26a10acbe749a6ae7d04a42a02392a', 'request_id': 'req-3f9000fc-dba1-45a3-8cb9-186d8f5b9bde'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:36.742384 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:03:36.758385 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-3f9000fc-dba1-45a3-8cb9-186d8f5b9bde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d26a10acbe749a6ae7d04a42a02392a', 'request_id': 'req-3f9000fc-dba1-45a3-8cb9-186d8f5b9bde'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:36.767868 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-3f9000fc-dba1-45a3-8cb9-186d8f5b9bde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d26a10acbe749a6ae7d04a42a02392a', 'request_id': 'req-3f9000fc-dba1-45a3-8cb9-186d8f5b9bde'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:36.785504 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-3f9000fc-dba1-45a3-8cb9-186d8f5b9bde admin admin] The token cache is being invalidate because project 4d26a10acbe749a6ae7d04a42a02392a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:03:36.785504 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-3f9000fc-dba1-45a3-8cb9-186d8f5b9bde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:36.786499 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-3f9000fc-dba1-45a3-8cb9-186d8f5b9bde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:36.792641 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 983/1995] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:03:36 2022] DELETE /identity/v3/projects/4d26a10acbe749a6ae7d04a42a02392a => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:03:36.795155 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37142046-e6a3-4f43-b021-89145b9a6ad6 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:36.795290 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37142046-e6a3-4f43-b021-89145b9a6ad6 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:36.795494 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37142046-e6a3-4f43-b021-89145b9a6ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:36.823449 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-37142046-e6a3-4f43-b021-89145b9a6ad6 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:03:36.824792 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-37142046-e6a3-4f43-b021-89145b9a6ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:36.880850 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:03:36.901749 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1013/1996] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:03:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:03:36.911272 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a4092-5072-4587-a5b5-98d596b0092b None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:36.912745 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a4092-5072-4587-a5b5-98d596b0092b None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:36.913033 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a4092-5072-4587-a5b5-98d596b0092b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:36.938508 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-1f8a4092-5072-4587-a5b5-98d596b0092b None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:03:36.939862 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-1f8a4092-5072-4587-a5b5-98d596b0092b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:36.952804 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 984/1997] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:03:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:03:36.954100 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37142046-e6a3-4f43-b021-89145b9a6ad6 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:36.969738 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37142046-e6a3-4f43-b021-89145b9a6ad6 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:36.976144 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d65ee6e-586a-4a93-b497-c9e82b4120f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:36.976766 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d65ee6e-586a-4a93-b497-c9e82b4120f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:36.977039 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d65ee6e-586a-4a93-b497-c9e82b4120f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:36.977304 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d65ee6e-586a-4a93-b497-c9e82b4120f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:36.978049 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d65ee6e-586a-4a93-b497-c9e82b4120f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:03:36.978353 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d65ee6e-586a-4a93-b497-c9e82b4120f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:36.979967 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d65ee6e-586a-4a93-b497-c9e82b4120f2 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:36.994747 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1014/1998] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Aug 18 11:03:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:03:36.998933 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8a4092-5072-4587-a5b5-98d596b0092b None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:37.010118 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8a4092-5072-4587-a5b5-98d596b0092b None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:37.015070 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c7e7c7-de2e-40a4-9cb0-162ebddaa1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:37.015724 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c7e7c7-de2e-40a4-9cb0-162ebddaa1cb admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:37.016098 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c7e7c7-de2e-40a4-9cb0-162ebddaa1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:37.016397 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c7e7c7-de2e-40a4-9cb0-162ebddaa1cb admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:37.017100 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c7e7c7-de2e-40a4-9cb0-162ebddaa1cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:37.019037 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c7e7c7-de2e-40a4-9cb0-162ebddaa1cb admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:37.056964 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 985/1999] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:03:36 2022] POST /identity/v3/projects => generated 365 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:03:37.061292 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d65ee6e-586a-4a93-b497-c9e82b4120f2 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:37.072108 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d65ee6e-586a-4a93-b497-c9e82b4120f2 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:37.128343 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b332069c-55c4-470c-9ccb-bf42f98908a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:37.128950 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332069c-55c4-470c-9ccb-bf42f98908a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:37.129227 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332069c-55c4-470c-9ccb-bf42f98908a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:37.130101 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332069c-55c4-470c-9ccb-bf42f98908a7 admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:37.130917 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b332069c-55c4-470c-9ccb-bf42f98908a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:37.132766 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b332069c-55c4-470c-9ccb-bf42f98908a7 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:37.154689 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1015/2000] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:03:37 2022] POST /identity/v3/users => generated 283 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:03:37.158794 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c7e7c7-de2e-40a4-9cb0-162ebddaa1cb admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:37.171105 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c7e7c7-de2e-40a4-9cb0-162ebddaa1cb admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:37.175782 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd45bbf-cbdd-4e06-9a81-5828efc92a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:37.176977 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd45bbf-cbdd-4e06-9a81-5828efc92a52 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:37.177280 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd45bbf-cbdd-4e06-9a81-5828efc92a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:37.177691 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd45bbf-cbdd-4e06-9a81-5828efc92a52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:37.178590 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd45bbf-cbdd-4e06-9a81-5828efc92a52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:37.180191 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd45bbf-cbdd-4e06-9a81-5828efc92a52 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:37.190676 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 986/2001] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:03:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:03:37.195528 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b332069c-55c4-470c-9ccb-bf42f98908a7 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:37.205947 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b332069c-55c4-470c-9ccb-bf42f98908a7 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:37.211178 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ed5ad4-78c4-40e1-ac70-0bcd4d3b7bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:37.211373 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed5ad4-78c4-40e1-ac70-0bcd4d3b7bef admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:37.211655 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed5ad4-78c4-40e1-ac70-0bcd4d3b7bef admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:37.211935 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed5ad4-78c4-40e1-ac70-0bcd4d3b7bef admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:37.212586 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ed5ad4-78c4-40e1-ac70-0bcd4d3b7bef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:37.214235 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ed5ad4-78c4-40e1-ac70-0bcd4d3b7bef admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:37.230184 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1016/2002] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:03:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:03:37.234343 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd45bbf-cbdd-4e06-9a81-5828efc92a52 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:37.247957 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd45bbf-cbdd-4e06-9a81-5828efc92a52 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:37.253510 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1858b0-b9b7-4937-9ed7-33948fc06d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:37.255380 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1858b0-b9b7-4937-9ed7-33948fc06d7a admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:37.255380 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1858b0-b9b7-4937-9ed7-33948fc06d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:37.255572 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1858b0-b9b7-4937-9ed7-33948fc06d7a admin admin] PATH_INFO: `/v3/projects/7d1615baeffd4789bd598673857f23e4/users/bb285b35cf2647479b57a1bdf8b9b6b5/roles/719e5c62188d4f8a838987d6e72ca8f7` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:37.273680 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1858b0-b9b7-4937-9ed7-33948fc06d7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d1615baeffd4789bd598673857f23e4, user_id=bb285b35cf2647479b57a1bdf8b9b6b5, role_id=719e5c62188d4f8a838987d6e72ca8f7)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:37.278498 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1858b0-b9b7-4937-9ed7-33948fc06d7a admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:37.293683 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 987/2003] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:03:37 2022] PUT /identity/v3/projects/7d1615baeffd4789bd598673857f23e4/users/bb285b35cf2647479b57a1bdf8b9b6b5/roles/719e5c62188d4f8a838987d6e72ca8f7 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:03:37.304575 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1705ff71-55e5-45eb-85c7-11d5f16274d4 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:37.304938 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1705ff71-55e5-45eb-85c7-11d5f16274d4 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:37.305247 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1705ff71-55e5-45eb-85c7-11d5f16274d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:37.333571 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-1705ff71-55e5-45eb-85c7-11d5f16274d4 None None] MFA Rules not processed for user `bb285b35cf2647479b57a1bdf8b9b6b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:03:37.334801 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-1705ff71-55e5-45eb-85c7-11d5f16274d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:37.401022 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1017/2004] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:03:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:03:37.413576 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1858b0-b9b7-4937-9ed7-33948fc06d7a admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:37.415690 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-5c1858b0-b9b7-4937-9ed7-33948fc06d7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:37.495251 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1858b0-b9b7-4937-9ed7-33948fc06d7a admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:37.498956 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebab98d6-626c-43ba-9468-b0b8c0833344 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77211d2dcef242c4a7fe2198556d5efc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:37.499563 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab98d6-626c-43ba-9468-b0b8c0833344 service glance] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:37.499853 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab98d6-626c-43ba-9468-b0b8c0833344 service glance] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:37.500125 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab98d6-626c-43ba-9468-b0b8c0833344 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:37.508793 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebab98d6-626c-43ba-9468-b0b8c0833344 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:37.510238 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebab98d6-626c-43ba-9468-b0b8c0833344 service glance] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:37.518984 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 988/2005] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:03:37 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:03:38.922764 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4236e498-f3db-400b-b5eb-86e466414609 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:38.923457 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4236e498-f3db-400b-b5eb-86e466414609 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:38.923457 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4236e498-f3db-400b-b5eb-86e466414609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:38.944268 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-4236e498-f3db-400b-b5eb-86e466414609 None None] MFA Rules not processed for user `2ea5b4501d934e1bbfd6d46577d09e5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:03:38.945506 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-4236e498-f3db-400b-b5eb-86e466414609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:38.991936 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:03:39.012306 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1018/2006] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:03:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:03:47.514985 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:DELETE=3,keystone:SELECT=68,keystone:INSERT=2 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:03:49.004595 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=5 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:03:59.324399 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebab98d6-626c-43ba-9468-b0b8c0833344 service glance] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:59.325888 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-ebab98d6-626c-43ba-9468-b0b8c0833344 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:59.424038 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebab98d6-626c-43ba-9468-b0b8c0833344 service glance] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:59.429881 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5965ead2-91a8-49b6-9e6e-755b7ddcaa32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:59.430529 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5965ead2-91a8-49b6-9e6e-755b7ddcaa32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:59.430813 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5965ead2-91a8-49b6-9e6e-755b7ddcaa32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:59.431088 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5965ead2-91a8-49b6-9e6e-755b7ddcaa32 admin admin] PATH_INFO: `/v3/users/cd6c278e04a143afb345166552b0bc2e` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:59.432518 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5965ead2-91a8-49b6-9e6e-755b7ddcaa32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd6c278e04a143afb345166552b0bc2e)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:59.434523 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5965ead2-91a8-49b6-9e6e-755b7ddcaa32 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:59.532431 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-5965ead2-91a8-49b6-9e6e-755b7ddcaa32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd6c278e04a143afb345166552b0bc2e'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:59.542680 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-5965ead2-91a8-49b6-9e6e-755b7ddcaa32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd6c278e04a143afb345166552b0bc2e'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:59.543958 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-5965ead2-91a8-49b6-9e6e-755b7ddcaa32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd6c278e04a143afb345166552b0bc2e'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:59.544280 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-5965ead2-91a8-49b6-9e6e-755b7ddcaa32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd6c278e04a143afb345166552b0bc2e'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:59.553424 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-5965ead2-91a8-49b6-9e6e-755b7ddcaa32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd6c278e04a143afb345166552b0bc2e'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:03:59.572819 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 989/2007] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:03:59 2022] DELETE /identity/v3/users/cd6c278e04a143afb345166552b0bc2e => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:03:59.577862 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b49d2-c008-49d6-80e8-cb3f7a435eef None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:59.578409 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b49d2-c008-49d6-80e8-cb3f7a435eef None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:59.578717 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b49d2-c008-49d6-80e8-cb3f7a435eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:59.599051 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-088b49d2-c008-49d6-80e8-cb3f7a435eef None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:03:59.600592 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-088b49d2-c008-49d6-80e8-cb3f7a435eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:59.689836 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1019/2008] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:03:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:03:59.696990 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5965ead2-91a8-49b6-9e6e-755b7ddcaa32 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:03:59.698536 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-5965ead2-91a8-49b6-9e6e-755b7ddcaa32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:03:59.789875 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5965ead2-91a8-49b6-9e6e-755b7ddcaa32 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:03:59.795043 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c416189-0b1c-477b-a487-c541acdf5057 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:03:59.795735 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c416189-0b1c-477b-a487-c541acdf5057 service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:03:59.796014 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c416189-0b1c-477b-a487-c541acdf5057 service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:03:59.796294 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c416189-0b1c-477b-a487-c541acdf5057 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:03:59.806880 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c416189-0b1c-477b-a487-c541acdf5057 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:03:59.808009 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c416189-0b1c-477b-a487-c541acdf5057 service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:03:59.824937 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 990/2009] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:03:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:04:00.459228 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088b49d2-c008-49d6-80e8-cb3f7a435eef None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:00.460738 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-088b49d2-c008-49d6-80e8-cb3f7a435eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:00.487064 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088b49d2-c008-49d6-80e8-cb3f7a435eef None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:00.494311 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366eceeb-f3d9-43f9-bbec-d65dfedeb8b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:00.494960 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366eceeb-f3d9-43f9-bbec-d65dfedeb8b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:00.495307 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366eceeb-f3d9-43f9-bbec-d65dfedeb8b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:00.495698 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366eceeb-f3d9-43f9-bbec-d65dfedeb8b7 admin admin] PATH_INFO: `/v3/projects/8700aae079914c34a43725b5e670ebfe` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:00.497104 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366eceeb-f3d9-43f9-bbec-d65dfedeb8b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8700aae079914c34a43725b5e670ebfe)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:00.499224 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366eceeb-f3d9-43f9-bbec-d65dfedeb8b7 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:00.560048 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-366eceeb-f3d9-43f9-bbec-d65dfedeb8b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8700aae079914c34a43725b5e670ebfe', 'request_id': 'req-366eceeb-f3d9-43f9-bbec-d65dfedeb8b7'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:00.570555 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-366eceeb-f3d9-43f9-bbec-d65dfedeb8b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8700aae079914c34a43725b5e670ebfe', 'request_id': 'req-366eceeb-f3d9-43f9-bbec-d65dfedeb8b7'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:00.581577 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-366eceeb-f3d9-43f9-bbec-d65dfedeb8b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8700aae079914c34a43725b5e670ebfe', 'request_id': 'req-366eceeb-f3d9-43f9-bbec-d65dfedeb8b7'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:00.594604 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-366eceeb-f3d9-43f9-bbec-d65dfedeb8b7 admin admin] The token cache is being invalidate because project 8700aae079914c34a43725b5e670ebfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:04:00.595105 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-366eceeb-f3d9-43f9-bbec-d65dfedeb8b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:00.596078 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-366eceeb-f3d9-43f9-bbec-d65dfedeb8b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:00.597854 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1020/2010] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:04:00 2022] DELETE /identity/v3/projects/8700aae079914c34a43725b5e670ebfe => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:04:00.602277 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c416189-0b1c-477b-a487-c541acdf5057 service neutron] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:00.616530 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c416189-0b1c-477b-a487-c541acdf5057 service neutron] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:00.643426 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:04:00.695399 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55686140-536f-4ea1-be27-d95d342f5a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:00.696052 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55686140-536f-4ea1-be27-d95d342f5a02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:00.696330 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55686140-536f-4ea1-be27-d95d342f5a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:00.696603 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55686140-536f-4ea1-be27-d95d342f5a02 admin admin] PATH_INFO: `/v3/users/529389c59d394e7ba6c93a38e44546e3` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:00.697837 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55686140-536f-4ea1-be27-d95d342f5a02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=529389c59d394e7ba6c93a38e44546e3)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:00.699795 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55686140-536f-4ea1-be27-d95d342f5a02 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:00.757106 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-55686140-536f-4ea1-be27-d95d342f5a02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '529389c59d394e7ba6c93a38e44546e3'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:00.766499 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-55686140-536f-4ea1-be27-d95d342f5a02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '529389c59d394e7ba6c93a38e44546e3'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:00.767201 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-55686140-536f-4ea1-be27-d95d342f5a02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '529389c59d394e7ba6c93a38e44546e3'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:00.767854 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-55686140-536f-4ea1-be27-d95d342f5a02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '529389c59d394e7ba6c93a38e44546e3'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:00.776771 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-55686140-536f-4ea1-be27-d95d342f5a02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '529389c59d394e7ba6c93a38e44546e3'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:00.797105 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 991/2011] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:04:00 2022] DELETE /identity/v3/users/529389c59d394e7ba6c93a38e44546e3 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:04:01.109263 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366eceeb-f3d9-43f9-bbec-d65dfedeb8b7 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:01.112563 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-366eceeb-f3d9-43f9-bbec-d65dfedeb8b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:01.133223 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366eceeb-f3d9-43f9-bbec-d65dfedeb8b7 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:01.202210 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2564443-1e8d-4f75-bb1a-1612d53cf6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:01.202870 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2564443-1e8d-4f75-bb1a-1612d53cf6dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:01.203162 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2564443-1e8d-4f75-bb1a-1612d53cf6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:01.203499 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2564443-1e8d-4f75-bb1a-1612d53cf6dc admin admin] PATH_INFO: `/v3/projects/8448fdfc07cb4eb0aa3bbcf5d3311061` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:01.205277 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2564443-1e8d-4f75-bb1a-1612d53cf6dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=8448fdfc07cb4eb0aa3bbcf5d3311061)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:01.207798 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2564443-1e8d-4f75-bb1a-1612d53cf6dc admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:01.246186 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:04:01.273104 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-a2564443-1e8d-4f75-bb1a-1612d53cf6dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8448fdfc07cb4eb0aa3bbcf5d3311061', 'request_id': 'req-a2564443-1e8d-4f75-bb1a-1612d53cf6dc'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:01.278180 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-a2564443-1e8d-4f75-bb1a-1612d53cf6dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8448fdfc07cb4eb0aa3bbcf5d3311061', 'request_id': 'req-a2564443-1e8d-4f75-bb1a-1612d53cf6dc'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:01.285004 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-a2564443-1e8d-4f75-bb1a-1612d53cf6dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8448fdfc07cb4eb0aa3bbcf5d3311061', 'request_id': 'req-a2564443-1e8d-4f75-bb1a-1612d53cf6dc'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:01.297877 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-a2564443-1e8d-4f75-bb1a-1612d53cf6dc admin admin] The token cache is being invalidate because project 8448fdfc07cb4eb0aa3bbcf5d3311061 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:04:01.298219 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-a2564443-1e8d-4f75-bb1a-1612d53cf6dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:01.298879 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-a2564443-1e8d-4f75-bb1a-1612d53cf6dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:01.300411 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1021/2012] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:04:01 2022] DELETE /identity/v3/projects/8448fdfc07cb4eb0aa3bbcf5d3311061 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:04:01.305610 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da11aef-1e0e-415c-8710-47d234dc5845 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:01.305898 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da11aef-1e0e-415c-8710-47d234dc5845 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:01.306176 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da11aef-1e0e-415c-8710-47d234dc5845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:01.328067 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-8da11aef-1e0e-415c-8710-47d234dc5845 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:04:01.329301 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-8da11aef-1e0e-415c-8710-47d234dc5845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:01.398994 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 992/2013] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:04:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:04:01.406720 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6233a6b7-5143-42fd-b6b5-b26bdd1f0bf2 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:01.407005 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6233a6b7-5143-42fd-b6b5-b26bdd1f0bf2 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:01.407280 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6233a6b7-5143-42fd-b6b5-b26bdd1f0bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:01.427022 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-6233a6b7-5143-42fd-b6b5-b26bdd1f0bf2 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:04:01.428227 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-6233a6b7-5143-42fd-b6b5-b26bdd1f0bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:01.436157 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1022/2014] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:04:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:04:01.440477 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da11aef-1e0e-415c-8710-47d234dc5845 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:01.451808 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da11aef-1e0e-415c-8710-47d234dc5845 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:01.456398 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d6d620-22b4-4067-8d94-2931e06ef025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:01.457163 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d6d620-22b4-4067-8d94-2931e06ef025 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:01.457988 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d6d620-22b4-4067-8d94-2931e06ef025 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:01.458263 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d6d620-22b4-4067-8d94-2931e06ef025 admin admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:01.458937 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d6d620-22b4-4067-8d94-2931e06ef025 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:04:01.459241 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d6d620-22b4-4067-8d94-2931e06ef025 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:01.460833 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d6d620-22b4-4067-8d94-2931e06ef025 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:01.472675 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 993/2015] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Aug 18 11:04:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:04:01.476998 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6233a6b7-5143-42fd-b6b5-b26bdd1f0bf2 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:01.486647 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6233a6b7-5143-42fd-b6b5-b26bdd1f0bf2 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:01.491752 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7316627-0b67-4d2a-8717-451766720e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:01.492366 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7316627-0b67-4d2a-8717-451766720e6a admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:01.492646 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7316627-0b67-4d2a-8717-451766720e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:01.492925 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7316627-0b67-4d2a-8717-451766720e6a admin admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:01.493599 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7316627-0b67-4d2a-8717-451766720e6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:01.495650 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7316627-0b67-4d2a-8717-451766720e6a admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:01.527560 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1023/2016] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:04:01 2022] POST /identity/v3/projects => generated 367 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:04:01.532153 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d6d620-22b4-4067-8d94-2931e06ef025 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:01.544039 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d6d620-22b4-4067-8d94-2931e06ef025 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:01.572521 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:04:01.605973 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9397c71e-7ff2-4dd0-be22-5372623ffce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:01.606625 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9397c71e-7ff2-4dd0-be22-5372623ffce2 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:01.606759 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9397c71e-7ff2-4dd0-be22-5372623ffce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:01.607036 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9397c71e-7ff2-4dd0-be22-5372623ffce2 admin admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:01.607685 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9397c71e-7ff2-4dd0-be22-5372623ffce2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:01.609650 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9397c71e-7ff2-4dd0-be22-5372623ffce2 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:01.638184 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 994/2017] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:04:01 2022] POST /identity/v3/users => generated 284 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:04:01.639643 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7316627-0b67-4d2a-8717-451766720e6a admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:01.650619 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7316627-0b67-4d2a-8717-451766720e6a admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:01.655242 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe703421-52d6-405f-9e8d-a737304c8028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:01.655862 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe703421-52d6-405f-9e8d-a737304c8028 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:01.656140 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe703421-52d6-405f-9e8d-a737304c8028 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:01.656416 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe703421-52d6-405f-9e8d-a737304c8028 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:01.657067 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe703421-52d6-405f-9e8d-a737304c8028 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:01.658678 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe703421-52d6-405f-9e8d-a737304c8028 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:01.672618 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1024/2018] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:04:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:04:01.673891 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9397c71e-7ff2-4dd0-be22-5372623ffce2 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:01.684319 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9397c71e-7ff2-4dd0-be22-5372623ffce2 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:01.688929 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d836f5b-145b-409e-9792-2d22bef47483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:01.689597 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d836f5b-145b-409e-9792-2d22bef47483 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:01.689882 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d836f5b-145b-409e-9792-2d22bef47483 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:01.690185 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d836f5b-145b-409e-9792-2d22bef47483 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:01.690830 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d836f5b-145b-409e-9792-2d22bef47483 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:01.693112 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d836f5b-145b-409e-9792-2d22bef47483 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:01.703977 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 995/2019] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:04:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:04:01.709323 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe703421-52d6-405f-9e8d-a737304c8028 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:01.720004 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe703421-52d6-405f-9e8d-a737304c8028 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:01.725091 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d80224-115e-4895-bfea-92565c3efb43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:01.725796 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d80224-115e-4895-bfea-92565c3efb43 admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:01.726087 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d80224-115e-4895-bfea-92565c3efb43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:01.726395 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d80224-115e-4895-bfea-92565c3efb43 admin admin] PATH_INFO: `/v3/projects/f18e7720ffd14ed9adfffd8d69cf4c1f/users/58c5b4b8add640faa09a9361c9be6307/roles/719e5c62188d4f8a838987d6e72ca8f7` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:01.742964 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d80224-115e-4895-bfea-92565c3efb43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f18e7720ffd14ed9adfffd8d69cf4c1f, user_id=58c5b4b8add640faa09a9361c9be6307, role_id=719e5c62188d4f8a838987d6e72ca8f7)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:01.745640 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d80224-115e-4895-bfea-92565c3efb43 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:01.759842 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1025/2020] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:04:01 2022] PUT /identity/v3/projects/f18e7720ffd14ed9adfffd8d69cf4c1f/users/58c5b4b8add640faa09a9361c9be6307/roles/719e5c62188d4f8a838987d6e72ca8f7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:04:01.771454 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287aa58-05af-42cd-9b60-bdfdc8e85164 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:01.771764 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287aa58-05af-42cd-9b60-bdfdc8e85164 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:01.772054 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287aa58-05af-42cd-9b60-bdfdc8e85164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:01.802480 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-d287aa58-05af-42cd-9b60-bdfdc8e85164 None None] MFA Rules not processed for user `58c5b4b8add640faa09a9361c9be6307`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:04:01.803704 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-d287aa58-05af-42cd-9b60-bdfdc8e85164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:01.868550 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 996/2021] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:04:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:04:01.873054 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d80224-115e-4895-bfea-92565c3efb43 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:01.937747 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d80224-115e-4895-bfea-92565c3efb43 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:01.943593 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2557cee-a569-430d-a2dd-7c4445d037b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:01.944208 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2557cee-a569-430d-a2dd-7c4445d037b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:01.944489 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2557cee-a569-430d-a2dd-7c4445d037b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:01.944772 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2557cee-a569-430d-a2dd-7c4445d037b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:01.945403 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2557cee-a569-430d-a2dd-7c4445d037b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:01.947335 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2557cee-a569-430d-a2dd-7c4445d037b6 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:01.982679 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1026/2022] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:04:01 2022] POST /identity/v3/projects => generated 367 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:04:01.983787 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d287aa58-05af-42cd-9b60-bdfdc8e85164 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:01.995764 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d287aa58-05af-42cd-9b60-bdfdc8e85164 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:02.055311 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7dba24-f252-4c21-bdd7-d9580571f0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:02.055926 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7dba24-f252-4c21-bdd7-d9580571f0cc admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:02.056209 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7dba24-f252-4c21-bdd7-d9580571f0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:02.056485 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7dba24-f252-4c21-bdd7-d9580571f0cc admin admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:02.057126 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7dba24-f252-4c21-bdd7-d9580571f0cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:02.059090 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7dba24-f252-4c21-bdd7-d9580571f0cc admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:02.085169 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 997/2023] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:04:01 2022] POST /identity/v3/users => generated 290 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 11:04:02.086321 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2557cee-a569-430d-a2dd-7c4445d037b6 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:02.096874 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2557cee-a569-430d-a2dd-7c4445d037b6 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:02.102241 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b1b5d6-1c7a-4c99-b780-dc9744e2c4dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:02.102840 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b1b5d6-1c7a-4c99-b780-dc9744e2c4dc admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:02.103585 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b1b5d6-1c7a-4c99-b780-dc9744e2c4dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:02.103873 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b1b5d6-1c7a-4c99-b780-dc9744e2c4dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:02.104514 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b1b5d6-1c7a-4c99-b780-dc9744e2c4dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:02.106146 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b1b5d6-1c7a-4c99-b780-dc9744e2c4dc admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:02.118677 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1027/2024] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:04:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:04:02.122939 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7dba24-f252-4c21-bdd7-d9580571f0cc admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:02.133551 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7dba24-f252-4c21-bdd7-d9580571f0cc admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:02.138417 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31016b6-2850-4d1d-8684-4f55fa22a67c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:02.139115 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31016b6-2850-4d1d-8684-4f55fa22a67c admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:02.139405 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31016b6-2850-4d1d-8684-4f55fa22a67c admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:02.139683 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31016b6-2850-4d1d-8684-4f55fa22a67c admin admin] PATH_INFO: `/v3/projects/3375b38eca72464a9523ec3ee593d594/users/f19169b4c06948bf8865a6c2e2152a5f/roles/127fdc7ef05b4e0b98a940b334e5fcab` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:02.155614 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31016b6-2850-4d1d-8684-4f55fa22a67c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3375b38eca72464a9523ec3ee593d594, user_id=f19169b4c06948bf8865a6c2e2152a5f, role_id=127fdc7ef05b4e0b98a940b334e5fcab)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:02.158416 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31016b6-2850-4d1d-8684-4f55fa22a67c admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:02.172905 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 998/2025] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:04:02 2022] PUT /identity/v3/projects/3375b38eca72464a9523ec3ee593d594/users/f19169b4c06948bf8865a6c2e2152a5f/roles/127fdc7ef05b4e0b98a940b334e5fcab => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:04:02.177551 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b1b5d6-1c7a-4c99-b780-dc9744e2c4dc admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:02.188058 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b1b5d6-1c7a-4c99-b780-dc9744e2c4dc admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:02.211189 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:04:02.258182 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97efd9f3-e31c-4336-8ab6-31c12031c3fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:02.258798 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97efd9f3-e31c-4336-8ab6-31c12031c3fc admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:02.259084 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97efd9f3-e31c-4336-8ab6-31c12031c3fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:02.259358 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97efd9f3-e31c-4336-8ab6-31c12031c3fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:02.260005 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97efd9f3-e31c-4336-8ab6-31c12031c3fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:02.261666 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97efd9f3-e31c-4336-8ab6-31c12031c3fc admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:02.271543 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1028/2026] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:04:02 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:04:02.275730 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31016b6-2850-4d1d-8684-4f55fa22a67c admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:02.281544 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:04:02.288527 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31016b6-2850-4d1d-8684-4f55fa22a67c admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:02.293827 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbe2e97-fcd9-4779-a5e3-968d36391180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:02.294493 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe2e97-fcd9-4779-a5e3-968d36391180 admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:02.294771 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe2e97-fcd9-4779-a5e3-968d36391180 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:02.295042 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe2e97-fcd9-4779-a5e3-968d36391180 admin admin] PATH_INFO: `/v3/projects/3375b38eca72464a9523ec3ee593d594/users/f19169b4c06948bf8865a6c2e2152a5f/roles/127fdc7ef05b4e0b98a940b334e5fcab` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:02.297127 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbe2e97-fcd9-4779-a5e3-968d36391180 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3375b38eca72464a9523ec3ee593d594, user_id=f19169b4c06948bf8865a6c2e2152a5f, role_id=127fdc7ef05b4e0b98a940b334e5fcab)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:02.299915 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbe2e97-fcd9-4779-a5e3-968d36391180 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:02.320208 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 999/2027] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:04:02 2022] PUT /identity/v3/projects/3375b38eca72464a9523ec3ee593d594/users/f19169b4c06948bf8865a6c2e2152a5f/roles/127fdc7ef05b4e0b98a940b334e5fcab => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:04:02.322605 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d6eac-d737-4fdd-a775-31c8fe523083 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:02.323001 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d6eac-d737-4fdd-a775-31c8fe523083 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:02.323524 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d6eac-d737-4fdd-a775-31c8fe523083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:02.352470 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-322d6eac-d737-4fdd-a775-31c8fe523083 None None] MFA Rules not processed for user `f19169b4c06948bf8865a6c2e2152a5f`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:04:02.353720 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-322d6eac-d737-4fdd-a775-31c8fe523083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:02.424276 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1029/2028] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:04:02 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:04:02.435715 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbe2e97-fcd9-4779-a5e3-968d36391180 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:02.437588 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-efbe2e97-fcd9-4779-a5e3-968d36391180 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:02.498953 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbe2e97-fcd9-4779-a5e3-968d36391180 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:02.502647 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0723c2-b433-4cad-9899-bbb2600ef50c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b8a09704b9b4ab2bffb813796ec6e77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:02.503269 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0723c2-b433-4cad-9899-bbb2600ef50c service cinder] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:02.503572 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0723c2-b433-4cad-9899-bbb2600ef50c service cinder] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:02.503901 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0723c2-b433-4cad-9899-bbb2600ef50c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:02.514308 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0723c2-b433-4cad-9899-bbb2600ef50c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:02.516237 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0723c2-b433-4cad-9899-bbb2600ef50c service cinder] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:02.526250 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1000/2029] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:04:02 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:04:02.610451 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322d6eac-d737-4fdd-a775-31c8fe523083 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:02.621337 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322d6eac-d737-4fdd-a775-31c8fe523083 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:02.625125 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344d832c-d64f-4090-aba3-8b3fa9ab2a6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b8a09704b9b4ab2bffb813796ec6e77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:02.625768 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d832c-d64f-4090-aba3-8b3fa9ab2a6b service cinder] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:02.626053 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d832c-d64f-4090-aba3-8b3fa9ab2a6b service cinder] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:02.626331 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d832c-d64f-4090-aba3-8b3fa9ab2a6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:02.686143 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344d832c-d64f-4090-aba3-8b3fa9ab2a6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:02.687585 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344d832c-d64f-4090-aba3-8b3fa9ab2a6b service cinder] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:02.697177 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1030/2030] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:04:02 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:04:07.690113 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0723c2-b433-4cad-9899-bbb2600ef50c service cinder] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:07.691671 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-da0723c2-b433-4cad-9899-bbb2600ef50c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:07.775986 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0723c2-b433-4cad-9899-bbb2600ef50c service cinder] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:07.781099 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7de4b2-801a-4dc4-a229-86ab2175e722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:07.781882 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7de4b2-801a-4dc4-a229-86ab2175e722 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:07.782230 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7de4b2-801a-4dc4-a229-86ab2175e722 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:07.782522 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7de4b2-801a-4dc4-a229-86ab2175e722 admin admin] PATH_INFO: `/v3/users/e06c87f7a365459cb60dcdc1d43e95a6` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:07.783663 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7de4b2-801a-4dc4-a229-86ab2175e722 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e06c87f7a365459cb60dcdc1d43e95a6)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:07.787424 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7de4b2-801a-4dc4-a229-86ab2175e722 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:07.839313 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-bd7de4b2-801a-4dc4-a229-86ab2175e722 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e06c87f7a365459cb60dcdc1d43e95a6'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:07.850151 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-bd7de4b2-801a-4dc4-a229-86ab2175e722 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e06c87f7a365459cb60dcdc1d43e95a6'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:07.850784 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-bd7de4b2-801a-4dc4-a229-86ab2175e722 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e06c87f7a365459cb60dcdc1d43e95a6'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:07.851519 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-bd7de4b2-801a-4dc4-a229-86ab2175e722 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e06c87f7a365459cb60dcdc1d43e95a6'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:07.859128 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-bd7de4b2-801a-4dc4-a229-86ab2175e722 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e06c87f7a365459cb60dcdc1d43e95a6'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:07.879512 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1001/2031] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:04:07 2022] DELETE /identity/v3/users/e06c87f7a365459cb60dcdc1d43e95a6 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:04:07.884592 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34364f3-f10a-40d9-8175-a12e7fd341d9 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:07.885115 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34364f3-f10a-40d9-8175-a12e7fd341d9 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:07.885210 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34364f3-f10a-40d9-8175-a12e7fd341d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:07.908772 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-d34364f3-f10a-40d9-8175-a12e7fd341d9 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:04:07.912690 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-d34364f3-f10a-40d9-8175-a12e7fd341d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:07.954803 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:04:07.978374 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1031/2032] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:04:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:04:07.989899 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7de4b2-801a-4dc4-a229-86ab2175e722 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:07.991309 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-bd7de4b2-801a-4dc4-a229-86ab2175e722 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:08.005303 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:04:08.060674 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7de4b2-801a-4dc4-a229-86ab2175e722 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:08.064442 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d168993f-132b-41d1-9c34-731d669022d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:08.065070 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168993f-132b-41d1-9c34-731d669022d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:08.065961 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168993f-132b-41d1-9c34-731d669022d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:08.066814 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168993f-132b-41d1-9c34-731d669022d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:08.079289 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d168993f-132b-41d1-9c34-731d669022d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:08.080728 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d168993f-132b-41d1-9c34-731d669022d0 service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:08.104255 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1002/2033] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:04:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:04:08.444190 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34364f3-f10a-40d9-8175-a12e7fd341d9 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:08.446335 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-d34364f3-f10a-40d9-8175-a12e7fd341d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:08.460800 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34364f3-f10a-40d9-8175-a12e7fd341d9 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:08.465726 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18fbde8-2848-44da-96bb-4ac6a374b70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:08.466505 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18fbde8-2848-44da-96bb-4ac6a374b70f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:08.466747 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18fbde8-2848-44da-96bb-4ac6a374b70f admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:08.467018 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18fbde8-2848-44da-96bb-4ac6a374b70f admin admin] PATH_INFO: `/v3/projects/13230239cd5242fb894966aeef4b504e` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:08.468160 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18fbde8-2848-44da-96bb-4ac6a374b70f admin admin] RBAC: Authorizing `identity:delete_project(project_id=13230239cd5242fb894966aeef4b504e)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:08.470131 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18fbde8-2848-44da-96bb-4ac6a374b70f admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:08.517876 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-d18fbde8-2848-44da-96bb-4ac6a374b70f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13230239cd5242fb894966aeef4b504e', 'request_id': 'req-d18fbde8-2848-44da-96bb-4ac6a374b70f'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:08.526006 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-d18fbde8-2848-44da-96bb-4ac6a374b70f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13230239cd5242fb894966aeef4b504e', 'request_id': 'req-d18fbde8-2848-44da-96bb-4ac6a374b70f'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:08.532918 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-d18fbde8-2848-44da-96bb-4ac6a374b70f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13230239cd5242fb894966aeef4b504e', 'request_id': 'req-d18fbde8-2848-44da-96bb-4ac6a374b70f'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:08.544214 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-d18fbde8-2848-44da-96bb-4ac6a374b70f admin admin] The token cache is being invalidate because project 13230239cd5242fb894966aeef4b504e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:04:08.544503 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-d18fbde8-2848-44da-96bb-4ac6a374b70f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:08.545149 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-d18fbde8-2848-44da-96bb-4ac6a374b70f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:08.546692 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1032/2034] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:04:08 2022] DELETE /identity/v3/projects/13230239cd5242fb894966aeef4b504e => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:04:08.551822 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d168993f-132b-41d1-9c34-731d669022d0 service neutron] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:08.561961 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d168993f-132b-41d1-9c34-731d669022d0 service neutron] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:08.627097 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48a534a-169f-4a13-b229-18d737380c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:08.627758 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a534a-169f-4a13-b229-18d737380c4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:08.628036 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a534a-169f-4a13-b229-18d737380c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:08.628307 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a534a-169f-4a13-b229-18d737380c4c admin admin] PATH_INFO: `/v3/users/908710b11a8a4bcfaab31efc1de62765` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:08.630115 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48a534a-169f-4a13-b229-18d737380c4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=908710b11a8a4bcfaab31efc1de62765)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:08.632032 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48a534a-169f-4a13-b229-18d737380c4c admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:08.679036 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-f48a534a-169f-4a13-b229-18d737380c4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '908710b11a8a4bcfaab31efc1de62765'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:08.687087 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-f48a534a-169f-4a13-b229-18d737380c4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '908710b11a8a4bcfaab31efc1de62765'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:08.687769 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-f48a534a-169f-4a13-b229-18d737380c4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '908710b11a8a4bcfaab31efc1de62765'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:08.688387 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-f48a534a-169f-4a13-b229-18d737380c4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '908710b11a8a4bcfaab31efc1de62765'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:08.696192 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-f48a534a-169f-4a13-b229-18d737380c4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '908710b11a8a4bcfaab31efc1de62765'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:08.713251 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1003/2035] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:04:08 2022] DELETE /identity/v3/users/908710b11a8a4bcfaab31efc1de62765 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:04:09.250308 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18fbde8-2848-44da-96bb-4ac6a374b70f admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:09.252281 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-d18fbde8-2848-44da-96bb-4ac6a374b70f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:09.266600 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18fbde8-2848-44da-96bb-4ac6a374b70f admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:09.359891 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9409976e-d0db-43a6-a7a7-5e479c78511b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:09.360530 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9409976e-d0db-43a6-a7a7-5e479c78511b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:09.360814 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9409976e-d0db-43a6-a7a7-5e479c78511b admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:09.361790 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9409976e-d0db-43a6-a7a7-5e479c78511b admin admin] PATH_INFO: `/v3/projects/528a7d0bb8584967b7bde6b3297507a8` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:09.362438 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9409976e-d0db-43a6-a7a7-5e479c78511b admin admin] RBAC: Authorizing `identity:delete_project(project_id=528a7d0bb8584967b7bde6b3297507a8)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:09.365412 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9409976e-d0db-43a6-a7a7-5e479c78511b admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:09.418366 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-9409976e-d0db-43a6-a7a7-5e479c78511b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '528a7d0bb8584967b7bde6b3297507a8', 'request_id': 'req-9409976e-d0db-43a6-a7a7-5e479c78511b'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:09.427743 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-9409976e-d0db-43a6-a7a7-5e479c78511b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '528a7d0bb8584967b7bde6b3297507a8', 'request_id': 'req-9409976e-d0db-43a6-a7a7-5e479c78511b'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:09.434207 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-9409976e-d0db-43a6-a7a7-5e479c78511b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '528a7d0bb8584967b7bde6b3297507a8', 'request_id': 'req-9409976e-d0db-43a6-a7a7-5e479c78511b'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:09.440519 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:04:09.447815 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-9409976e-d0db-43a6-a7a7-5e479c78511b admin admin] The token cache is being invalidate because project 528a7d0bb8584967b7bde6b3297507a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:04:09.448117 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-9409976e-d0db-43a6-a7a7-5e479c78511b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:09.449288 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-9409976e-d0db-43a6-a7a7-5e479c78511b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:09.451034 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1033/2036] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:04:09 2022] DELETE /identity/v3/projects/528a7d0bb8584967b7bde6b3297507a8 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:04:09.455929 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3e9daf-b992-4dd2-920b-049ddec5efd6 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:09.456219 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3e9daf-b992-4dd2-920b-049ddec5efd6 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:09.456498 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3e9daf-b992-4dd2-920b-049ddec5efd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:09.476137 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-8e3e9daf-b992-4dd2-920b-049ddec5efd6 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:04:09.477343 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-8e3e9daf-b992-4dd2-920b-049ddec5efd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:09.508930 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:04:09.541003 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1004/2037] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:04:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:04:09.548966 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7426230f-cd2c-47ea-a2b8-a15bf3ccde08 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:09.549248 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7426230f-cd2c-47ea-a2b8-a15bf3ccde08 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:09.549583 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7426230f-cd2c-47ea-a2b8-a15bf3ccde08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:09.569955 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-7426230f-cd2c-47ea-a2b8-a15bf3ccde08 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:04:09.571152 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-7426230f-cd2c-47ea-a2b8-a15bf3ccde08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:09.578945 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1034/2038] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:04:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:04:09.583351 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3e9daf-b992-4dd2-920b-049ddec5efd6 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:09.593230 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3e9daf-b992-4dd2-920b-049ddec5efd6 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:09.598427 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f35a999-365c-4d43-a14a-60bde640a987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:09.599195 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35a999-365c-4d43-a14a-60bde640a987 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:09.599474 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35a999-365c-4d43-a14a-60bde640a987 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:09.599746 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35a999-365c-4d43-a14a-60bde640a987 admin admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:09.600396 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f35a999-365c-4d43-a14a-60bde640a987 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:04:09.600694 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f35a999-365c-4d43-a14a-60bde640a987 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:09.602325 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f35a999-365c-4d43-a14a-60bde640a987 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:09.614919 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1005/2039] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Aug 18 11:04:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:04:09.619284 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7426230f-cd2c-47ea-a2b8-a15bf3ccde08 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:09.628458 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7426230f-cd2c-47ea-a2b8-a15bf3ccde08 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:09.633269 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0339b9-37f1-421d-a5f1-ca3b9024ad5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:09.633979 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0339b9-37f1-421d-a5f1-ca3b9024ad5b admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:09.634257 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0339b9-37f1-421d-a5f1-ca3b9024ad5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:09.634525 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0339b9-37f1-421d-a5f1-ca3b9024ad5b admin admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:09.635141 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0339b9-37f1-421d-a5f1-ca3b9024ad5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:09.637031 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0339b9-37f1-421d-a5f1-ca3b9024ad5b admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:09.668388 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1035/2040] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:04:09 2022] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:04:09.674479 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f35a999-365c-4d43-a14a-60bde640a987 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:09.685605 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f35a999-365c-4d43-a14a-60bde640a987 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:09.744363 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00049aec-8684-459e-ba60-1615aa2e32d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:09.744998 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00049aec-8684-459e-ba60-1615aa2e32d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:09.745263 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00049aec-8684-459e-ba60-1615aa2e32d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:09.745559 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00049aec-8684-459e-ba60-1615aa2e32d8 admin admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:09.746181 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00049aec-8684-459e-ba60-1615aa2e32d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:09.748128 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00049aec-8684-459e-ba60-1615aa2e32d8 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:09.769034 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1006/2041] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:04:09 2022] POST /identity/v3/users => generated 283 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:04:09.773456 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0339b9-37f1-421d-a5f1-ca3b9024ad5b admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:09.783692 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0339b9-37f1-421d-a5f1-ca3b9024ad5b admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:09.789186 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204380f5-4e3a-4aae-b6e0-bca006620616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:09.790126 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204380f5-4e3a-4aae-b6e0-bca006620616 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:09.790432 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204380f5-4e3a-4aae-b6e0-bca006620616 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:09.790711 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204380f5-4e3a-4aae-b6e0-bca006620616 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:09.791354 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204380f5-4e3a-4aae-b6e0-bca006620616 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:09.792956 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204380f5-4e3a-4aae-b6e0-bca006620616 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:09.803739 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1036/2042] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:04:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:04:09.807808 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00049aec-8684-459e-ba60-1615aa2e32d8 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:09.818002 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00049aec-8684-459e-ba60-1615aa2e32d8 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:09.822739 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f65d2-df8b-4c7f-b5a5-4e1a20c96118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:09.823246 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f65d2-df8b-4c7f-b5a5-4e1a20c96118 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:09.823523 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f65d2-df8b-4c7f-b5a5-4e1a20c96118 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:09.823795 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f65d2-df8b-4c7f-b5a5-4e1a20c96118 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:09.824445 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13f65d2-df8b-4c7f-b5a5-4e1a20c96118 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:09.826073 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13f65d2-df8b-4c7f-b5a5-4e1a20c96118 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:09.841087 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1007/2043] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:04:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:04:09.842497 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204380f5-4e3a-4aae-b6e0-bca006620616 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:09.853078 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204380f5-4e3a-4aae-b6e0-bca006620616 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:09.858763 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a92f925-21e2-4d89-b72c-e0c69438cd7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:09.859752 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a92f925-21e2-4d89-b72c-e0c69438cd7e admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:09.860190 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a92f925-21e2-4d89-b72c-e0c69438cd7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:09.860521 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a92f925-21e2-4d89-b72c-e0c69438cd7e admin admin] PATH_INFO: `/v3/projects/9261e546e2824f51984bf4a7475b4c0e/users/b73926813b024c2a8f98538377bfbb27/roles/719e5c62188d4f8a838987d6e72ca8f7` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:09.876165 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a92f925-21e2-4d89-b72c-e0c69438cd7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9261e546e2824f51984bf4a7475b4c0e, user_id=b73926813b024c2a8f98538377bfbb27, role_id=719e5c62188d4f8a838987d6e72ca8f7)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:09.879069 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a92f925-21e2-4d89-b72c-e0c69438cd7e admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:09.891397 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1037/2044] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:04:09 2022] PUT /identity/v3/projects/9261e546e2824f51984bf4a7475b4c0e/users/b73926813b024c2a8f98538377bfbb27/roles/719e5c62188d4f8a838987d6e72ca8f7 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:04:09.902234 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c41d56-7d85-43da-8722-36cc7c25420b None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:09.902667 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c41d56-7d85-43da-8722-36cc7c25420b None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:09.902947 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c41d56-7d85-43da-8722-36cc7c25420b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:09.931989 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-a2c41d56-7d85-43da-8722-36cc7c25420b None None] MFA Rules not processed for user `b73926813b024c2a8f98538377bfbb27`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:04:09.933224 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-a2c41d56-7d85-43da-8722-36cc7c25420b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:09.999020 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1008/2045] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:04:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:04:10.003195 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a92f925-21e2-4d89-b72c-e0c69438cd7e admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:10.077932 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a92f925-21e2-4d89-b72c-e0c69438cd7e admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:10.083182 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaf7ea0-9151-4b0f-8bf8-4971b4d42862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:10.083898 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaf7ea0-9151-4b0f-8bf8-4971b4d42862 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:10.084181 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaf7ea0-9151-4b0f-8bf8-4971b4d42862 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:10.084457 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaf7ea0-9151-4b0f-8bf8-4971b4d42862 admin admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:10.085091 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaf7ea0-9151-4b0f-8bf8-4971b4d42862 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:10.087080 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaf7ea0-9151-4b0f-8bf8-4971b4d42862 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:10.116194 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1038/2046] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:04:10 2022] POST /identity/v3/projects => generated 365 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:04:10.120434 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c41d56-7d85-43da-8722-36cc7c25420b None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:10.132021 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c41d56-7d85-43da-8722-36cc7c25420b None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:10.161606 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:04:10.196796 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460e1e1c-01fa-4311-acea-3fcef4d3b689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:10.197475 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e1e1c-01fa-4311-acea-3fcef4d3b689 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:10.197789 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e1e1c-01fa-4311-acea-3fcef4d3b689 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:10.198062 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e1e1c-01fa-4311-acea-3fcef4d3b689 admin admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:10.198698 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460e1e1c-01fa-4311-acea-3fcef4d3b689 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:10.200677 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460e1e1c-01fa-4311-acea-3fcef4d3b689 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:10.225882 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1009/2047] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:04:10 2022] POST /identity/v3/users => generated 289 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:04:10.230187 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaf7ea0-9151-4b0f-8bf8-4971b4d42862 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:10.243056 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaf7ea0-9151-4b0f-8bf8-4971b4d42862 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:10.248065 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d02c5-8bc7-432c-b3ae-c35ff4d37c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:10.248780 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d02c5-8bc7-432c-b3ae-c35ff4d37c82 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:10.249121 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d02c5-8bc7-432c-b3ae-c35ff4d37c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:10.249399 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d02c5-8bc7-432c-b3ae-c35ff4d37c82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:10.250167 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7d02c5-8bc7-432c-b3ae-c35ff4d37c82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:10.251907 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7d02c5-8bc7-432c-b3ae-c35ff4d37c82 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:10.263449 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1039/2048] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:04:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:04:10.267794 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460e1e1c-01fa-4311-acea-3fcef4d3b689 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:10.278653 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460e1e1c-01fa-4311-acea-3fcef4d3b689 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:10.283882 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c41d597-4b9c-4546-a76e-288aeb437da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:10.284549 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c41d597-4b9c-4546-a76e-288aeb437da7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:10.284830 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c41d597-4b9c-4546-a76e-288aeb437da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:10.286328 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c41d597-4b9c-4546-a76e-288aeb437da7 admin admin] PATH_INFO: `/v3/projects/2cbb7614006740c2ab8c4efb83a902fb/users/d12f054fa6974f6ebda5f04d1c065fe7/roles/127fdc7ef05b4e0b98a940b334e5fcab` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:10.302851 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c41d597-4b9c-4546-a76e-288aeb437da7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cbb7614006740c2ab8c4efb83a902fb, user_id=d12f054fa6974f6ebda5f04d1c065fe7, role_id=127fdc7ef05b4e0b98a940b334e5fcab)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:10.305577 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c41d597-4b9c-4546-a76e-288aeb437da7 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:10.320525 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1010/2049] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:04:10 2022] PUT /identity/v3/projects/2cbb7614006740c2ab8c4efb83a902fb/users/d12f054fa6974f6ebda5f04d1c065fe7/roles/127fdc7ef05b4e0b98a940b334e5fcab => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:04:10.324625 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d02c5-8bc7-432c-b3ae-c35ff4d37c82 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:10.337291 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d02c5-8bc7-432c-b3ae-c35ff4d37c82 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:10.461405 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803b3b73-e11b-4b64-a884-7e5aed755c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:10.462178 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b3b73-e11b-4b64-a884-7e5aed755c8c admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:10.462534 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b3b73-e11b-4b64-a884-7e5aed755c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:10.463611 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b3b73-e11b-4b64-a884-7e5aed755c8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:10.464365 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803b3b73-e11b-4b64-a884-7e5aed755c8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:10.468306 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803b3b73-e11b-4b64-a884-7e5aed755c8c admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:10.492498 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1040/2050] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:04:10 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 11:04:10.497353 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c41d597-4b9c-4546-a76e-288aeb437da7 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:10.512018 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c41d597-4b9c-4546-a76e-288aeb437da7 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:10.523895 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04645dd-a00c-48a2-8c01-b2a3af3329d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:10.524965 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04645dd-a00c-48a2-8c01-b2a3af3329d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:10.525576 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04645dd-a00c-48a2-8c01-b2a3af3329d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:10.526011 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04645dd-a00c-48a2-8c01-b2a3af3329d1 admin admin] PATH_INFO: `/v3/projects/2cbb7614006740c2ab8c4efb83a902fb/users/d12f054fa6974f6ebda5f04d1c065fe7/roles/127fdc7ef05b4e0b98a940b334e5fcab` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:10.528205 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04645dd-a00c-48a2-8c01-b2a3af3329d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cbb7614006740c2ab8c4efb83a902fb, user_id=d12f054fa6974f6ebda5f04d1c065fe7, role_id=127fdc7ef05b4e0b98a940b334e5fcab)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:10.533631 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04645dd-a00c-48a2-8c01-b2a3af3329d1 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:10.548523 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1011/2051] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:04:10 2022] PUT /identity/v3/projects/2cbb7614006740c2ab8c4efb83a902fb/users/d12f054fa6974f6ebda5f04d1c065fe7/roles/127fdc7ef05b4e0b98a940b334e5fcab => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:04:10.561421 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af1a6d7-6240-44dc-8abc-f8f0660f5b44 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:10.562272 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af1a6d7-6240-44dc-8abc-f8f0660f5b44 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:10.562528 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af1a6d7-6240-44dc-8abc-f8f0660f5b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:10.588418 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:04:10.618522 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-8af1a6d7-6240-44dc-8abc-f8f0660f5b44 None None] MFA Rules not processed for user `d12f054fa6974f6ebda5f04d1c065fe7`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:04:10.619806 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-8af1a6d7-6240-44dc-8abc-f8f0660f5b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:10.698871 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1041/2052] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:04:10 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:04:10.711996 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04645dd-a00c-48a2-8c01-b2a3af3329d1 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:10.713751 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-d04645dd-a00c-48a2-8c01-b2a3af3329d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:10.777250 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04645dd-a00c-48a2-8c01-b2a3af3329d1 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:10.781007 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8e7d77-914b-4fc4-b7ba-c56492392d56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b8a09704b9b4ab2bffb813796ec6e77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:10.781655 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e7d77-914b-4fc4-b7ba-c56492392d56 service cinder] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:10.781934 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e7d77-914b-4fc4-b7ba-c56492392d56 service cinder] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:10.782209 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e7d77-914b-4fc4-b7ba-c56492392d56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:10.794179 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8e7d77-914b-4fc4-b7ba-c56492392d56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:10.795973 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8e7d77-914b-4fc4-b7ba-c56492392d56 service cinder] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:10.806962 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1012/2053] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:04:10 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:04:10.885037 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af1a6d7-6240-44dc-8abc-f8f0660f5b44 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:10.895529 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af1a6d7-6240-44dc-8abc-f8f0660f5b44 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:10.899262 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e4637a-13ba-40bd-a180-fd2f39de67f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b8a09704b9b4ab2bffb813796ec6e77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:10.899864 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e4637a-13ba-40bd-a180-fd2f39de67f5 service cinder] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:10.900137 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e4637a-13ba-40bd-a180-fd2f39de67f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:10.900406 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e4637a-13ba-40bd-a180-fd2f39de67f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:10.960062 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e4637a-13ba-40bd-a180-fd2f39de67f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:10.961581 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e4637a-13ba-40bd-a180-fd2f39de67f5 service cinder] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:10.970869 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1042/2054] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:04:10 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:04:13.002983 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8e7d77-914b-4fc4-b7ba-c56492392d56 service cinder] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:13.005212 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-ba8e7d77-914b-4fc4-b7ba-c56492392d56 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:13.082671 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8e7d77-914b-4fc4-b7ba-c56492392d56 service cinder] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:13.091850 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607caba2-e6fb-4a61-ad81-0514c80f3902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:13.092962 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607caba2-e6fb-4a61-ad81-0514c80f3902 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:13.093424 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607caba2-e6fb-4a61-ad81-0514c80f3902 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:13.093991 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607caba2-e6fb-4a61-ad81-0514c80f3902 admin admin] PATH_INFO: `/v3/users/58c5b4b8add640faa09a9361c9be6307` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:13.095550 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607caba2-e6fb-4a61-ad81-0514c80f3902 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58c5b4b8add640faa09a9361c9be6307)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:13.098027 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607caba2-e6fb-4a61-ad81-0514c80f3902 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:13.133955 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:04:13.156677 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-607caba2-e6fb-4a61-ad81-0514c80f3902 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58c5b4b8add640faa09a9361c9be6307'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:13.165067 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-607caba2-e6fb-4a61-ad81-0514c80f3902 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58c5b4b8add640faa09a9361c9be6307'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:13.165923 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-607caba2-e6fb-4a61-ad81-0514c80f3902 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58c5b4b8add640faa09a9361c9be6307'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:13.166594 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-607caba2-e6fb-4a61-ad81-0514c80f3902 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58c5b4b8add640faa09a9361c9be6307'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:13.173938 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-607caba2-e6fb-4a61-ad81-0514c80f3902 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58c5b4b8add640faa09a9361c9be6307'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:13.193090 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1013/2055] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:04:13 2022] DELETE /identity/v3/users/58c5b4b8add640faa09a9361c9be6307 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:04:13.197719 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89676e78-7f40-45f6-99ff-e4332292f484 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:13.198175 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89676e78-7f40-45f6-99ff-e4332292f484 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:13.198266 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89676e78-7f40-45f6-99ff-e4332292f484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:13.217779 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-89676e78-7f40-45f6-99ff-e4332292f484 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:04:13.219000 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-89676e78-7f40-45f6-99ff-e4332292f484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:13.281772 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1043/2056] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:04:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:04:13.292277 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607caba2-e6fb-4a61-ad81-0514c80f3902 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:13.293781 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-607caba2-e6fb-4a61-ad81-0514c80f3902 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:13.352001 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607caba2-e6fb-4a61-ad81-0514c80f3902 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:13.355776 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dd3cc6-1f2b-45f1-a4b0-a3bccb47e7aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:13.356381 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dd3cc6-1f2b-45f1-a4b0-a3bccb47e7aa service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:13.356657 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dd3cc6-1f2b-45f1-a4b0-a3bccb47e7aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:13.356929 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dd3cc6-1f2b-45f1-a4b0-a3bccb47e7aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:13.366877 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dd3cc6-1f2b-45f1-a4b0-a3bccb47e7aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:13.368334 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dd3cc6-1f2b-45f1-a4b0-a3bccb47e7aa service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:13.378322 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1014/2057] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:04:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:04:13.767149 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89676e78-7f40-45f6-99ff-e4332292f484 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:13.770243 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-89676e78-7f40-45f6-99ff-e4332292f484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:13.802149 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89676e78-7f40-45f6-99ff-e4332292f484 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:13.821501 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd9eda3-329b-4a7b-925d-c4ba0c241c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:13.822135 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd9eda3-329b-4a7b-925d-c4ba0c241c4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:13.822617 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd9eda3-329b-4a7b-925d-c4ba0c241c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:13.823062 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd9eda3-329b-4a7b-925d-c4ba0c241c4f admin admin] PATH_INFO: `/v3/projects/f18e7720ffd14ed9adfffd8d69cf4c1f` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:13.824261 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd9eda3-329b-4a7b-925d-c4ba0c241c4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f18e7720ffd14ed9adfffd8d69cf4c1f)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:13.827964 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd9eda3-329b-4a7b-925d-c4ba0c241c4f admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:13.865230 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:04:13.893272 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-7cd9eda3-329b-4a7b-925d-c4ba0c241c4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f18e7720ffd14ed9adfffd8d69cf4c1f', 'request_id': 'req-7cd9eda3-329b-4a7b-925d-c4ba0c241c4f'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:13.909693 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-7cd9eda3-329b-4a7b-925d-c4ba0c241c4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f18e7720ffd14ed9adfffd8d69cf4c1f', 'request_id': 'req-7cd9eda3-329b-4a7b-925d-c4ba0c241c4f'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:13.917285 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-7cd9eda3-329b-4a7b-925d-c4ba0c241c4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f18e7720ffd14ed9adfffd8d69cf4c1f', 'request_id': 'req-7cd9eda3-329b-4a7b-925d-c4ba0c241c4f'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:13.935927 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-7cd9eda3-329b-4a7b-925d-c4ba0c241c4f admin admin] The token cache is being invalidate because project f18e7720ffd14ed9adfffd8d69cf4c1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:04:13.937191 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-7cd9eda3-329b-4a7b-925d-c4ba0c241c4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:13.938153 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-7cd9eda3-329b-4a7b-925d-c4ba0c241c4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:13.941826 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1044/2058] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:04:13 2022] DELETE /identity/v3/projects/f18e7720ffd14ed9adfffd8d69cf4c1f => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:04:13.944431 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dd3cc6-1f2b-45f1-a4b0-a3bccb47e7aa service neutron] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:13.954308 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dd3cc6-1f2b-45f1-a4b0-a3bccb47e7aa service neutron] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:14.018701 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4375c677-91a8-43fc-ba0f-dc415d606351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:14.019642 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4375c677-91a8-43fc-ba0f-dc415d606351 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:14.019890 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4375c677-91a8-43fc-ba0f-dc415d606351 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:14.020285 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4375c677-91a8-43fc-ba0f-dc415d606351 admin admin] PATH_INFO: `/v3/users/f19169b4c06948bf8865a6c2e2152a5f` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:14.021571 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4375c677-91a8-43fc-ba0f-dc415d606351 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f19169b4c06948bf8865a6c2e2152a5f)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:14.023725 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4375c677-91a8-43fc-ba0f-dc415d606351 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:14.081415 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-4375c677-91a8-43fc-ba0f-dc415d606351 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f19169b4c06948bf8865a6c2e2152a5f'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:14.083791 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:04:14.093599 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-4375c677-91a8-43fc-ba0f-dc415d606351 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f19169b4c06948bf8865a6c2e2152a5f'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:14.094786 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-4375c677-91a8-43fc-ba0f-dc415d606351 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f19169b4c06948bf8865a6c2e2152a5f'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:14.095617 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-4375c677-91a8-43fc-ba0f-dc415d606351 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f19169b4c06948bf8865a6c2e2152a5f'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:14.108445 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-4375c677-91a8-43fc-ba0f-dc415d606351 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f19169b4c06948bf8865a6c2e2152a5f'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:14.148286 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1015/2059] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:04:13 2022] DELETE /identity/v3/users/f19169b4c06948bf8865a6c2e2152a5f => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:04:14.514654 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd9eda3-329b-4a7b-925d-c4ba0c241c4f admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:14.516105 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-7cd9eda3-329b-4a7b-925d-c4ba0c241c4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:14.529986 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd9eda3-329b-4a7b-925d-c4ba0c241c4f admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:14.590021 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0085eb4-3eef-45d2-b9da-b75b282ef4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:14.590573 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0085eb4-3eef-45d2-b9da-b75b282ef4ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:14.590860 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0085eb4-3eef-45d2-b9da-b75b282ef4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:14.591130 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0085eb4-3eef-45d2-b9da-b75b282ef4ea admin admin] PATH_INFO: `/v3/projects/3375b38eca72464a9523ec3ee593d594` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:14.592240 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0085eb4-3eef-45d2-b9da-b75b282ef4ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=3375b38eca72464a9523ec3ee593d594)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:14.594171 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0085eb4-3eef-45d2-b9da-b75b282ef4ea admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:14.645635 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-b0085eb4-3eef-45d2-b9da-b75b282ef4ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3375b38eca72464a9523ec3ee593d594', 'request_id': 'req-b0085eb4-3eef-45d2-b9da-b75b282ef4ea'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:14.654356 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-b0085eb4-3eef-45d2-b9da-b75b282ef4ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3375b38eca72464a9523ec3ee593d594', 'request_id': 'req-b0085eb4-3eef-45d2-b9da-b75b282ef4ea'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:14.661884 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-b0085eb4-3eef-45d2-b9da-b75b282ef4ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3375b38eca72464a9523ec3ee593d594', 'request_id': 'req-b0085eb4-3eef-45d2-b9da-b75b282ef4ea'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:14.673740 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-b0085eb4-3eef-45d2-b9da-b75b282ef4ea admin admin] The token cache is being invalidate because project 3375b38eca72464a9523ec3ee593d594 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:04:14.674029 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-b0085eb4-3eef-45d2-b9da-b75b282ef4ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:14.674678 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-b0085eb4-3eef-45d2-b9da-b75b282ef4ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:14.676514 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1045/2060] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:04:14 2022] DELETE /identity/v3/projects/3375b38eca72464a9523ec3ee593d594 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:04:14.681365 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462802d2-0971-4a3c-a8c5-2456b0ea585f None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:14.681684 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462802d2-0971-4a3c-a8c5-2456b0ea585f None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:14.681963 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462802d2-0971-4a3c-a8c5-2456b0ea585f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:14.701217 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-462802d2-0971-4a3c-a8c5-2456b0ea585f None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:04:14.702422 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-462802d2-0971-4a3c-a8c5-2456b0ea585f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:14.763042 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1016/2061] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:04:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:04:14.773982 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfceeb0-b509-40c5-b9bb-64599318d2ce None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:14.774537 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfceeb0-b509-40c5-b9bb-64599318d2ce None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:14.775829 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfceeb0-b509-40c5-b9bb-64599318d2ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:14.798210 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-edfceeb0-b509-40c5-b9bb-64599318d2ce None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:04:14.799443 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-edfceeb0-b509-40c5-b9bb-64599318d2ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:14.807383 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1046/2062] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:04:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:04:14.811791 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462802d2-0971-4a3c-a8c5-2456b0ea585f None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:14.822967 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462802d2-0971-4a3c-a8c5-2456b0ea585f None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:14.827549 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9a7944-48b2-442d-a813-037f4514885f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:14.828159 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a7944-48b2-442d-a813-037f4514885f admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:14.828441 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a7944-48b2-442d-a813-037f4514885f admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:14.828717 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a7944-48b2-442d-a813-037f4514885f admin admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:14.829364 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9a7944-48b2-442d-a813-037f4514885f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:04:14.829706 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9a7944-48b2-442d-a813-037f4514885f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:14.831317 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9a7944-48b2-442d-a813-037f4514885f admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:14.844455 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1017/2063] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Aug 18 11:04:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:04:14.848989 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfceeb0-b509-40c5-b9bb-64599318d2ce None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:14.858359 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfceeb0-b509-40c5-b9bb-64599318d2ce None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:14.863197 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781defd5-c4f8-4df5-a821-a9f0ea376fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:14.864158 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781defd5-c4f8-4df5-a821-a9f0ea376fd9 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:14.864608 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781defd5-c4f8-4df5-a821-a9f0ea376fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:14.865135 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781defd5-c4f8-4df5-a821-a9f0ea376fd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:14.866281 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781defd5-c4f8-4df5-a821-a9f0ea376fd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:14.868590 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781defd5-c4f8-4df5-a821-a9f0ea376fd9 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:14.911260 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1047/2064] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:04:14 2022] POST /identity/v3/projects => generated 371 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:04:14.912516 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9a7944-48b2-442d-a813-037f4514885f admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:14.925795 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9a7944-48b2-442d-a813-037f4514885f admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:15.009213 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f547b112-bc6e-41c1-a849-debac5076a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:15.010268 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547b112-bc6e-41c1-a849-debac5076a5b admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:15.010750 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547b112-bc6e-41c1-a849-debac5076a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:15.011168 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547b112-bc6e-41c1-a849-debac5076a5b admin admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:15.011992 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f547b112-bc6e-41c1-a849-debac5076a5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:15.013964 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f547b112-bc6e-41c1-a849-debac5076a5b admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:15.037176 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1018/2065] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:04:14 2022] POST /identity/v3/users => generated 286 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:04:15.041721 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781defd5-c4f8-4df5-a821-a9f0ea376fd9 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:15.052145 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781defd5-c4f8-4df5-a821-a9f0ea376fd9 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:15.057325 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb60445-78d3-460e-add7-b6acaedbc167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:15.057966 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb60445-78d3-460e-add7-b6acaedbc167 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:15.058243 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb60445-78d3-460e-add7-b6acaedbc167 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:15.058512 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb60445-78d3-460e-add7-b6acaedbc167 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:15.059204 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb60445-78d3-460e-add7-b6acaedbc167 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:15.060810 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb60445-78d3-460e-add7-b6acaedbc167 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:15.080853 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1048/2066] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:04:15 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 11:04:15.084497 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f547b112-bc6e-41c1-a849-debac5076a5b admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:15.096759 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f547b112-bc6e-41c1-a849-debac5076a5b admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:15.101810 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb5856e-c004-4850-a69d-4fda11aacb87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:15.102416 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb5856e-c004-4850-a69d-4fda11aacb87 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:15.102751 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb5856e-c004-4850-a69d-4fda11aacb87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:15.103242 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb5856e-c004-4850-a69d-4fda11aacb87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:15.103906 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb5856e-c004-4850-a69d-4fda11aacb87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:15.105605 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb5856e-c004-4850-a69d-4fda11aacb87 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:15.121949 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1019/2067] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:04:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 11:04:15.123133 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb60445-78d3-460e-add7-b6acaedbc167 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:15.138372 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:04:15.146722 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb60445-78d3-460e-add7-b6acaedbc167 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:15.157689 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817a5643-43b4-4911-8b1f-69b42e1cf7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:15.158592 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a5643-43b4-4911-8b1f-69b42e1cf7da admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:15.158882 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a5643-43b4-4911-8b1f-69b42e1cf7da admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:15.159164 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a5643-43b4-4911-8b1f-69b42e1cf7da admin admin] PATH_INFO: `/v3/projects/ec9579dfc10347188154c7599fcdba54/users/16feab74dce6418495006f9835060be6/roles/719e5c62188d4f8a838987d6e72ca8f7` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:15.176870 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817a5643-43b4-4911-8b1f-69b42e1cf7da admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec9579dfc10347188154c7599fcdba54, user_id=16feab74dce6418495006f9835060be6, role_id=719e5c62188d4f8a838987d6e72ca8f7)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:15.180822 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817a5643-43b4-4911-8b1f-69b42e1cf7da admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:15.201193 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1049/2068] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:04:15 2022] PUT /identity/v3/projects/ec9579dfc10347188154c7599fcdba54/users/16feab74dce6418495006f9835060be6/roles/719e5c62188d4f8a838987d6e72ca8f7 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:04:15.208011 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2027ec-4bec-40aa-b506-36eea5891c3c None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:15.208355 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2027ec-4bec-40aa-b506-36eea5891c3c None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:15.208697 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2027ec-4bec-40aa-b506-36eea5891c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:15.255744 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-8f2027ec-4bec-40aa-b506-36eea5891c3c None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:04:15.257044 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-8f2027ec-4bec-40aa-b506-36eea5891c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:15.299838 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:04:15.362592 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1020/2069] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:04:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:04:15.376857 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817a5643-43b4-4911-8b1f-69b42e1cf7da admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:15.379765 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-817a5643-43b4-4911-8b1f-69b42e1cf7da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:15.457461 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817a5643-43b4-4911-8b1f-69b42e1cf7da admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:15.461830 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103ecb8c-2b86-45c9-bf39-3d2e31b42d90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:15.462449 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ecb8c-2b86-45c9-bf39-3d2e31b42d90 service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:15.462732 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ecb8c-2b86-45c9-bf39-3d2e31b42d90 service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:15.463012 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ecb8c-2b86-45c9-bf39-3d2e31b42d90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:15.485667 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103ecb8c-2b86-45c9-bf39-3d2e31b42d90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:15.487302 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103ecb8c-2b86-45c9-bf39-3d2e31b42d90 service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:15.511634 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1050/2070] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:04:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:04:16.182573 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7312dbb-999f-4fb0-aae5-7dfe8b8ee120 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:16.183115 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7312dbb-999f-4fb0-aae5-7dfe8b8ee120 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:16.183115 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7312dbb-999f-4fb0-aae5-7dfe8b8ee120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:16.212706 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-b7312dbb-999f-4fb0-aae5-7dfe8b8ee120 None None] MFA Rules not processed for user `16feab74dce6418495006f9835060be6`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:04:16.213991 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-b7312dbb-999f-4fb0-aae5-7dfe8b8ee120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:16.283587 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1021/2071] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:04:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:04:16.289385 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103ecb8c-2b86-45c9-bf39-3d2e31b42d90 service neutron] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:16.299802 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103ecb8c-2b86-45c9-bf39-3d2e31b42d90 service neutron] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:16.305884 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0edc305-b7b7-49ab-a191-4ef622e770c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:16.306963 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0edc305-b7b7-49ab-a191-4ef622e770c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:16.307393 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0edc305-b7b7-49ab-a191-4ef622e770c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:16.307799 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0edc305-b7b7-49ab-a191-4ef622e770c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:16.308561 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0edc305-b7b7-49ab-a191-4ef622e770c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:16.311376 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0edc305-b7b7-49ab-a191-4ef622e770c2 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:16.345563 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1051/2072] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:04:16 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:04:16.350198 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7312dbb-999f-4fb0-aae5-7dfe8b8ee120 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:16.365733 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7312dbb-999f-4fb0-aae5-7dfe8b8ee120 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:16.428597 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee4d19f-f5c1-4b57-b01a-85b6e10b7cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:16.429212 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee4d19f-f5c1-4b57-b01a-85b6e10b7cf9 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:16.429495 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee4d19f-f5c1-4b57-b01a-85b6e10b7cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:16.429801 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee4d19f-f5c1-4b57-b01a-85b6e10b7cf9 admin admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:16.430429 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee4d19f-f5c1-4b57-b01a-85b6e10b7cf9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:16.432351 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee4d19f-f5c1-4b57-b01a-85b6e10b7cf9 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:16.454582 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1022/2073] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:04:16 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:04:16.459112 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0edc305-b7b7-49ab-a191-4ef622e770c2 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:16.469385 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0edc305-b7b7-49ab-a191-4ef622e770c2 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:16.474256 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564a8cb0-cc07-459c-9f46-7cbca5a0af27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:16.474851 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a8cb0-cc07-459c-9f46-7cbca5a0af27 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:16.475130 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a8cb0-cc07-459c-9f46-7cbca5a0af27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:16.475403 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a8cb0-cc07-459c-9f46-7cbca5a0af27 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:16.476043 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564a8cb0-cc07-459c-9f46-7cbca5a0af27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:16.477664 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564a8cb0-cc07-459c-9f46-7cbca5a0af27 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:16.488194 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1052/2074] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:04:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:04:16.492505 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee4d19f-f5c1-4b57-b01a-85b6e10b7cf9 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:16.502502 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee4d19f-f5c1-4b57-b01a-85b6e10b7cf9 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:16.507874 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760cc91-7561-41a1-8767-8978ab038527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:16.508521 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760cc91-7561-41a1-8767-8978ab038527 admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:16.508801 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760cc91-7561-41a1-8767-8978ab038527 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:16.509071 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760cc91-7561-41a1-8767-8978ab038527 admin admin] PATH_INFO: `/v3/projects/958507b88d424ad78a6bf13152788558/users/715fc63367fb4dfea476f26aeee55c05/roles/127fdc7ef05b4e0b98a940b334e5fcab` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:16.524991 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5760cc91-7561-41a1-8767-8978ab038527 admin admin] RBAC: Authorizing `identity:create_grant(project_id=958507b88d424ad78a6bf13152788558, user_id=715fc63367fb4dfea476f26aeee55c05, role_id=127fdc7ef05b4e0b98a940b334e5fcab)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:16.527795 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5760cc91-7561-41a1-8767-8978ab038527 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:16.544379 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1023/2075] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:04:16 2022] PUT /identity/v3/projects/958507b88d424ad78a6bf13152788558/users/715fc63367fb4dfea476f26aeee55c05/roles/127fdc7ef05b4e0b98a940b334e5fcab => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:04:16.548652 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564a8cb0-cc07-459c-9f46-7cbca5a0af27 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:16.560200 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564a8cb0-cc07-459c-9f46-7cbca5a0af27 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:16.663435 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74d5f89-3e60-42a5-be98-d571927a7b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:16.665761 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d5f89-3e60-42a5-be98-d571927a7b58 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:16.666290 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d5f89-3e60-42a5-be98-d571927a7b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:16.667039 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d5f89-3e60-42a5-be98-d571927a7b58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:16.669431 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74d5f89-3e60-42a5-be98-d571927a7b58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:16.671536 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74d5f89-3e60-42a5-be98-d571927a7b58 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:16.686439 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1053/2076] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:04:16 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:04:16.687666 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760cc91-7561-41a1-8767-8978ab038527 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:16.699700 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760cc91-7561-41a1-8767-8978ab038527 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:16.705995 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecd3f62-8fa1-4bfc-b22a-c72f684e7358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:16.708080 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecd3f62-8fa1-4bfc-b22a-c72f684e7358 admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:16.708465 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecd3f62-8fa1-4bfc-b22a-c72f684e7358 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:16.708750 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecd3f62-8fa1-4bfc-b22a-c72f684e7358 admin admin] PATH_INFO: `/v3/projects/958507b88d424ad78a6bf13152788558/users/715fc63367fb4dfea476f26aeee55c05/roles/127fdc7ef05b4e0b98a940b334e5fcab` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:16.710766 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecd3f62-8fa1-4bfc-b22a-c72f684e7358 admin admin] RBAC: Authorizing `identity:create_grant(project_id=958507b88d424ad78a6bf13152788558, user_id=715fc63367fb4dfea476f26aeee55c05, role_id=127fdc7ef05b4e0b98a940b334e5fcab)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:16.714047 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecd3f62-8fa1-4bfc-b22a-c72f684e7358 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:16.727515 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1024/2077] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:04:16 2022] PUT /identity/v3/projects/958507b88d424ad78a6bf13152788558/users/715fc63367fb4dfea476f26aeee55c05/roles/127fdc7ef05b4e0b98a940b334e5fcab => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:04:17.403120 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953fd7e8-dcf5-419d-9159-9fd2afae383f None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:17.403588 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953fd7e8-dcf5-419d-9159-9fd2afae383f None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:17.403680 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953fd7e8-dcf5-419d-9159-9fd2afae383f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:17.438306 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-953fd7e8-dcf5-419d-9159-9fd2afae383f None None] MFA Rules not processed for user `715fc63367fb4dfea476f26aeee55c05`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:04:17.439790 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-953fd7e8-dcf5-419d-9159-9fd2afae383f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:17.474148 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:04:17.513728 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1054/2078] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:04:17 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:04:17.526167 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecd3f62-8fa1-4bfc-b22a-c72f684e7358 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:17.527889 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-9ecd3f62-8fa1-4bfc-b22a-c72f684e7358 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:17.543661 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:04:17.593559 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecd3f62-8fa1-4bfc-b22a-c72f684e7358 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:17.597267 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b3a8dc-005b-4e26-9895-e6bc438b4b90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b8a09704b9b4ab2bffb813796ec6e77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:17.598541 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b3a8dc-005b-4e26-9895-e6bc438b4b90 service cinder] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:17.598898 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b3a8dc-005b-4e26-9895-e6bc438b4b90 service cinder] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:17.599242 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b3a8dc-005b-4e26-9895-e6bc438b4b90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:17.658684 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b3a8dc-005b-4e26-9895-e6bc438b4b90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:17.660963 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b3a8dc-005b-4e26-9895-e6bc438b4b90 service cinder] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:17.671581 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1025/2079] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:04:17 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:04:22.399935 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953fd7e8-dcf5-419d-9159-9fd2afae383f None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:22.401371 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-953fd7e8-dcf5-419d-9159-9fd2afae383f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:22.414362 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953fd7e8-dcf5-419d-9159-9fd2afae383f None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:22.418729 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9011cfa2-e4f0-46c8-8d2d-7c0454060b9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b8a09704b9b4ab2bffb813796ec6e77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:22.419362 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9011cfa2-e4f0-46c8-8d2d-7c0454060b9f service cinder] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:22.419688 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9011cfa2-e4f0-46c8-8d2d-7c0454060b9f service cinder] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:22.419968 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9011cfa2-e4f0-46c8-8d2d-7c0454060b9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:22.429757 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9011cfa2-e4f0-46c8-8d2d-7c0454060b9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:22.431174 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9011cfa2-e4f0-46c8-8d2d-7c0454060b9f service cinder] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:22.440590 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1055/2080] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:04:22 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 11:04:24.971403 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b3a8dc-005b-4e26-9895-e6bc438b4b90 service cinder] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:24.973752 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-93b3a8dc-005b-4e26-9895-e6bc438b4b90 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:25.045974 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b3a8dc-005b-4e26-9895-e6bc438b4b90 service cinder] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:25.055141 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa945e2-875f-4f97-9d40-e822186a0a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:25.055782 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa945e2-875f-4f97-9d40-e822186a0a5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:25.056061 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa945e2-875f-4f97-9d40-e822186a0a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:25.056317 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa945e2-875f-4f97-9d40-e822186a0a5e admin admin] PATH_INFO: `/v3/users/b73926813b024c2a8f98538377bfbb27` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:25.058181 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa945e2-875f-4f97-9d40-e822186a0a5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b73926813b024c2a8f98538377bfbb27)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:25.061489 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa945e2-875f-4f97-9d40-e822186a0a5e admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:25.159642 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-6aa945e2-875f-4f97-9d40-e822186a0a5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b73926813b024c2a8f98538377bfbb27'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:25.170004 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-6aa945e2-875f-4f97-9d40-e822186a0a5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b73926813b024c2a8f98538377bfbb27'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:25.171218 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-6aa945e2-875f-4f97-9d40-e822186a0a5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b73926813b024c2a8f98538377bfbb27'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:25.172222 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-6aa945e2-875f-4f97-9d40-e822186a0a5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b73926813b024c2a8f98538377bfbb27'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:25.183317 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-6aa945e2-875f-4f97-9d40-e822186a0a5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b73926813b024c2a8f98538377bfbb27'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:25.189576 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:04:25.218997 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1026/2081] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:04:24 2022] DELETE /identity/v3/users/b73926813b024c2a8f98538377bfbb27 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:04:25.223836 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b8d702-263f-4181-89b9-8fb0f8513a47 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:25.224332 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b8d702-263f-4181-89b9-8fb0f8513a47 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:25.224332 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b8d702-263f-4181-89b9-8fb0f8513a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:25.249673 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-72b8d702-263f-4181-89b9-8fb0f8513a47 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:04:25.251311 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-72b8d702-263f-4181-89b9-8fb0f8513a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:25.336259 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1056/2082] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:04:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:04:25.347547 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa945e2-875f-4f97-9d40-e822186a0a5e admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:25.349417 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-6aa945e2-875f-4f97-9d40-e822186a0a5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:25.413396 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa945e2-875f-4f97-9d40-e822186a0a5e admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:25.417647 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b050f383-816d-4311-9766-d1543e4d1fe7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:25.418289 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b050f383-816d-4311-9766-d1543e4d1fe7 service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:25.418567 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b050f383-816d-4311-9766-d1543e4d1fe7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:25.418841 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b050f383-816d-4311-9766-d1543e4d1fe7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:25.432971 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b050f383-816d-4311-9766-d1543e4d1fe7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:25.434974 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b050f383-816d-4311-9766-d1543e4d1fe7 service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:25.446019 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1027/2083] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:04:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:04:25.559232 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95bc407-f9b2-494d-b406-32a55eb5606a None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:25.559731 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95bc407-f9b2-494d-b406-32a55eb5606a None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:25.560037 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95bc407-f9b2-494d-b406-32a55eb5606a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:25.580757 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-b95bc407-f9b2-494d-b406-32a55eb5606a None None] MFA Rules not processed for user `2ea5b4501d934e1bbfd6d46577d09e5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:04:25.582100 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-b95bc407-f9b2-494d-b406-32a55eb5606a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:25.648875 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1057/2084] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:04:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:04:26.073888 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b050f383-816d-4311-9766-d1543e4d1fe7 service neutron] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:26.075491 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-b050f383-816d-4311-9766-d1543e4d1fe7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:26.099675 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b050f383-816d-4311-9766-d1543e4d1fe7 service neutron] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:26.105036 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7788016-3977-44ce-88b4-806f15de8059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:26.105871 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7788016-3977-44ce-88b4-806f15de8059 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:26.106150 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7788016-3977-44ce-88b4-806f15de8059 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:26.106428 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7788016-3977-44ce-88b4-806f15de8059 admin admin] PATH_INFO: `/v3/projects/9261e546e2824f51984bf4a7475b4c0e` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:26.107576 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7788016-3977-44ce-88b4-806f15de8059 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9261e546e2824f51984bf4a7475b4c0e)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:26.109554 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7788016-3977-44ce-88b4-806f15de8059 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:26.160983 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-a7788016-3977-44ce-88b4-806f15de8059 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9261e546e2824f51984bf4a7475b4c0e', 'request_id': 'req-a7788016-3977-44ce-88b4-806f15de8059'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:26.169180 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-a7788016-3977-44ce-88b4-806f15de8059 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9261e546e2824f51984bf4a7475b4c0e', 'request_id': 'req-a7788016-3977-44ce-88b4-806f15de8059'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:26.176542 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-a7788016-3977-44ce-88b4-806f15de8059 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9261e546e2824f51984bf4a7475b4c0e', 'request_id': 'req-a7788016-3977-44ce-88b4-806f15de8059'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:26.187878 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-a7788016-3977-44ce-88b4-806f15de8059 admin admin] The token cache is being invalidate because project 9261e546e2824f51984bf4a7475b4c0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:04:26.188102 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-a7788016-3977-44ce-88b4-806f15de8059 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:26.188789 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-a7788016-3977-44ce-88b4-806f15de8059 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:26.190323 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1028/2085] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:04:26 2022] DELETE /identity/v3/projects/9261e546e2824f51984bf4a7475b4c0e => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:04:26.195201 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95bc407-f9b2-494d-b406-32a55eb5606a None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:26.208487 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95bc407-f9b2-494d-b406-32a55eb5606a None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:26.290965 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1469365-9806-45f6-a7c9-a61302e2b9c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:26.291736 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1469365-9806-45f6-a7c9-a61302e2b9c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:26.292206 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1469365-9806-45f6-a7c9-a61302e2b9c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:26.292643 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1469365-9806-45f6-a7c9-a61302e2b9c5 admin admin] PATH_INFO: `/v3/users/d12f054fa6974f6ebda5f04d1c065fe7` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:26.293897 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1469365-9806-45f6-a7c9-a61302e2b9c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d12f054fa6974f6ebda5f04d1c065fe7)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:26.296038 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1469365-9806-45f6-a7c9-a61302e2b9c5 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:26.299053 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:04:26.370260 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-c1469365-9806-45f6-a7c9-a61302e2b9c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd12f054fa6974f6ebda5f04d1c065fe7'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:26.371124 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-c1469365-9806-45f6-a7c9-a61302e2b9c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd12f054fa6974f6ebda5f04d1c065fe7'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:26.381194 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-c1469365-9806-45f6-a7c9-a61302e2b9c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd12f054fa6974f6ebda5f04d1c065fe7'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:26.410490 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-c1469365-9806-45f6-a7c9-a61302e2b9c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd12f054fa6974f6ebda5f04d1c065fe7'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:26.421150 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-c1469365-9806-45f6-a7c9-a61302e2b9c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd12f054fa6974f6ebda5f04d1c065fe7'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:26.429565 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1058/2086] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:04:26 2022] DELETE /identity/v3/users/d12f054fa6974f6ebda5f04d1c065fe7 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:04:26.852097 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7788016-3977-44ce-88b4-806f15de8059 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:26.854476 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-a7788016-3977-44ce-88b4-806f15de8059 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:26.895110 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7788016-3977-44ce-88b4-806f15de8059 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:27.009752 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a240d5d0-9f96-4d91-8c5b-92c989d30648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:27.011389 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a240d5d0-9f96-4d91-8c5b-92c989d30648 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:27.012122 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a240d5d0-9f96-4d91-8c5b-92c989d30648 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:27.012620 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a240d5d0-9f96-4d91-8c5b-92c989d30648 admin admin] PATH_INFO: `/v3/projects/2cbb7614006740c2ab8c4efb83a902fb` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:27.014946 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a240d5d0-9f96-4d91-8c5b-92c989d30648 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cbb7614006740c2ab8c4efb83a902fb)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:27.017250 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a240d5d0-9f96-4d91-8c5b-92c989d30648 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:27.041645 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:04:27.089750 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-a240d5d0-9f96-4d91-8c5b-92c989d30648 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cbb7614006740c2ab8c4efb83a902fb', 'request_id': 'req-a240d5d0-9f96-4d91-8c5b-92c989d30648'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:27.099848 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-a240d5d0-9f96-4d91-8c5b-92c989d30648 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cbb7614006740c2ab8c4efb83a902fb', 'request_id': 'req-a240d5d0-9f96-4d91-8c5b-92c989d30648'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:27.107380 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-a240d5d0-9f96-4d91-8c5b-92c989d30648 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cbb7614006740c2ab8c4efb83a902fb', 'request_id': 'req-a240d5d0-9f96-4d91-8c5b-92c989d30648'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:27.119317 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-a240d5d0-9f96-4d91-8c5b-92c989d30648 admin admin] The token cache is being invalidate because project 2cbb7614006740c2ab8c4efb83a902fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:04:27.119607 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-a240d5d0-9f96-4d91-8c5b-92c989d30648 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:27.120385 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-a240d5d0-9f96-4d91-8c5b-92c989d30648 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:27.121991 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1029/2087] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:04:26 2022] DELETE /identity/v3/projects/2cbb7614006740c2ab8c4efb83a902fb => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:04:27.127382 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc50bd3-8706-4ebc-be9f-383a07a70711 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:27.127621 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc50bd3-8706-4ebc-be9f-383a07a70711 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:27.127909 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc50bd3-8706-4ebc-be9f-383a07a70711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:27.149417 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-0bc50bd3-8706-4ebc-be9f-383a07a70711 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:04:27.150748 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-0bc50bd3-8706-4ebc-be9f-383a07a70711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:27.224739 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1059/2088] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:04:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:04:27.232712 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1206ca-925e-4d50-ad71-d05dd4cab7eb None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:27.232979 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1206ca-925e-4d50-ad71-d05dd4cab7eb None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:27.233479 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1206ca-925e-4d50-ad71-d05dd4cab7eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:27.256059 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-dc1206ca-925e-4d50-ad71-d05dd4cab7eb None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:04:27.257300 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-dc1206ca-925e-4d50-ad71-d05dd4cab7eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:27.266001 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1030/2089] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:04:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:04:27.271105 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc50bd3-8706-4ebc-be9f-383a07a70711 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:27.281463 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc50bd3-8706-4ebc-be9f-383a07a70711 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:27.287027 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5b5cf6-b187-44e3-8315-0588fd121177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:27.287692 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b5cf6-b187-44e3-8315-0588fd121177 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:27.287977 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b5cf6-b187-44e3-8315-0588fd121177 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:27.288248 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b5cf6-b187-44e3-8315-0588fd121177 admin admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:27.288924 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5b5cf6-b187-44e3-8315-0588fd121177 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:04:27.289228 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5b5cf6-b187-44e3-8315-0588fd121177 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:27.291305 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5b5cf6-b187-44e3-8315-0588fd121177 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:27.307799 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1060/2090] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Aug 18 11:04:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:04:27.309068 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1206ca-925e-4d50-ad71-d05dd4cab7eb None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:27.319983 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1206ca-925e-4d50-ad71-d05dd4cab7eb None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:27.325805 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20512b4c-48a6-4371-938e-4682444e1299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:27.326425 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20512b4c-48a6-4371-938e-4682444e1299 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:27.326706 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20512b4c-48a6-4371-938e-4682444e1299 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:27.326978 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20512b4c-48a6-4371-938e-4682444e1299 admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:27.327643 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20512b4c-48a6-4371-938e-4682444e1299 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:27.330069 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20512b4c-48a6-4371-938e-4682444e1299 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:27.364893 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1031/2091] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:04:27 2022] POST /identity/v3/projects => generated 387 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:04:27.370388 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5b5cf6-b187-44e3-8315-0588fd121177 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:27.383343 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5b5cf6-b187-44e3-8315-0588fd121177 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:27.458137 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06805c26-9bc3-4ecc-82cb-c4e8b66c7f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:27.458880 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06805c26-9bc3-4ecc-82cb-c4e8b66c7f88 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:27.462738 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06805c26-9bc3-4ecc-82cb-c4e8b66c7f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:27.462738 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06805c26-9bc3-4ecc-82cb-c4e8b66c7f88 admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:27.462738 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06805c26-9bc3-4ecc-82cb-c4e8b66c7f88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:27.462738 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06805c26-9bc3-4ecc-82cb-c4e8b66c7f88 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:27.492986 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:04:27.518281 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1061/2092] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:04:27 2022] POST /identity/v3/users => generated 294 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 11:04:27.522758 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20512b4c-48a6-4371-938e-4682444e1299 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:27.533557 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06805c26-9bc3-4ecc-82cb-c4e8b66c7f88 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:27.535452 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20512b4c-48a6-4371-938e-4682444e1299 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:27.536694 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-06805c26-9bc3-4ecc-82cb-c4e8b66c7f88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:27.540581 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a4d62-34cc-4416-af56-22fe063dab02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:27.541186 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a4d62-34cc-4416-af56-22fe063dab02 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:27.541463 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a4d62-34cc-4416-af56-22fe063dab02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:27.541771 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a4d62-34cc-4416-af56-22fe063dab02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:27.542418 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923a4d62-34cc-4416-af56-22fe063dab02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:27.544020 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923a4d62-34cc-4416-af56-22fe063dab02 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:27.552971 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06805c26-9bc3-4ecc-82cb-c4e8b66c7f88 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:27.560147 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e52b3ca-2d2e-470a-941a-fbb2ad98cf21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:27.561218 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e52b3ca-2d2e-470a-941a-fbb2ad98cf21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:27.562001 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e52b3ca-2d2e-470a-941a-fbb2ad98cf21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:27.562771 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e52b3ca-2d2e-470a-941a-fbb2ad98cf21 admin admin] PATH_INFO: `/v3/users/bb285b35cf2647479b57a1bdf8b9b6b5` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:27.564330 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e52b3ca-2d2e-470a-941a-fbb2ad98cf21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb285b35cf2647479b57a1bdf8b9b6b5)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:27.566957 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e52b3ca-2d2e-470a-941a-fbb2ad98cf21 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:27.579518 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1032/2093] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:04:27 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:04:27.584538 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a4d62-34cc-4416-af56-22fe063dab02 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:27.600947 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a4d62-34cc-4416-af56-22fe063dab02 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:27.615821 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068ced12-5c4c-441d-a5cd-2059a16a1d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:27.615821 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ced12-5c4c-441d-a5cd-2059a16a1d77 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:27.615821 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ced12-5c4c-441d-a5cd-2059a16a1d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:27.616204 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ced12-5c4c-441d-a5cd-2059a16a1d77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:27.616654 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068ced12-5c4c-441d-a5cd-2059a16a1d77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:27.618485 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068ced12-5c4c-441d-a5cd-2059a16a1d77 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:27.643086 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1033/2094] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:04:27 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:04:27.648674 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068ced12-5c4c-441d-a5cd-2059a16a1d77 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:27.655061 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-1e52b3ca-2d2e-470a-941a-fbb2ad98cf21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb285b35cf2647479b57a1bdf8b9b6b5'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:27.658471 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-1e52b3ca-2d2e-470a-941a-fbb2ad98cf21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb285b35cf2647479b57a1bdf8b9b6b5'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:27.666233 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068ced12-5c4c-441d-a5cd-2059a16a1d77 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:27.671858 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-1e52b3ca-2d2e-470a-941a-fbb2ad98cf21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb285b35cf2647479b57a1bdf8b9b6b5'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:27.672742 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5497fc77-de16-42b0-819d-76532600e46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:27.673647 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5497fc77-de16-42b0-819d-76532600e46c admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:27.673968 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5497fc77-de16-42b0-819d-76532600e46c admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:27.674356 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5497fc77-de16-42b0-819d-76532600e46c admin admin] PATH_INFO: `/v3/projects/cc237cc9ce73486297afdeb35517669b/users/442c5966ff2e4df982bdd85e0ce1dd35/roles/719e5c62188d4f8a838987d6e72ca8f7` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:27.692040 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-1e52b3ca-2d2e-470a-941a-fbb2ad98cf21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb285b35cf2647479b57a1bdf8b9b6b5'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:27.700460 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5497fc77-de16-42b0-819d-76532600e46c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc237cc9ce73486297afdeb35517669b, user_id=442c5966ff2e4df982bdd85e0ce1dd35, role_id=719e5c62188d4f8a838987d6e72ca8f7)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:27.702298 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-1e52b3ca-2d2e-470a-941a-fbb2ad98cf21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb285b35cf2647479b57a1bdf8b9b6b5'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:27.705979 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5497fc77-de16-42b0-819d-76532600e46c admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:27.710831 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1062/2095] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:04:27 2022] DELETE /identity/v3/users/bb285b35cf2647479b57a1bdf8b9b6b5 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:04:27.715833 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10242e66-659b-47fd-8a8b-c7072e8d0037 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:27.716172 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10242e66-659b-47fd-8a8b-c7072e8d0037 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:27.716514 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10242e66-659b-47fd-8a8b-c7072e8d0037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:27.724643 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1034/2096] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:04:27 2022] PUT /identity/v3/projects/cc237cc9ce73486297afdeb35517669b/users/442c5966ff2e4df982bdd85e0ce1dd35/roles/719e5c62188d4f8a838987d6e72ca8f7 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:04:27.734812 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af9fe5-d4f4-4917-a31f-da2f8c164759 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:27.735338 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af9fe5-d4f4-4917-a31f-da2f8c164759 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:27.735526 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af9fe5-d4f4-4917-a31f-da2f8c164759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:27.740165 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-10242e66-659b-47fd-8a8b-c7072e8d0037 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:04:27.741583 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-10242e66-659b-47fd-8a8b-c7072e8d0037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:27.767097 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-34af9fe5-d4f4-4917-a31f-da2f8c164759 None None] MFA Rules not processed for user `442c5966ff2e4df982bdd85e0ce1dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:04:27.768515 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-34af9fe5-d4f4-4917-a31f-da2f8c164759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:27.814735 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1063/2097] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:04:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:04:27.825481 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10242e66-659b-47fd-8a8b-c7072e8d0037 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:27.826912 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-10242e66-659b-47fd-8a8b-c7072e8d0037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:27.858640 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1035/2098] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:04:27 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:04:27.859743 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34af9fe5-d4f4-4917-a31f-da2f8c164759 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:27.861118 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-34af9fe5-d4f4-4917-a31f-da2f8c164759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:27.876427 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34af9fe5-d4f4-4917-a31f-da2f8c164759 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:27.882094 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbd8646-bf1c-42c3-b174-cf12b1f80099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:27.882715 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbd8646-bf1c-42c3-b174-cf12b1f80099 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:27.883005 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbd8646-bf1c-42c3-b174-cf12b1f80099 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:27.883499 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbd8646-bf1c-42c3-b174-cf12b1f80099 admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:27.884147 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbd8646-bf1c-42c3-b174-cf12b1f80099 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:27.886137 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbd8646-bf1c-42c3-b174-cf12b1f80099 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:27.905379 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:04:27.907534 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10242e66-659b-47fd-8a8b-c7072e8d0037 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:27.914059 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c470ab-5bfe-423d-b847-fbf8769ddb1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:27.915541 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c470ab-5bfe-423d-b847-fbf8769ddb1e service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:27.915698 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c470ab-5bfe-423d-b847-fbf8769ddb1e service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:27.915971 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c470ab-5bfe-423d-b847-fbf8769ddb1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:27.927835 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1036/2099] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:04:27 2022] POST /identity/v3/projects => generated 389 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 11:04:27.928833 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbd8646-bf1c-42c3-b174-cf12b1f80099 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:27.930796 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c470ab-5bfe-423d-b847-fbf8769ddb1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:27.932447 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c470ab-5bfe-423d-b847-fbf8769ddb1e service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:27.947393 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1064/2100] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:04:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 11:04:28.023113 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbd8646-bf1c-42c3-b174-cf12b1f80099 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:28.029885 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84086104-060f-4c1d-9092-16dea636047b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:28.031578 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84086104-060f-4c1d-9092-16dea636047b admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:28.032380 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84086104-060f-4c1d-9092-16dea636047b admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:28.032772 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84086104-060f-4c1d-9092-16dea636047b admin admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:28.033838 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84086104-060f-4c1d-9092-16dea636047b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:28.037422 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84086104-060f-4c1d-9092-16dea636047b admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:28.078978 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1037/2101] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:04:27 2022] POST /identity/v3/users => generated 301 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:04:28.080766 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c470ab-5bfe-423d-b847-fbf8769ddb1e service neutron] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:28.095447 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c470ab-5bfe-423d-b847-fbf8769ddb1e service neutron] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:28.122733 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dc169c-e06a-463a-aa09-17660e42f3f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:28.123467 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc169c-e06a-463a-aa09-17660e42f3f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:28.124195 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc169c-e06a-463a-aa09-17660e42f3f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:28.124195 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc169c-e06a-463a-aa09-17660e42f3f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:28.124761 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dc169c-e06a-463a-aa09-17660e42f3f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:28.126485 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dc169c-e06a-463a-aa09-17660e42f3f9 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:28.143143 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84086104-060f-4c1d-9092-16dea636047b admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:28.143629 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1065/2102] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:04:28 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 11:04:28.174977 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84086104-060f-4c1d-9092-16dea636047b admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:28.189142 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff258e-09d0-4444-9a8c-1a0b70cb9d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:28.190206 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff258e-09d0-4444-9a8c-1a0b70cb9d5e admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:28.191575 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff258e-09d0-4444-9a8c-1a0b70cb9d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:28.192054 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff258e-09d0-4444-9a8c-1a0b70cb9d5e admin admin] PATH_INFO: `/v3/projects/31a31f2745d84a5d91c5e3bb5c4e2d1e/users/ccacf70c44634787a8d35b5946fe435f/roles/127fdc7ef05b4e0b98a940b334e5fcab` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:28.223756 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ff258e-09d0-4444-9a8c-1a0b70cb9d5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=31a31f2745d84a5d91c5e3bb5c4e2d1e, user_id=ccacf70c44634787a8d35b5946fe435f, role_id=127fdc7ef05b4e0b98a940b334e5fcab)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:28.227143 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ff258e-09d0-4444-9a8c-1a0b70cb9d5e admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:28.249093 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1038/2103] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:04:28 2022] PUT /identity/v3/projects/31a31f2745d84a5d91c5e3bb5c4e2d1e/users/ccacf70c44634787a8d35b5946fe435f/roles/127fdc7ef05b4e0b98a940b334e5fcab => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:04:28.254232 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dc169c-e06a-463a-aa09-17660e42f3f9 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:28.262891 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:04:28.271400 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dc169c-e06a-463a-aa09-17660e42f3f9 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:28.364237 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceceb386-50bd-4842-ac6c-71a2e1ddadf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:28.364863 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceceb386-50bd-4842-ac6c-71a2e1ddadf2 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:28.365224 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceceb386-50bd-4842-ac6c-71a2e1ddadf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:28.365868 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceceb386-50bd-4842-ac6c-71a2e1ddadf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:28.371169 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff258e-09d0-4444-9a8c-1a0b70cb9d5e admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:28.372947 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-e7ff258e-09d0-4444-9a8c-1a0b70cb9d5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:28.387044 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceceb386-50bd-4842-ac6c-71a2e1ddadf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:28.390333 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceceb386-50bd-4842-ac6c-71a2e1ddadf2 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:28.400540 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff258e-09d0-4444-9a8c-1a0b70cb9d5e admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:28.413705 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebe4780-e5ae-4612-939b-2a3fa57702fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:28.414493 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe4780-e5ae-4612-939b-2a3fa57702fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:28.415023 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe4780-e5ae-4612-939b-2a3fa57702fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:28.415364 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe4780-e5ae-4612-939b-2a3fa57702fa admin admin] PATH_INFO: `/v3/projects/7d1615baeffd4789bd598673857f23e4` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:28.419051 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebe4780-e5ae-4612-939b-2a3fa57702fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d1615baeffd4789bd598673857f23e4)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:28.423555 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebe4780-e5ae-4612-939b-2a3fa57702fa admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:28.428502 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1066/2104] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:04:28 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 11:04:28.438747 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceceb386-50bd-4842-ac6c-71a2e1ddadf2 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:28.465013 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceceb386-50bd-4842-ac6c-71a2e1ddadf2 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:28.477057 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43578a42-4641-43a8-a6e5-a038a4f5e8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:28.477678 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43578a42-4641-43a8-a6e5-a038a4f5e8cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:28.477955 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43578a42-4641-43a8-a6e5-a038a4f5e8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:28.478264 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43578a42-4641-43a8-a6e5-a038a4f5e8cf admin admin] PATH_INFO: `/v3/projects/31a31f2745d84a5d91c5e3bb5c4e2d1e/users/ccacf70c44634787a8d35b5946fe435f/roles/127fdc7ef05b4e0b98a940b334e5fcab` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:28.481022 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43578a42-4641-43a8-a6e5-a038a4f5e8cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=31a31f2745d84a5d91c5e3bb5c4e2d1e, user_id=ccacf70c44634787a8d35b5946fe435f, role_id=127fdc7ef05b4e0b98a940b334e5fcab)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:28.487236 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43578a42-4641-43a8-a6e5-a038a4f5e8cf admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:28.521570 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1067/2105] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:04:28 2022] PUT /identity/v3/projects/31a31f2745d84a5d91c5e3bb5c4e2d1e/users/ccacf70c44634787a8d35b5946fe435f/roles/127fdc7ef05b4e0b98a940b334e5fcab => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:04:28.536953 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7421f989-69b5-44b3-aeca-45f4146592c8 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:28.538346 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7421f989-69b5-44b3-aeca-45f4146592c8 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:28.539072 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7421f989-69b5-44b3-aeca-45f4146592c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:28.549415 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-8ebe4780-e5ae-4612-939b-2a3fa57702fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d1615baeffd4789bd598673857f23e4', 'request_id': 'req-8ebe4780-e5ae-4612-939b-2a3fa57702fa'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:28.568692 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-8ebe4780-e5ae-4612-939b-2a3fa57702fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d1615baeffd4789bd598673857f23e4', 'request_id': 'req-8ebe4780-e5ae-4612-939b-2a3fa57702fa'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:28.577235 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-8ebe4780-e5ae-4612-939b-2a3fa57702fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d1615baeffd4789bd598673857f23e4', 'request_id': 'req-8ebe4780-e5ae-4612-939b-2a3fa57702fa'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:28.604585 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-8ebe4780-e5ae-4612-939b-2a3fa57702fa admin admin] The token cache is being invalidate because project 7d1615baeffd4789bd598673857f23e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:04:28.604881 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-8ebe4780-e5ae-4612-939b-2a3fa57702fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:28.605616 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-8ebe4780-e5ae-4612-939b-2a3fa57702fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:28.607032 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-7421f989-69b5-44b3-aeca-45f4146592c8 None None] MFA Rules not processed for user `ccacf70c44634787a8d35b5946fe435f`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:04:28.608441 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-7421f989-69b5-44b3-aeca-45f4146592c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:28.610083 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1039/2106] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:04:28 2022] DELETE /identity/v3/projects/7d1615baeffd4789bd598673857f23e4 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:04:28.617226 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b406559-e928-4a2e-818e-d8641f150dae None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:28.617600 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b406559-e928-4a2e-818e-d8641f150dae None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:28.617878 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b406559-e928-4a2e-818e-d8641f150dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:28.656952 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-6b406559-e928-4a2e-818e-d8641f150dae None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:04:28.661766 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-6b406559-e928-4a2e-818e-d8641f150dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:28.721773 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:04:28.733769 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1068/2107] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:04:28 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:04:28.742360 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7421f989-69b5-44b3-aeca-45f4146592c8 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:28.744057 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-7421f989-69b5-44b3-aeca-45f4146592c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:28.748763 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1040/2108] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:04:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:04:28.757565 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95325fc1-4667-472e-ab80-2fe30264e717 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:28.757565 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95325fc1-4667-472e-ab80-2fe30264e717 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:28.757565 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95325fc1-4667-472e-ab80-2fe30264e717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:28.780934 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-95325fc1-4667-472e-ab80-2fe30264e717 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:04:28.782490 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-95325fc1-4667-472e-ab80-2fe30264e717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:28.794621 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1041/2109] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:04:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:04:28.808155 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95325fc1-4667-472e-ab80-2fe30264e717 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:28.817786 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95325fc1-4667-472e-ab80-2fe30264e717 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:28.823244 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a42f5-e1e8-4a70-97fb-6479f2b059d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:28.823244 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a42f5-e1e8-4a70-97fb-6479f2b059d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:28.823459 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a42f5-e1e8-4a70-97fb-6479f2b059d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:28.823729 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a42f5-e1e8-4a70-97fb-6479f2b059d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:28.824378 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7a42f5-e1e8-4a70-97fb-6479f2b059d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:04:28.824723 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7a42f5-e1e8-4a70-97fb-6479f2b059d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:28.826372 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7a42f5-e1e8-4a70-97fb-6479f2b059d5 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:28.826481 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7421f989-69b5-44b3-aeca-45f4146592c8 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:28.830495 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04669f1-bb2c-4038-99b0-edc240538d59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b8a09704b9b4ab2bffb813796ec6e77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:28.830953 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04669f1-bb2c-4038-99b0-edc240538d59 service cinder] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:28.831237 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04669f1-bb2c-4038-99b0-edc240538d59 service cinder] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:28.832036 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04669f1-bb2c-4038-99b0-edc240538d59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:28.841604 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1042/2110] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Aug 18 11:04:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:04:28.842851 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04669f1-bb2c-4038-99b0-edc240538d59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:28.844658 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04669f1-bb2c-4038-99b0-edc240538d59 service cinder] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:28.845881 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a42f5-e1e8-4a70-97fb-6479f2b059d5 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:28.856110 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1069/2111] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:04:28 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 11:04:28.860053 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a42f5-e1e8-4a70-97fb-6479f2b059d5 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:28.866151 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae10e2f9-7e55-4bf8-9872-b1e06aad0498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:28.866829 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae10e2f9-7e55-4bf8-9872-b1e06aad0498 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:28.867115 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae10e2f9-7e55-4bf8-9872-b1e06aad0498 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:28.867444 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae10e2f9-7e55-4bf8-9872-b1e06aad0498 admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:28.868129 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae10e2f9-7e55-4bf8-9872-b1e06aad0498 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:28.870171 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae10e2f9-7e55-4bf8-9872-b1e06aad0498 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:28.914138 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1043/2112] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:04:28 2022] POST /identity/v3/projects => generated 373 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 11:04:28.918279 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04669f1-bb2c-4038-99b0-edc240538d59 service cinder] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:28.930037 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04669f1-bb2c-4038-99b0-edc240538d59 service cinder] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:28.944186 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:04:29.011813 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05b2f65-2d9f-40b7-811b-2cdf025387f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:29.012591 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05b2f65-2d9f-40b7-811b-2cdf025387f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:29.012884 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05b2f65-2d9f-40b7-811b-2cdf025387f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:29.013163 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05b2f65-2d9f-40b7-811b-2cdf025387f1 admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:29.013901 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05b2f65-2d9f-40b7-811b-2cdf025387f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:29.016777 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05b2f65-2d9f-40b7-811b-2cdf025387f1 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:29.020186 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae10e2f9-7e55-4bf8-9872-b1e06aad0498 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:29.024235 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-ae10e2f9-7e55-4bf8-9872-b1e06aad0498 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:29.042573 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae10e2f9-7e55-4bf8-9872-b1e06aad0498 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:29.042973 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1070/2113] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:04:28 2022] POST /identity/v3/users => generated 287 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 11:04:29.046753 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05b2f65-2d9f-40b7-811b-2cdf025387f1 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:29.049474 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24716e7-a832-4a96-8d69-ee0c14bde78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:29.053124 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24716e7-a832-4a96-8d69-ee0c14bde78e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:29.055102 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24716e7-a832-4a96-8d69-ee0c14bde78e admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:29.055443 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24716e7-a832-4a96-8d69-ee0c14bde78e admin admin] PATH_INFO: `/v3/users/442c5966ff2e4df982bdd85e0ce1dd35` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:29.056713 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24716e7-a832-4a96-8d69-ee0c14bde78e admin admin] RBAC: Authorizing `identity:delete_user(user_id=442c5966ff2e4df982bdd85e0ce1dd35)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:29.058503 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05b2f65-2d9f-40b7-811b-2cdf025387f1 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:29.058704 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24716e7-a832-4a96-8d69-ee0c14bde78e admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:29.063532 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be294eb-c67e-41fc-be70-a563cdd63100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:29.064354 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be294eb-c67e-41fc-be70-a563cdd63100 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:29.064647 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be294eb-c67e-41fc-be70-a563cdd63100 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:29.064922 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be294eb-c67e-41fc-be70-a563cdd63100 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:29.065595 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be294eb-c67e-41fc-be70-a563cdd63100 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:29.068274 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be294eb-c67e-41fc-be70-a563cdd63100 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:29.085084 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1071/2114] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:04:29 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:04:29.086894 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be294eb-c67e-41fc-be70-a563cdd63100 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:29.103840 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be294eb-c67e-41fc-be70-a563cdd63100 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:29.110039 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f437641d-947b-45a4-b347-e70cafad6a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:29.110673 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f437641d-947b-45a4-b347-e70cafad6a2d admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:29.110948 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f437641d-947b-45a4-b347-e70cafad6a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:29.111217 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f437641d-947b-45a4-b347-e70cafad6a2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:29.111873 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f437641d-947b-45a4-b347-e70cafad6a2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:29.114161 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f437641d-947b-45a4-b347-e70cafad6a2d admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:29.120724 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-a24716e7-a832-4a96-8d69-ee0c14bde78e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '442c5966ff2e4df982bdd85e0ce1dd35'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:29.125859 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1072/2115] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:04:29 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 11:04:29.132367 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f437641d-947b-45a4-b347-e70cafad6a2d admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:29.135436 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-a24716e7-a832-4a96-8d69-ee0c14bde78e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '442c5966ff2e4df982bdd85e0ce1dd35'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:29.136405 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-a24716e7-a832-4a96-8d69-ee0c14bde78e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '442c5966ff2e4df982bdd85e0ce1dd35'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:29.137024 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-a24716e7-a832-4a96-8d69-ee0c14bde78e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '442c5966ff2e4df982bdd85e0ce1dd35'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:29.145757 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f437641d-947b-45a4-b347-e70cafad6a2d admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:29.148199 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-a24716e7-a832-4a96-8d69-ee0c14bde78e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '442c5966ff2e4df982bdd85e0ce1dd35'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:29.151656 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97023f4-02b6-4b94-a74e-00f89b5d484a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:29.152341 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97023f4-02b6-4b94-a74e-00f89b5d484a admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:29.152622 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97023f4-02b6-4b94-a74e-00f89b5d484a admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:29.152897 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97023f4-02b6-4b94-a74e-00f89b5d484a admin admin] PATH_INFO: `/v3/projects/f20ffd1ca0c94a9285f1fad07e8ab39a/users/b6e7022d0e4c4b00b92f12a65963d9e9/roles/719e5c62188d4f8a838987d6e72ca8f7` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:29.172834 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1044/2116] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:04:29 2022] DELETE /identity/v3/users/442c5966ff2e4df982bdd85e0ce1dd35 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:04:29.176075 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97023f4-02b6-4b94-a74e-00f89b5d484a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f20ffd1ca0c94a9285f1fad07e8ab39a, user_id=b6e7022d0e4c4b00b92f12a65963d9e9, role_id=719e5c62188d4f8a838987d6e72ca8f7)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:29.176445 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97023f4-02b6-4b94-a74e-00f89b5d484a admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:29.178114 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b09635-8d07-4867-82db-68f9c74427c8 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:29.178468 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b09635-8d07-4867-82db-68f9c74427c8 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:29.178823 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b09635-8d07-4867-82db-68f9c74427c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:29.193557 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1073/2117] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:04:29 2022] PUT /identity/v3/projects/f20ffd1ca0c94a9285f1fad07e8ab39a/users/b6e7022d0e4c4b00b92f12a65963d9e9/roles/719e5c62188d4f8a838987d6e72ca8f7 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:04:29.200334 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9910a4ee-63bc-4cee-b242-41bb9f369a4e None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:29.200953 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9910a4ee-63bc-4cee-b242-41bb9f369a4e None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:29.201383 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-20b09635-8d07-4867-82db-68f9c74427c8 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:04:29.201730 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9910a4ee-63bc-4cee-b242-41bb9f369a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:29.203476 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-20b09635-8d07-4867-82db-68f9c74427c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:29.233480 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-9910a4ee-63bc-4cee-b242-41bb9f369a4e None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:04:29.235290 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-9910a4ee-63bc-4cee-b242-41bb9f369a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:29.297067 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1045/2118] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:04:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:04:29.308605 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b09635-8d07-4867-82db-68f9c74427c8 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:29.310380 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-20b09635-8d07-4867-82db-68f9c74427c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:29.316235 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1074/2119] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:04:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:04:29.324959 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9910a4ee-63bc-4cee-b242-41bb9f369a4e None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:29.327684 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-9910a4ee-63bc-4cee-b242-41bb9f369a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:29.332773 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:04:29.388216 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b09635-8d07-4867-82db-68f9c74427c8 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:29.392652 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7286f60-1877-4555-a5d3-97d405a16261 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:29.393273 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7286f60-1877-4555-a5d3-97d405a16261 service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:29.393598 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7286f60-1877-4555-a5d3-97d405a16261 service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:29.394019 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7286f60-1877-4555-a5d3-97d405a16261 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:29.406674 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7286f60-1877-4555-a5d3-97d405a16261 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:29.408249 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7286f60-1877-4555-a5d3-97d405a16261 service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:29.412375 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9910a4ee-63bc-4cee-b242-41bb9f369a4e None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:29.418751 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933d37a7-21fa-4fce-9031-5a7909305922 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:29.419876 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933d37a7-21fa-4fce-9031-5a7909305922 service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:29.420382 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933d37a7-21fa-4fce-9031-5a7909305922 service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:29.420751 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933d37a7-21fa-4fce-9031-5a7909305922 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:29.432573 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933d37a7-21fa-4fce-9031-5a7909305922 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:29.435331 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933d37a7-21fa-4fce-9031-5a7909305922 service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:29.444161 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:04:29.449838 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1046/2120] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:04:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 11:04:29.451772 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1075/2121] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:04:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:04:30.345551 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7286f60-1877-4555-a5d3-97d405a16261 service neutron] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:30.349756 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-c7286f60-1877-4555-a5d3-97d405a16261 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:30.366274 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7286f60-1877-4555-a5d3-97d405a16261 service neutron] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:30.372537 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36a06d4-b8b3-4c28-92db-77587f10ebdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:30.373187 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a06d4-b8b3-4c28-92db-77587f10ebdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:30.373471 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a06d4-b8b3-4c28-92db-77587f10ebdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:30.373797 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a06d4-b8b3-4c28-92db-77587f10ebdb admin admin] PATH_INFO: `/v3/projects/cc237cc9ce73486297afdeb35517669b` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:30.378118 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36a06d4-b8b3-4c28-92db-77587f10ebdb admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc237cc9ce73486297afdeb35517669b)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:30.383123 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36a06d4-b8b3-4c28-92db-77587f10ebdb admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:30.454279 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-d36a06d4-b8b3-4c28-92db-77587f10ebdb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc237cc9ce73486297afdeb35517669b', 'request_id': 'req-d36a06d4-b8b3-4c28-92db-77587f10ebdb'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:30.474379 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-d36a06d4-b8b3-4c28-92db-77587f10ebdb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc237cc9ce73486297afdeb35517669b', 'request_id': 'req-d36a06d4-b8b3-4c28-92db-77587f10ebdb'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:30.482407 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-d36a06d4-b8b3-4c28-92db-77587f10ebdb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc237cc9ce73486297afdeb35517669b', 'request_id': 'req-d36a06d4-b8b3-4c28-92db-77587f10ebdb'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:30.514505 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-d36a06d4-b8b3-4c28-92db-77587f10ebdb admin admin] The token cache is being invalidate because project cc237cc9ce73486297afdeb35517669b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:04:30.515554 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-d36a06d4-b8b3-4c28-92db-77587f10ebdb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:30.520895 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-d36a06d4-b8b3-4c28-92db-77587f10ebdb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:30.523670 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1047/2122] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:04:30 2022] DELETE /identity/v3/projects/cc237cc9ce73486297afdeb35517669b => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:04:30.543352 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933d37a7-21fa-4fce-9031-5a7909305922 service neutron] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:30.567847 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933d37a7-21fa-4fce-9031-5a7909305922 service neutron] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:30.656111 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af59c486-6195-4822-9d3e-749b9672a54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:30.656778 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af59c486-6195-4822-9d3e-749b9672a54f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:30.657396 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af59c486-6195-4822-9d3e-749b9672a54f admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:30.657509 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af59c486-6195-4822-9d3e-749b9672a54f admin admin] PATH_INFO: `/v3/users/ccacf70c44634787a8d35b5946fe435f` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:30.659332 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af59c486-6195-4822-9d3e-749b9672a54f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccacf70c44634787a8d35b5946fe435f)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:30.662683 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af59c486-6195-4822-9d3e-749b9672a54f admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:30.744861 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-af59c486-6195-4822-9d3e-749b9672a54f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccacf70c44634787a8d35b5946fe435f'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:30.745744 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-af59c486-6195-4822-9d3e-749b9672a54f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccacf70c44634787a8d35b5946fe435f'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:30.756530 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-af59c486-6195-4822-9d3e-749b9672a54f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccacf70c44634787a8d35b5946fe435f'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:30.779228 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-af59c486-6195-4822-9d3e-749b9672a54f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccacf70c44634787a8d35b5946fe435f'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:30.810089 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-af59c486-6195-4822-9d3e-749b9672a54f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccacf70c44634787a8d35b5946fe435f'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:30.838049 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1076/2123] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:04:30 2022] DELETE /identity/v3/users/ccacf70c44634787a8d35b5946fe435f => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:04:31.874038 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36a06d4-b8b3-4c28-92db-77587f10ebdb admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:31.875548 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-d36a06d4-b8b3-4c28-92db-77587f10ebdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:31.891014 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36a06d4-b8b3-4c28-92db-77587f10ebdb admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:32.039569 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9566a051-5191-469a-8f20-0e441ab9ba39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:32.040763 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9566a051-5191-469a-8f20-0e441ab9ba39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:32.041047 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9566a051-5191-469a-8f20-0e441ab9ba39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:32.041333 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9566a051-5191-469a-8f20-0e441ab9ba39 admin admin] PATH_INFO: `/v3/projects/31a31f2745d84a5d91c5e3bb5c4e2d1e` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:32.042506 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9566a051-5191-469a-8f20-0e441ab9ba39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31a31f2745d84a5d91c5e3bb5c4e2d1e)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:32.044800 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9566a051-5191-469a-8f20-0e441ab9ba39 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:32.108954 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:04:32.110006 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-9566a051-5191-469a-8f20-0e441ab9ba39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31a31f2745d84a5d91c5e3bb5c4e2d1e', 'request_id': 'req-9566a051-5191-469a-8f20-0e441ab9ba39'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:32.134495 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-9566a051-5191-469a-8f20-0e441ab9ba39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31a31f2745d84a5d91c5e3bb5c4e2d1e', 'request_id': 'req-9566a051-5191-469a-8f20-0e441ab9ba39'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:32.146015 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-9566a051-5191-469a-8f20-0e441ab9ba39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31a31f2745d84a5d91c5e3bb5c4e2d1e', 'request_id': 'req-9566a051-5191-469a-8f20-0e441ab9ba39'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:32.193927 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-9566a051-5191-469a-8f20-0e441ab9ba39 admin admin] The token cache is being invalidate because project 31a31f2745d84a5d91c5e3bb5c4e2d1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:04:32.194278 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-9566a051-5191-469a-8f20-0e441ab9ba39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:32.195003 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-9566a051-5191-469a-8f20-0e441ab9ba39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:32.196571 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1048/2124] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:04:31 2022] DELETE /identity/v3/projects/31a31f2745d84a5d91c5e3bb5c4e2d1e => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:04:32.206213 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47afb64a-1b02-4494-93a9-3065f124117f None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:32.207704 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47afb64a-1b02-4494-93a9-3065f124117f None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:32.208372 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47afb64a-1b02-4494-93a9-3065f124117f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:32.285833 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-47afb64a-1b02-4494-93a9-3065f124117f None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:04:32.287404 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-47afb64a-1b02-4494-93a9-3065f124117f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:32.407590 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1077/2125] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:04:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:04:32.416683 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f803bf49-9663-4fa0-9780-ec8bcaae0742 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:32.417026 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f803bf49-9663-4fa0-9780-ec8bcaae0742 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:32.417306 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f803bf49-9663-4fa0-9780-ec8bcaae0742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:32.449440 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-f803bf49-9663-4fa0-9780-ec8bcaae0742 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:04:32.451800 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-f803bf49-9663-4fa0-9780-ec8bcaae0742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:32.464916 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1049/2126] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:04:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:04:32.469284 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47afb64a-1b02-4494-93a9-3065f124117f None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:32.485327 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47afb64a-1b02-4494-93a9-3065f124117f None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:32.495239 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12671c9-e22c-46f8-ae86-628d1c5f5da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:32.497549 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12671c9-e22c-46f8-ae86-628d1c5f5da2 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:32.498113 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12671c9-e22c-46f8-ae86-628d1c5f5da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:32.498773 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12671c9-e22c-46f8-ae86-628d1c5f5da2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:32.500668 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12671c9-e22c-46f8-ae86-628d1c5f5da2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:04:32.501627 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12671c9-e22c-46f8-ae86-628d1c5f5da2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:32.505084 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12671c9-e22c-46f8-ae86-628d1c5f5da2 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:32.524749 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1078/2127] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Aug 18 11:04:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:04:32.528804 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f803bf49-9663-4fa0-9780-ec8bcaae0742 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:32.544239 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f803bf49-9663-4fa0-9780-ec8bcaae0742 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:32.560003 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7823f34-9b5e-4894-8d2f-49dcb752d9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:32.561077 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7823f34-9b5e-4894-8d2f-49dcb752d9e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:32.561497 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7823f34-9b5e-4894-8d2f-49dcb752d9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:32.561956 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7823f34-9b5e-4894-8d2f-49dcb752d9e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:32.562895 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7823f34-9b5e-4894-8d2f-49dcb752d9e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:32.565345 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7823f34-9b5e-4894-8d2f-49dcb752d9e6 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:32.607969 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1050/2128] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:04:32 2022] POST /identity/v3/projects => generated 371 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 11:04:32.611909 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12671c9-e22c-46f8-ae86-628d1c5f5da2 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:32.631698 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12671c9-e22c-46f8-ae86-628d1c5f5da2 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:32.639443 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:04:32.774772 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42aa5a1-a24d-491d-b9ce-0d9019a639f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:32.775480 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42aa5a1-a24d-491d-b9ce-0d9019a639f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:32.775823 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42aa5a1-a24d-491d-b9ce-0d9019a639f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:32.777728 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42aa5a1-a24d-491d-b9ce-0d9019a639f5 admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:32.778817 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42aa5a1-a24d-491d-b9ce-0d9019a639f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:32.785546 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42aa5a1-a24d-491d-b9ce-0d9019a639f5 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:32.884168 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1079/2129] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:04:32 2022] POST /identity/v3/users => generated 286 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:04:32.895000 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7823f34-9b5e-4894-8d2f-49dcb752d9e6 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:32.922444 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7823f34-9b5e-4894-8d2f-49dcb752d9e6 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:32.940490 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c744a-4962-45fe-8a15-e05f31e105eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:32.941702 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c744a-4962-45fe-8a15-e05f31e105eb admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:32.941978 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c744a-4962-45fe-8a15-e05f31e105eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:32.942249 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c744a-4962-45fe-8a15-e05f31e105eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:32.942906 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053c744a-4962-45fe-8a15-e05f31e105eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:32.945318 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053c744a-4962-45fe-8a15-e05f31e105eb admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:32.968058 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42aa5a1-a24d-491d-b9ce-0d9019a639f5 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:32.986813 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1051/2130] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:04:32 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:04:32.989343 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42aa5a1-a24d-491d-b9ce-0d9019a639f5 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:33.017265 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6624bce3-0dc4-423a-ae1d-dfdb2809049a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:33.017935 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624bce3-0dc4-423a-ae1d-dfdb2809049a admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:33.018216 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624bce3-0dc4-423a-ae1d-dfdb2809049a admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:33.018490 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624bce3-0dc4-423a-ae1d-dfdb2809049a admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:33.019725 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6624bce3-0dc4-423a-ae1d-dfdb2809049a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:33.036385 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6624bce3-0dc4-423a-ae1d-dfdb2809049a admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:33.057884 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1080/2131] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:04:32 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 11:04:33.062065 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c744a-4962-45fe-8a15-e05f31e105eb admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:33.077249 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c744a-4962-45fe-8a15-e05f31e105eb admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:33.096424 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4239d3b-947f-4d4d-9bf2-b29e304312fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:33.098288 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4239d3b-947f-4d4d-9bf2-b29e304312fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:33.099225 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4239d3b-947f-4d4d-9bf2-b29e304312fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:33.099918 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4239d3b-947f-4d4d-9bf2-b29e304312fd admin admin] PATH_INFO: `/v3/projects/de73affa93cf4fa8b772a8384280c2e3/users/3b0426b673ca444f8a99eb49e367a32d/roles/719e5c62188d4f8a838987d6e72ca8f7` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:33.120355 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4239d3b-947f-4d4d-9bf2-b29e304312fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=de73affa93cf4fa8b772a8384280c2e3, user_id=3b0426b673ca444f8a99eb49e367a32d, role_id=719e5c62188d4f8a838987d6e72ca8f7)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:33.123260 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4239d3b-947f-4d4d-9bf2-b29e304312fd admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:33.153737 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1052/2132] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:04:33 2022] PUT /identity/v3/projects/de73affa93cf4fa8b772a8384280c2e3/users/3b0426b673ca444f8a99eb49e367a32d/roles/719e5c62188d4f8a838987d6e72ca8f7 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:04:33.157299 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb590f3e-cd80-46ac-a249-1325eb56293d None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:33.158001 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb590f3e-cd80-46ac-a249-1325eb56293d None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:33.158639 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb590f3e-cd80-46ac-a249-1325eb56293d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:33.197401 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-bb590f3e-cd80-46ac-a249-1325eb56293d None None] MFA Rules not processed for user `3b0426b673ca444f8a99eb49e367a32d`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:04:33.199219 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-bb590f3e-cd80-46ac-a249-1325eb56293d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:33.296158 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1081/2133] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:04:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:04:33.308786 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4239d3b-947f-4d4d-9bf2-b29e304312fd admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:33.310827 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-a4239d3b-947f-4d4d-9bf2-b29e304312fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:33.423338 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4239d3b-947f-4d4d-9bf2-b29e304312fd admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:33.428933 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022f79fb-c1ef-4f3c-aa14-60b9272045f9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77211d2dcef242c4a7fe2198556d5efc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:33.430189 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022f79fb-c1ef-4f3c-aa14-60b9272045f9 service glance] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:33.430572 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022f79fb-c1ef-4f3c-aa14-60b9272045f9 service glance] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:33.430945 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022f79fb-c1ef-4f3c-aa14-60b9272045f9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:33.446434 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022f79fb-c1ef-4f3c-aa14-60b9272045f9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:33.451325 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022f79fb-c1ef-4f3c-aa14-60b9272045f9 service glance] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:33.499485 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1053/2134] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:04:33 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:04:33.930708 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b89151-a9ae-4184-9c46-007e3a16de03 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:33.931000 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b89151-a9ae-4184-9c46-007e3a16de03 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:33.931279 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b89151-a9ae-4184-9c46-007e3a16de03 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:33.933017 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1082/2135] 10.222.0.15 () {54 vars in 921 bytes} [Thu Aug 18 11:04:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:04:33.959150 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb3692-a9f3-4b30-b4a4-ee7d9bcc2dfa None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:33.960046 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb3692-a9f3-4b30-b4a4-ee7d9bcc2dfa None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:33.960473 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb3692-a9f3-4b30-b4a4-ee7d9bcc2dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:33.996705 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-9bfb3692-a9f3-4b30-b4a4-ee7d9bcc2dfa None None] MFA Rules not processed for user `0f918bcdd83d4d48be3fff5a48c54929`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:04:33.997996 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-9bfb3692-a9f3-4b30-b4a4-ee7d9bcc2dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:34.145111 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1054/2136] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Aug 18 11:04:33 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:04:34.164567 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b89151-a9ae-4184-9c46-007e3a16de03 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:34.170138 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-a7b89151-a9ae-4184-9c46-007e3a16de03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:34.181763 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfb3692-a9f3-4b30-b4a4-ee7d9bcc2dfa None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:34.183797 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-9bfb3692-a9f3-4b30-b4a4-ee7d9bcc2dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:34.230128 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfb3692-a9f3-4b30-b4a4-ee7d9bcc2dfa None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:34.242870 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0f98f8-e869-46b4-ae37-ee869c88acf8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f918bcdd83d4d48be3fff5a48c54929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:34.243758 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f98f8-e869-46b4-ae37-ee869c88acf8 service placement] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:34.244189 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f98f8-e869-46b4-ae37-ee869c88acf8 service placement] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:34.244725 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f98f8-e869-46b4-ae37-ee869c88acf8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:34.256803 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:04:34.265107 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0f98f8-e869-46b4-ae37-ee869c88acf8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:34.267023 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0f98f8-e869-46b4-ae37-ee869c88acf8 service placement] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:34.285724 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1055/2137] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:04:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:04:34.356714 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b89151-a9ae-4184-9c46-007e3a16de03 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:34.362076 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3c5820-a065-4f47-9a48-bdc32c09a8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:34.366133 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c5820-a065-4f47-9a48-bdc32c09a8a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:34.366735 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c5820-a065-4f47-9a48-bdc32c09a8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:34.368540 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c5820-a065-4f47-9a48-bdc32c09a8a7 admin admin] PATH_INFO: `/v3/users/10b548df8cdf40d4879efbd34563385e` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:34.370246 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3c5820-a065-4f47-9a48-bdc32c09a8a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10b548df8cdf40d4879efbd34563385e)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:34.372697 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3c5820-a065-4f47-9a48-bdc32c09a8a7 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:34.412630 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:04:34.510791 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-2f3c5820-a065-4f47-9a48-bdc32c09a8a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10b548df8cdf40d4879efbd34563385e'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:34.513070 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-2f3c5820-a065-4f47-9a48-bdc32c09a8a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10b548df8cdf40d4879efbd34563385e'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:34.537639 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-2f3c5820-a065-4f47-9a48-bdc32c09a8a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10b548df8cdf40d4879efbd34563385e'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:34.592106 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-2f3c5820-a065-4f47-9a48-bdc32c09a8a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10b548df8cdf40d4879efbd34563385e'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:34.614280 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-2f3c5820-a065-4f47-9a48-bdc32c09a8a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10b548df8cdf40d4879efbd34563385e'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:34.625142 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1083/2138] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:04:34 2022] DELETE /identity/v3/users/10b548df8cdf40d4879efbd34563385e => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:04:35.376870 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0f98f8-e869-46b4-ae37-ee869c88acf8 service placement] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:35.392661 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0f98f8-e869-46b4-ae37-ee869c88acf8 service placement] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:35.532223 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1df1be3-ffd4-43ce-8700-a481af7c2e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:35.535377 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1df1be3-ffd4-43ce-8700-a481af7c2e89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:35.535880 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1df1be3-ffd4-43ce-8700-a481af7c2e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:35.537245 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1df1be3-ffd4-43ce-8700-a481af7c2e89 admin admin] PATH_INFO: `/v3/projects/532114507c3e4c8e8d14dd3cfdd65c6a` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:35.554556 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1df1be3-ffd4-43ce-8700-a481af7c2e89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=532114507c3e4c8e8d14dd3cfdd65c6a)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:35.557130 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1df1be3-ffd4-43ce-8700-a481af7c2e89 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:35.654104 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-b1df1be3-ffd4-43ce-8700-a481af7c2e89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '532114507c3e4c8e8d14dd3cfdd65c6a', 'request_id': 'req-b1df1be3-ffd4-43ce-8700-a481af7c2e89'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:35.666885 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-b1df1be3-ffd4-43ce-8700-a481af7c2e89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '532114507c3e4c8e8d14dd3cfdd65c6a', 'request_id': 'req-b1df1be3-ffd4-43ce-8700-a481af7c2e89'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:35.677912 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-b1df1be3-ffd4-43ce-8700-a481af7c2e89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '532114507c3e4c8e8d14dd3cfdd65c6a', 'request_id': 'req-b1df1be3-ffd4-43ce-8700-a481af7c2e89'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:35.706640 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-b1df1be3-ffd4-43ce-8700-a481af7c2e89 admin admin] The token cache is being invalidate because project 532114507c3e4c8e8d14dd3cfdd65c6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:04:35.706896 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-b1df1be3-ffd4-43ce-8700-a481af7c2e89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:35.708074 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-b1df1be3-ffd4-43ce-8700-a481af7c2e89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:35.715606 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1056/2139] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:04:35 2022] DELETE /identity/v3/projects/532114507c3e4c8e8d14dd3cfdd65c6a => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:04:35.716316 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa00ad0-c94a-465f-89f5-7fc4be58bfc1 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:35.716811 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa00ad0-c94a-465f-89f5-7fc4be58bfc1 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:35.716890 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa00ad0-c94a-465f-89f5-7fc4be58bfc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:35.747788 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-daa00ad0-c94a-465f-89f5-7fc4be58bfc1 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:04:35.762140 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-daa00ad0-c94a-465f-89f5-7fc4be58bfc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:35.869563 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1084/2140] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:04:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:04:35.876995 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96afc02a-b467-40d9-9cb9-aa00e1ce0533 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:35.877338 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96afc02a-b467-40d9-9cb9-aa00e1ce0533 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:35.877661 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96afc02a-b467-40d9-9cb9-aa00e1ce0533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:35.903437 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-96afc02a-b467-40d9-9cb9-aa00e1ce0533 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:04:35.906676 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-96afc02a-b467-40d9-9cb9-aa00e1ce0533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:35.921405 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa00ad0-c94a-465f-89f5-7fc4be58bfc1 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:35.931449 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1057/2141] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:04:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:04:35.935086 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa00ad0-c94a-465f-89f5-7fc4be58bfc1 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:35.941462 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4295a0a-8c3d-4c05-82c7-82e66f4ba8f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:35.943002 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4295a0a-8c3d-4c05-82c7-82e66f4ba8f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:35.943299 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4295a0a-8c3d-4c05-82c7-82e66f4ba8f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:35.943920 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4295a0a-8c3d-4c05-82c7-82e66f4ba8f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:35.944957 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4295a0a-8c3d-4c05-82c7-82e66f4ba8f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:04:35.945142 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4295a0a-8c3d-4c05-82c7-82e66f4ba8f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:35.947101 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4295a0a-8c3d-4c05-82c7-82e66f4ba8f3 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:35.966125 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96afc02a-b467-40d9-9cb9-aa00e1ce0533 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:35.978722 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96afc02a-b467-40d9-9cb9-aa00e1ce0533 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:35.979440 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1085/2142] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Aug 18 11:04:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:04:35.984195 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cbc7b0-72b5-42c7-864b-551f327fc540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:35.984824 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cbc7b0-72b5-42c7-864b-551f327fc540 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:35.985107 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cbc7b0-72b5-42c7-864b-551f327fc540 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:35.985384 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cbc7b0-72b5-42c7-864b-551f327fc540 admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:35.998369 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cbc7b0-72b5-42c7-864b-551f327fc540 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:36.011662 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cbc7b0-72b5-42c7-864b-551f327fc540 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:36.095319 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4295a0a-8c3d-4c05-82c7-82e66f4ba8f3 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:36.105589 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1058/2143] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:04:35 2022] POST /identity/v3/projects => generated 387 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:04:36.108553 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4295a0a-8c3d-4c05-82c7-82e66f4ba8f3 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:36.282022 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5567b7fc-31db-47ea-9c9b-c9b9e2926958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:36.282659 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5567b7fc-31db-47ea-9c9b-c9b9e2926958 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:36.282942 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5567b7fc-31db-47ea-9c9b-c9b9e2926958 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:36.283216 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5567b7fc-31db-47ea-9c9b-c9b9e2926958 admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:36.283944 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5567b7fc-31db-47ea-9c9b-c9b9e2926958 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:36.287539 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5567b7fc-31db-47ea-9c9b-c9b9e2926958 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:36.326275 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cbc7b0-72b5-42c7-864b-551f327fc540 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:36.338735 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1086/2144] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:04:36 2022] POST /identity/v3/users => generated 294 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:04:36.345849 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cbc7b0-72b5-42c7-864b-551f327fc540 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:36.356486 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228bae62-52c4-46f2-a1e1-c4af54829812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:36.357825 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228bae62-52c4-46f2-a1e1-c4af54829812 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:36.358110 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228bae62-52c4-46f2-a1e1-c4af54829812 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:36.358393 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228bae62-52c4-46f2-a1e1-c4af54829812 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:36.359272 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228bae62-52c4-46f2-a1e1-c4af54829812 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:36.360729 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228bae62-52c4-46f2-a1e1-c4af54829812 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:36.382635 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1059/2145] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:04:36 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:04:36.383184 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5567b7fc-31db-47ea-9c9b-c9b9e2926958 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:36.399394 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5567b7fc-31db-47ea-9c9b-c9b9e2926958 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:36.405175 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30807365-dae8-440e-b7f6-5f9618009557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:36.406030 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30807365-dae8-440e-b7f6-5f9618009557 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:36.406663 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30807365-dae8-440e-b7f6-5f9618009557 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:36.406993 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30807365-dae8-440e-b7f6-5f9618009557 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:36.407784 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30807365-dae8-440e-b7f6-5f9618009557 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:36.410274 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30807365-dae8-440e-b7f6-5f9618009557 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:36.427041 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:04:36.442946 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1087/2146] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:04:36 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 11:04:36.445169 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228bae62-52c4-46f2-a1e1-c4af54829812 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:36.462826 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228bae62-52c4-46f2-a1e1-c4af54829812 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:36.467454 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812c4b86-e55a-48ca-ae66-6ac6883c97b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:36.468253 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812c4b86-e55a-48ca-ae66-6ac6883c97b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:36.468602 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812c4b86-e55a-48ca-ae66-6ac6883c97b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:36.468945 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812c4b86-e55a-48ca-ae66-6ac6883c97b1 admin admin] PATH_INFO: `/v3/projects/0012eb96613e4f1baaf1bc9493cc2145/users/22490d67f299423aad8f5d75a47a1808/roles/719e5c62188d4f8a838987d6e72ca8f7` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:36.494280 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812c4b86-e55a-48ca-ae66-6ac6883c97b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0012eb96613e4f1baaf1bc9493cc2145, user_id=22490d67f299423aad8f5d75a47a1808, role_id=719e5c62188d4f8a838987d6e72ca8f7)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:36.497065 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812c4b86-e55a-48ca-ae66-6ac6883c97b1 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:36.513836 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1060/2147] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:04:36 2022] PUT /identity/v3/projects/0012eb96613e4f1baaf1bc9493cc2145/users/22490d67f299423aad8f5d75a47a1808/roles/719e5c62188d4f8a838987d6e72ca8f7 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:04:36.526037 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf33b15-2946-448e-9848-226c6021323e None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:36.526395 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf33b15-2946-448e-9848-226c6021323e None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:36.526775 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf33b15-2946-448e-9848-226c6021323e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:36.574248 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-8bf33b15-2946-448e-9848-226c6021323e None None] MFA Rules not processed for user `22490d67f299423aad8f5d75a47a1808`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:04:36.575750 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-8bf33b15-2946-448e-9848-226c6021323e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:36.699933 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1088/2148] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:04:36 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:04:36.704785 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812c4b86-e55a-48ca-ae66-6ac6883c97b1 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:36.758245 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:04:36.828905 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812c4b86-e55a-48ca-ae66-6ac6883c97b1 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:36.836270 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858446cf-c83a-4ec1-b48e-66485e04ae97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:36.838115 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858446cf-c83a-4ec1-b48e-66485e04ae97 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:36.838726 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858446cf-c83a-4ec1-b48e-66485e04ae97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:36.839010 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858446cf-c83a-4ec1-b48e-66485e04ae97 admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:36.839840 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858446cf-c83a-4ec1-b48e-66485e04ae97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:36.841850 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858446cf-c83a-4ec1-b48e-66485e04ae97 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:36.873111 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1061/2149] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:04:36 2022] POST /identity/v3/projects => generated 387 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:04:36.877182 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf33b15-2946-448e-9848-226c6021323e None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:36.891629 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf33b15-2946-448e-9848-226c6021323e None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:36.966882 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daebbcc-7fa2-4bdf-92b1-637910b874bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:36.967552 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daebbcc-7fa2-4bdf-92b1-637910b874bd admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:36.967782 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daebbcc-7fa2-4bdf-92b1-637910b874bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:36.968056 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daebbcc-7fa2-4bdf-92b1-637910b874bd admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:36.968755 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daebbcc-7fa2-4bdf-92b1-637910b874bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:36.970663 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daebbcc-7fa2-4bdf-92b1-637910b874bd admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:36.999811 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1089/2150] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:04:36 2022] POST /identity/v3/users => generated 300 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 11:04:37.001050 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858446cf-c83a-4ec1-b48e-66485e04ae97 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:37.012927 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858446cf-c83a-4ec1-b48e-66485e04ae97 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:37.020109 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea4612e-3560-4da7-a9f6-082c9393aa17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:37.021625 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea4612e-3560-4da7-a9f6-082c9393aa17 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:37.021829 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea4612e-3560-4da7-a9f6-082c9393aa17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:37.022367 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea4612e-3560-4da7-a9f6-082c9393aa17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:37.027205 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea4612e-3560-4da7-a9f6-082c9393aa17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:37.027742 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea4612e-3560-4da7-a9f6-082c9393aa17 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:37.049568 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1062/2151] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:04:36 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:04:37.051230 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daebbcc-7fa2-4bdf-92b1-637910b874bd admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:37.065357 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daebbcc-7fa2-4bdf-92b1-637910b874bd admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:37.072377 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd6a9ae-0eb9-4772-a471-19ed5d45bfd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:37.073232 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd6a9ae-0eb9-4772-a471-19ed5d45bfd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:37.073642 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd6a9ae-0eb9-4772-a471-19ed5d45bfd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:37.074031 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd6a9ae-0eb9-4772-a471-19ed5d45bfd8 admin admin] PATH_INFO: `/v3/projects/33a2dbbbb9e8497ab3f0ef166bff4cab/users/038c38a1bdcb4cbcaff6dd1d26e60037/roles/127fdc7ef05b4e0b98a940b334e5fcab` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:37.097343 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd6a9ae-0eb9-4772-a471-19ed5d45bfd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33a2dbbbb9e8497ab3f0ef166bff4cab, user_id=038c38a1bdcb4cbcaff6dd1d26e60037, role_id=127fdc7ef05b4e0b98a940b334e5fcab)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:37.106139 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd6a9ae-0eb9-4772-a471-19ed5d45bfd8 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:37.138035 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1090/2152] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:04:37 2022] PUT /identity/v3/projects/33a2dbbbb9e8497ab3f0ef166bff4cab/users/038c38a1bdcb4cbcaff6dd1d26e60037/roles/127fdc7ef05b4e0b98a940b334e5fcab => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:04:37.141030 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea4612e-3560-4da7-a9f6-082c9393aa17 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:37.158619 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea4612e-3560-4da7-a9f6-082c9393aa17 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:37.283306 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc194ec6-cbe8-4dfc-a266-6c25147bbab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:37.283933 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc194ec6-cbe8-4dfc-a266-6c25147bbab1 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:37.284776 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc194ec6-cbe8-4dfc-a266-6c25147bbab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:37.285087 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc194ec6-cbe8-4dfc-a266-6c25147bbab1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:37.286375 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc194ec6-cbe8-4dfc-a266-6c25147bbab1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:37.288022 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc194ec6-cbe8-4dfc-a266-6c25147bbab1 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:37.314234 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1063/2153] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:04:37 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:04:37.318736 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd6a9ae-0eb9-4772-a471-19ed5d45bfd8 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:37.341283 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd6a9ae-0eb9-4772-a471-19ed5d45bfd8 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:37.352368 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e959ab-b9fe-46c3-b277-5383561fa5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:37.353171 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e959ab-b9fe-46c3-b277-5383561fa5e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:37.353655 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e959ab-b9fe-46c3-b277-5383561fa5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:37.354841 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e959ab-b9fe-46c3-b277-5383561fa5e6 admin admin] PATH_INFO: `/v3/projects/33a2dbbbb9e8497ab3f0ef166bff4cab/users/038c38a1bdcb4cbcaff6dd1d26e60037/roles/127fdc7ef05b4e0b98a940b334e5fcab` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:37.357098 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e959ab-b9fe-46c3-b277-5383561fa5e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33a2dbbbb9e8497ab3f0ef166bff4cab, user_id=038c38a1bdcb4cbcaff6dd1d26e60037, role_id=127fdc7ef05b4e0b98a940b334e5fcab)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:37.360912 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e959ab-b9fe-46c3-b277-5383561fa5e6 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:37.388110 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1091/2154] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:04:37 2022] PUT /identity/v3/projects/33a2dbbbb9e8497ab3f0ef166bff4cab/users/038c38a1bdcb4cbcaff6dd1d26e60037/roles/127fdc7ef05b4e0b98a940b334e5fcab => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:04:37.412867 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ebdb81-970f-410e-b9bc-5a639635d13f None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:37.413367 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ebdb81-970f-410e-b9bc-5a639635d13f None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:37.413832 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ebdb81-970f-410e-b9bc-5a639635d13f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:37.493595 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a7280f-6fc1-4ddb-8016-5ad08b1b6a84 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:37.494132 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a7280f-6fc1-4ddb-8016-5ad08b1b6a84 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:37.494664 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a7280f-6fc1-4ddb-8016-5ad08b1b6a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:37.504627 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-49ebdb81-970f-410e-b9bc-5a639635d13f None None] MFA Rules not processed for user `038c38a1bdcb4cbcaff6dd1d26e60037`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:04:37.508327 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-49ebdb81-970f-410e-b9bc-5a639635d13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:37.562253 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-90a7280f-6fc1-4ddb-8016-5ad08b1b6a84 None None] MFA Rules not processed for user `b6e7022d0e4c4b00b92f12a65963d9e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:04:37.563868 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-90a7280f-6fc1-4ddb-8016-5ad08b1b6a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:37.689268 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:04:37.781857 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1092/2155] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:04:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:04:37.791529 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a7280f-6fc1-4ddb-8016-5ad08b1b6a84 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:37.793282 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-90a7280f-6fc1-4ddb-8016-5ad08b1b6a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:37.810330 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1064/2156] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:04:37 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 409 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:04:37.821865 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ebdb81-970f-410e-b9bc-5a639635d13f None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:37.824414 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-49ebdb81-970f-410e-b9bc-5a639635d13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:37.862399 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:04:37.903717 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a7280f-6fc1-4ddb-8016-5ad08b1b6a84 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:37.910817 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c5bdfb-7172-4549-92c7-7807416a25db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:37.911663 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c5bdfb-7172-4549-92c7-7807416a25db admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:37.912426 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c5bdfb-7172-4549-92c7-7807416a25db admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:37.912426 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c5bdfb-7172-4549-92c7-7807416a25db admin admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:37.912937 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c5bdfb-7172-4549-92c7-7807416a25db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:37.915212 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c5bdfb-7172-4549-92c7-7807416a25db admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:37.933589 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ebdb81-970f-410e-b9bc-5a639635d13f None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:37.946201 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b60741-d479-464b-ba76-c560dc140970 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b8a09704b9b4ab2bffb813796ec6e77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:37.947216 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b60741-d479-464b-ba76-c560dc140970 service cinder] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:37.947697 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b60741-d479-464b-ba76-c560dc140970 service cinder] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:37.948167 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b60741-d479-464b-ba76-c560dc140970 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:37.957558 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1093/2157] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:04:37 2022] POST /identity/v3/projects => generated 371 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:04:37.962865 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c5bdfb-7172-4549-92c7-7807416a25db admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:37.974966 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b60741-d479-464b-ba76-c560dc140970 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:37.977148 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b60741-d479-464b-ba76-c560dc140970 service cinder] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:38.000822 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1065/2158] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:04:37 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 11:04:38.064678 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b60741-d479-464b-ba76-c560dc140970 service cinder] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:38.100689 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c5bdfb-7172-4549-92c7-7807416a25db admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:38.111386 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05be7be-739f-40b9-8409-077e0418b712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:38.112246 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05be7be-739f-40b9-8409-077e0418b712 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:38.113268 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05be7be-739f-40b9-8409-077e0418b712 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:38.113860 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05be7be-739f-40b9-8409-077e0418b712 admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:38.114419 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05be7be-739f-40b9-8409-077e0418b712 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:38.118204 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05be7be-739f-40b9-8409-077e0418b712 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:38.118940 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b60741-d479-464b-ba76-c560dc140970 service cinder] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:38.130360 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be61ac2-be50-4d1e-819f-0feec7be8fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:38.132068 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be61ac2-be50-4d1e-819f-0feec7be8fea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:38.132294 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be61ac2-be50-4d1e-819f-0feec7be8fea admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:38.132781 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be61ac2-be50-4d1e-819f-0feec7be8fea admin admin] PATH_INFO: `/v3/users/22490d67f299423aad8f5d75a47a1808` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:38.136097 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be61ac2-be50-4d1e-819f-0feec7be8fea admin admin] RBAC: Authorizing `identity:delete_user(user_id=22490d67f299423aad8f5d75a47a1808)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:38.146761 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be61ac2-be50-4d1e-819f-0feec7be8fea admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:38.163051 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1094/2159] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:04:37 2022] POST /identity/v3/users => generated 292 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:04:38.167164 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05be7be-739f-40b9-8409-077e0418b712 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:38.180368 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05be7be-739f-40b9-8409-077e0418b712 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:38.186063 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89b063d-3579-4ae4-ae45-d091e84395bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:38.186728 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b063d-3579-4ae4-ae45-d091e84395bf admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:38.187015 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b063d-3579-4ae4-ae45-d091e84395bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:38.187289 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b063d-3579-4ae4-ae45-d091e84395bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:38.188002 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89b063d-3579-4ae4-ae45-d091e84395bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:38.189890 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89b063d-3579-4ae4-ae45-d091e84395bf admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:38.233800 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-0be61ac2-be50-4d1e-819f-0feec7be8fea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22490d67f299423aad8f5d75a47a1808'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:38.238800 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1095/2160] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:04:38 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 11:04:38.239757 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89b063d-3579-4ae4-ae45-d091e84395bf admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:38.243549 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-0be61ac2-be50-4d1e-819f-0feec7be8fea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22490d67f299423aad8f5d75a47a1808'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:38.245912 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-0be61ac2-be50-4d1e-819f-0feec7be8fea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22490d67f299423aad8f5d75a47a1808'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:38.247039 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-0be61ac2-be50-4d1e-819f-0feec7be8fea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22490d67f299423aad8f5d75a47a1808'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:38.250373 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89b063d-3579-4ae4-ae45-d091e84395bf admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:38.256162 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5bd9e8-0558-4d3a-baba-1211ff906c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:38.257574 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5bd9e8-0558-4d3a-baba-1211ff906c89 admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:38.257574 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5bd9e8-0558-4d3a-baba-1211ff906c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:38.257574 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5bd9e8-0558-4d3a-baba-1211ff906c89 admin admin] PATH_INFO: `/v3/projects/686b7ea14bde4ccd9b9d88e8b930e1ac/users/d67b6b603ba545bea43921012cf08278/roles/127fdc7ef05b4e0b98a940b334e5fcab` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:38.265262 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-0be61ac2-be50-4d1e-819f-0feec7be8fea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22490d67f299423aad8f5d75a47a1808'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:38.299535 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5bd9e8-0558-4d3a-baba-1211ff906c89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=686b7ea14bde4ccd9b9d88e8b930e1ac, user_id=d67b6b603ba545bea43921012cf08278, role_id=127fdc7ef05b4e0b98a940b334e5fcab)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:38.305787 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5bd9e8-0558-4d3a-baba-1211ff906c89 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:38.315672 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1066/2161] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:04:38 2022] DELETE /identity/v3/users/22490d67f299423aad8f5d75a47a1808 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:04:38.319743 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b8df89-2c7f-44fe-858e-b7c25c86c236 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:38.320031 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b8df89-2c7f-44fe-858e-b7c25c86c236 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:38.320323 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b8df89-2c7f-44fe-858e-b7c25c86c236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:38.325003 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1096/2162] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:04:38 2022] PUT /identity/v3/projects/686b7ea14bde4ccd9b9d88e8b930e1ac/users/d67b6b603ba545bea43921012cf08278/roles/127fdc7ef05b4e0b98a940b334e5fcab => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:04:38.328736 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5bd9e8-0558-4d3a-baba-1211ff906c89 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:38.330529 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-ce5bd9e8-0558-4d3a-baba-1211ff906c89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:38.355960 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-57b8df89-2c7f-44fe-858e-b7c25c86c236 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:04:38.358252 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-57b8df89-2c7f-44fe-858e-b7c25c86c236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:38.358510 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:04:38.448062 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5bd9e8-0558-4d3a-baba-1211ff906c89 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:38.482164 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1067/2163] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:04:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:04:38.493583 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b8df89-2c7f-44fe-858e-b7c25c86c236 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:38.495305 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-57b8df89-2c7f-44fe-858e-b7c25c86c236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:38.540779 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034028b8-754f-4862-8d40-3432b9fa7feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:38.541529 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034028b8-754f-4862-8d40-3432b9fa7feb admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:38.542426 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034028b8-754f-4862-8d40-3432b9fa7feb admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:38.542426 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034028b8-754f-4862-8d40-3432b9fa7feb admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:38.543063 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034028b8-754f-4862-8d40-3432b9fa7feb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:38.544919 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034028b8-754f-4862-8d40-3432b9fa7feb admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:38.554718 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:04:38.577925 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1097/2164] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:04:38 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:04:38.579351 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034028b8-754f-4862-8d40-3432b9fa7feb admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:38.601282 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b8df89-2c7f-44fe-858e-b7c25c86c236 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:38.607124 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034028b8-754f-4862-8d40-3432b9fa7feb admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:38.607616 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46894387-c348-4edb-b6bf-68fed3fac8e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:38.608946 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46894387-c348-4edb-b6bf-68fed3fac8e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:38.610260 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46894387-c348-4edb-b6bf-68fed3fac8e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:38.611006 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46894387-c348-4edb-b6bf-68fed3fac8e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:38.619572 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02d9622-aa6a-4e68-8767-fd345bb6d42b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:38.621585 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02d9622-aa6a-4e68-8767-fd345bb6d42b admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:38.623394 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02d9622-aa6a-4e68-8767-fd345bb6d42b admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:38.624836 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02d9622-aa6a-4e68-8767-fd345bb6d42b admin admin] PATH_INFO: `/v3/projects/686b7ea14bde4ccd9b9d88e8b930e1ac/users/d67b6b603ba545bea43921012cf08278/roles/127fdc7ef05b4e0b98a940b334e5fcab` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:38.626469 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46894387-c348-4edb-b6bf-68fed3fac8e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:38.629389 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46894387-c348-4edb-b6bf-68fed3fac8e2 service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:38.629886 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02d9622-aa6a-4e68-8767-fd345bb6d42b admin admin] RBAC: Authorizing `identity:create_grant(project_id=686b7ea14bde4ccd9b9d88e8b930e1ac, user_id=d67b6b603ba545bea43921012cf08278, role_id=127fdc7ef05b4e0b98a940b334e5fcab)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:38.635561 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02d9622-aa6a-4e68-8767-fd345bb6d42b admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:38.651824 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1068/2165] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:04:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:04:38.668355 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1098/2166] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:04:38 2022] PUT /identity/v3/projects/686b7ea14bde4ccd9b9d88e8b930e1ac/users/d67b6b603ba545bea43921012cf08278/roles/127fdc7ef05b4e0b98a940b334e5fcab => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:04:38.951123 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46894387-c348-4edb-b6bf-68fed3fac8e2 service neutron] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:38.954543 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-46894387-c348-4edb-b6bf-68fed3fac8e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:39.001555 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46894387-c348-4edb-b6bf-68fed3fac8e2 service neutron] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:39.197019 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88329d7-3728-4811-8bac-6beabc1b3f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:39.197948 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88329d7-3728-4811-8bac-6beabc1b3f13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:39.198284 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88329d7-3728-4811-8bac-6beabc1b3f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:39.198610 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88329d7-3728-4811-8bac-6beabc1b3f13 admin admin] PATH_INFO: `/v3/users/16feab74dce6418495006f9835060be6` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:39.213117 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88329d7-3728-4811-8bac-6beabc1b3f13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16feab74dce6418495006f9835060be6)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:39.224862 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88329d7-3728-4811-8bac-6beabc1b3f13 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:39.319346 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-b88329d7-3728-4811-8bac-6beabc1b3f13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16feab74dce6418495006f9835060be6'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:39.332247 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-b88329d7-3728-4811-8bac-6beabc1b3f13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16feab74dce6418495006f9835060be6'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:39.333017 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-b88329d7-3728-4811-8bac-6beabc1b3f13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16feab74dce6418495006f9835060be6'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:39.333756 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-b88329d7-3728-4811-8bac-6beabc1b3f13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16feab74dce6418495006f9835060be6'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:39.343751 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-b88329d7-3728-4811-8bac-6beabc1b3f13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16feab74dce6418495006f9835060be6'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:39.365176 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1069/2167] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:04:38 2022] DELETE /identity/v3/users/16feab74dce6418495006f9835060be6 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:04:39.540612 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02d9622-aa6a-4e68-8767-fd345bb6d42b admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:39.543422 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-b02d9622-aa6a-4e68-8767-fd345bb6d42b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:39.598056 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02d9622-aa6a-4e68-8767-fd345bb6d42b admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:39.698111 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88329d7-3728-4811-8bac-6beabc1b3f13 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:39.700934 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-b88329d7-3728-4811-8bac-6beabc1b3f13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:39.751496 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b50fda-67e8-417c-acc7-ed63fa183987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:39.752439 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b50fda-67e8-417c-acc7-ed63fa183987 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:39.752968 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b50fda-67e8-417c-acc7-ed63fa183987 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:39.755011 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b50fda-67e8-417c-acc7-ed63fa183987 admin admin] PATH_INFO: `/v3/projects/0012eb96613e4f1baaf1bc9493cc2145` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:39.756750 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b50fda-67e8-417c-acc7-ed63fa183987 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0012eb96613e4f1baaf1bc9493cc2145)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:39.759827 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b50fda-67e8-417c-acc7-ed63fa183987 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:39.787329 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:04:39.813088 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88329d7-3728-4811-8bac-6beabc1b3f13 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:39.819733 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d66b06-9ba4-42bb-b46b-5c35c045785d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:39.820375 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d66b06-9ba4-42bb-b46b-5c35c045785d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:39.820656 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d66b06-9ba4-42bb-b46b-5c35c045785d admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:39.820928 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d66b06-9ba4-42bb-b46b-5c35c045785d admin admin] PATH_INFO: `/v3/projects/ec9579dfc10347188154c7599fcdba54` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:39.822553 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d66b06-9ba4-42bb-b46b-5c35c045785d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec9579dfc10347188154c7599fcdba54)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:39.825598 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d66b06-9ba4-42bb-b46b-5c35c045785d admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:39.883970 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:04:39.889477 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-b0b50fda-67e8-417c-acc7-ed63fa183987 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0012eb96613e4f1baaf1bc9493cc2145', 'request_id': 'req-b0b50fda-67e8-417c-acc7-ed63fa183987'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:39.903672 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-b0b50fda-67e8-417c-acc7-ed63fa183987 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0012eb96613e4f1baaf1bc9493cc2145', 'request_id': 'req-b0b50fda-67e8-417c-acc7-ed63fa183987'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:39.910190 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-21d66b06-9ba4-42bb-b46b-5c35c045785d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec9579dfc10347188154c7599fcdba54', 'request_id': 'req-21d66b06-9ba4-42bb-b46b-5c35c045785d'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:39.914274 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-b0b50fda-67e8-417c-acc7-ed63fa183987 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0012eb96613e4f1baaf1bc9493cc2145', 'request_id': 'req-b0b50fda-67e8-417c-acc7-ed63fa183987'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:39.923192 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-21d66b06-9ba4-42bb-b46b-5c35c045785d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec9579dfc10347188154c7599fcdba54', 'request_id': 'req-21d66b06-9ba4-42bb-b46b-5c35c045785d'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:39.935347 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-b0b50fda-67e8-417c-acc7-ed63fa183987 admin admin] The token cache is being invalidate because project 0012eb96613e4f1baaf1bc9493cc2145 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:04:39.935890 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-b0b50fda-67e8-417c-acc7-ed63fa183987 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:39.936594 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-b0b50fda-67e8-417c-acc7-ed63fa183987 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:39.941356 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1099/2168] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:04:39 2022] DELETE /identity/v3/projects/0012eb96613e4f1baaf1bc9493cc2145 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:04:39.943176 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b50fda-67e8-417c-acc7-ed63fa183987 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:39.944719 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-b0b50fda-67e8-417c-acc7-ed63fa183987 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:39.947039 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-21d66b06-9ba4-42bb-b46b-5c35c045785d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec9579dfc10347188154c7599fcdba54', 'request_id': 'req-21d66b06-9ba4-42bb-b46b-5c35c045785d'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:39.965796 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-21d66b06-9ba4-42bb-b46b-5c35c045785d admin admin] The token cache is being invalidate because project ec9579dfc10347188154c7599fcdba54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:04:39.966137 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-21d66b06-9ba4-42bb-b46b-5c35c045785d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:39.966836 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-21d66b06-9ba4-42bb-b46b-5c35c045785d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:39.968608 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1070/2169] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:04:39 2022] DELETE /identity/v3/projects/ec9579dfc10347188154c7599fcdba54 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:04:39.973024 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d66b06-9ba4-42bb-b46b-5c35c045785d admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:39.974437 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-21d66b06-9ba4-42bb-b46b-5c35c045785d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:40.110715 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d66b06-9ba4-42bb-b46b-5c35c045785d admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:40.113080 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b50fda-67e8-417c-acc7-ed63fa183987 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:40.118399 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90db1837-4ae1-4adb-8743-2e9ab00c70f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:40.119383 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db1837-4ae1-4adb-8743-2e9ab00c70f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:40.119810 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db1837-4ae1-4adb-8743-2e9ab00c70f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:40.120348 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db1837-4ae1-4adb-8743-2e9ab00c70f2 admin admin] PATH_INFO: `/v3/users/715fc63367fb4dfea476f26aeee55c05` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:40.121958 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90db1837-4ae1-4adb-8743-2e9ab00c70f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=715fc63367fb4dfea476f26aeee55c05)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:40.125702 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90db1837-4ae1-4adb-8743-2e9ab00c70f2 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:40.133059 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cf84fd-a3d0-4dd2-9584-65949d9e3ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:40.134353 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cf84fd-a3d0-4dd2-9584-65949d9e3ffd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:40.134353 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cf84fd-a3d0-4dd2-9584-65949d9e3ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:40.134561 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cf84fd-a3d0-4dd2-9584-65949d9e3ffd admin admin] PATH_INFO: `/v3/users/038c38a1bdcb4cbcaff6dd1d26e60037` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:40.135751 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cf84fd-a3d0-4dd2-9584-65949d9e3ffd admin admin] RBAC: Authorizing `identity:delete_user(user_id=038c38a1bdcb4cbcaff6dd1d26e60037)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:40.137786 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cf84fd-a3d0-4dd2-9584-65949d9e3ffd admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:40.209263 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-90db1837-4ae1-4adb-8743-2e9ab00c70f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '715fc63367fb4dfea476f26aeee55c05'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:40.220519 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-90db1837-4ae1-4adb-8743-2e9ab00c70f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '715fc63367fb4dfea476f26aeee55c05'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:40.222611 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-90db1837-4ae1-4adb-8743-2e9ab00c70f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '715fc63367fb4dfea476f26aeee55c05'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:40.226783 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-90db1837-4ae1-4adb-8743-2e9ab00c70f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '715fc63367fb4dfea476f26aeee55c05'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:40.247330 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-79cf84fd-a3d0-4dd2-9584-65949d9e3ffd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '038c38a1bdcb4cbcaff6dd1d26e60037'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:40.248093 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-79cf84fd-a3d0-4dd2-9584-65949d9e3ffd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '038c38a1bdcb4cbcaff6dd1d26e60037'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:40.256679 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-90db1837-4ae1-4adb-8743-2e9ab00c70f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '715fc63367fb4dfea476f26aeee55c05'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:40.269591 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-79cf84fd-a3d0-4dd2-9584-65949d9e3ffd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '038c38a1bdcb4cbcaff6dd1d26e60037'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:40.292136 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1071/2170] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:04:39 2022] DELETE /identity/v3/users/715fc63367fb4dfea476f26aeee55c05 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:04:40.299465 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-79cf84fd-a3d0-4dd2-9584-65949d9e3ffd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '038c38a1bdcb4cbcaff6dd1d26e60037'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:40.309932 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-79cf84fd-a3d0-4dd2-9584-65949d9e3ffd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '038c38a1bdcb4cbcaff6dd1d26e60037'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:40.321075 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1100/2171] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:04:39 2022] DELETE /identity/v3/users/038c38a1bdcb4cbcaff6dd1d26e60037 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:04:41.435431 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90db1837-4ae1-4adb-8743-2e9ab00c70f2 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:41.437719 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-90db1837-4ae1-4adb-8743-2e9ab00c70f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:41.454733 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:04:41.556029 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cf84fd-a3d0-4dd2-9584-65949d9e3ffd admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:41.558332 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-79cf84fd-a3d0-4dd2-9584-65949d9e3ffd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:41.606380 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90db1837-4ae1-4adb-8743-2e9ab00c70f2 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:41.724542 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:04:41.748626 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cf84fd-a3d0-4dd2-9584-65949d9e3ffd admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:41.756983 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9753a33b-2921-4d89-90c0-f4d2136b7fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:41.757671 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9753a33b-2921-4d89-90c0-f4d2136b7fdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:41.757951 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9753a33b-2921-4d89-90c0-f4d2136b7fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:41.758287 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9753a33b-2921-4d89-90c0-f4d2136b7fdb admin admin] PATH_INFO: `/v3/projects/33a2dbbbb9e8497ab3f0ef166bff4cab` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:41.763035 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9753a33b-2921-4d89-90c0-f4d2136b7fdb admin admin] RBAC: Authorizing `identity:delete_project(project_id=33a2dbbbb9e8497ab3f0ef166bff4cab)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:41.764967 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9753a33b-2921-4d89-90c0-f4d2136b7fdb admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:41.769143 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e6636d-e364-446d-8be3-3ce86671df7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:41.769972 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6636d-e364-446d-8be3-3ce86671df7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:41.770249 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6636d-e364-446d-8be3-3ce86671df7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:41.770520 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6636d-e364-446d-8be3-3ce86671df7e admin admin] PATH_INFO: `/v3/projects/958507b88d424ad78a6bf13152788558` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:41.772314 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e6636d-e364-446d-8be3-3ce86671df7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=958507b88d424ad78a6bf13152788558)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:41.774338 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e6636d-e364-446d-8be3-3ce86671df7e admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:41.850633 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-a5e6636d-e364-446d-8be3-3ce86671df7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '958507b88d424ad78a6bf13152788558', 'request_id': 'req-a5e6636d-e364-446d-8be3-3ce86671df7e'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:41.859494 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-9753a33b-2921-4d89-90c0-f4d2136b7fdb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33a2dbbbb9e8497ab3f0ef166bff4cab', 'request_id': 'req-9753a33b-2921-4d89-90c0-f4d2136b7fdb'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:41.869306 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-a5e6636d-e364-446d-8be3-3ce86671df7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '958507b88d424ad78a6bf13152788558', 'request_id': 'req-a5e6636d-e364-446d-8be3-3ce86671df7e'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:41.878148 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-9753a33b-2921-4d89-90c0-f4d2136b7fdb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33a2dbbbb9e8497ab3f0ef166bff4cab', 'request_id': 'req-9753a33b-2921-4d89-90c0-f4d2136b7fdb'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:41.884909 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-a5e6636d-e364-446d-8be3-3ce86671df7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '958507b88d424ad78a6bf13152788558', 'request_id': 'req-a5e6636d-e364-446d-8be3-3ce86671df7e'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:41.886140 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-9753a33b-2921-4d89-90c0-f4d2136b7fdb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33a2dbbbb9e8497ab3f0ef166bff4cab', 'request_id': 'req-9753a33b-2921-4d89-90c0-f4d2136b7fdb'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:41.906158 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-a5e6636d-e364-446d-8be3-3ce86671df7e admin admin] The token cache is being invalidate because project 958507b88d424ad78a6bf13152788558 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:04:41.906707 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-a5e6636d-e364-446d-8be3-3ce86671df7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:41.909358 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-a5e6636d-e364-446d-8be3-3ce86671df7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:41.909787 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-9753a33b-2921-4d89-90c0-f4d2136b7fdb admin admin] The token cache is being invalidate because project 33a2dbbbb9e8497ab3f0ef166bff4cab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:04:41.910407 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-9753a33b-2921-4d89-90c0-f4d2136b7fdb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:41.911147 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-9753a33b-2921-4d89-90c0-f4d2136b7fdb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:41.912499 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1072/2172] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:04:41 2022] DELETE /identity/v3/projects/958507b88d424ad78a6bf13152788558 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:04:41.917792 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795015bc-b464-4845-b86f-460b0d7884ab None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:41.918534 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795015bc-b464-4845-b86f-460b0d7884ab None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:41.918953 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795015bc-b464-4845-b86f-460b0d7884ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:41.930078 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1101/2173] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:04:41 2022] DELETE /identity/v3/projects/33a2dbbbb9e8497ab3f0ef166bff4cab => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:04:41.931932 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a745eb-9493-4f6f-9da6-29a26b9ece18 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:41.932430 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a745eb-9493-4f6f-9da6-29a26b9ece18 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:41.932920 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a745eb-9493-4f6f-9da6-29a26b9ece18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:41.949592 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-795015bc-b464-4845-b86f-460b0d7884ab None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:04:41.951480 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-795015bc-b464-4845-b86f-460b0d7884ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:41.961181 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-e4a745eb-9493-4f6f-9da6-29a26b9ece18 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:04:41.962916 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-e4a745eb-9493-4f6f-9da6-29a26b9ece18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:42.003259 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:04:42.037640 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1073/2174] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:04:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:04:42.057106 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6dec78-28ab-42ec-af1e-2d512bffff0a None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:42.057447 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6dec78-28ab-42ec-af1e-2d512bffff0a None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:42.057725 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6dec78-28ab-42ec-af1e-2d512bffff0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:42.084535 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1102/2175] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:04:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:04:42.086366 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c39c3e-f0ce-44e0-86ed-cef49f90ad99 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:42.086830 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c39c3e-f0ce-44e0-86ed-cef49f90ad99 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:42.087307 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c39c3e-f0ce-44e0-86ed-cef49f90ad99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:42.101388 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-0d6dec78-28ab-42ec-af1e-2d512bffff0a None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:04:42.103919 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-0d6dec78-28ab-42ec-af1e-2d512bffff0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:42.127138 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-b3c39c3e-f0ce-44e0-86ed-cef49f90ad99 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:04:42.128768 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-b3c39c3e-f0ce-44e0-86ed-cef49f90ad99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:42.148457 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1074/2176] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:04:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:04:42.155725 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1103/2177] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:04:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:04:42.156039 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6dec78-28ab-42ec-af1e-2d512bffff0a None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:42.157892 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c39c3e-f0ce-44e0-86ed-cef49f90ad99 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:42.186709 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c39c3e-f0ce-44e0-86ed-cef49f90ad99 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:42.187266 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6dec78-28ab-42ec-af1e-2d512bffff0a None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:42.200267 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed001629-4998-4c05-b49b-cffc217240be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:42.200896 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed001629-4998-4c05-b49b-cffc217240be admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:42.201169 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed001629-4998-4c05-b49b-cffc217240be admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:42.201437 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed001629-4998-4c05-b49b-cffc217240be admin admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:42.202149 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed001629-4998-4c05-b49b-cffc217240be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:04:42.203111 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed001629-4998-4c05-b49b-cffc217240be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:42.207243 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dcbc3e-67a5-4c79-a063-df35b25b386c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:42.207864 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dcbc3e-67a5-4c79-a063-df35b25b386c admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:42.208172 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dcbc3e-67a5-4c79-a063-df35b25b386c admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:42.208450 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dcbc3e-67a5-4c79-a063-df35b25b386c admin admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:42.209252 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dcbc3e-67a5-4c79-a063-df35b25b386c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:04:42.209681 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dcbc3e-67a5-4c79-a063-df35b25b386c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:42.211909 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dcbc3e-67a5-4c79-a063-df35b25b386c admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:42.235341 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed001629-4998-4c05-b49b-cffc217240be admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:42.253117 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1075/2178] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Aug 18 11:04:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:04:42.254589 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dcbc3e-67a5-4c79-a063-df35b25b386c admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:42.266374 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1104/2179] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Aug 18 11:04:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:04:42.268457 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed001629-4998-4c05-b49b-cffc217240be admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:42.276303 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dcbc3e-67a5-4c79-a063-df35b25b386c admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:42.297113 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dbec0f-2992-4810-9ad2-bb63a131848f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:42.300719 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dbec0f-2992-4810-9ad2-bb63a131848f admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:42.301174 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dbec0f-2992-4810-9ad2-bb63a131848f admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:42.301486 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dbec0f-2992-4810-9ad2-bb63a131848f admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:42.305695 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed001629-4998-4c05-b49b-cffc217240be admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:42.309432 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dbec0f-2992-4810-9ad2-bb63a131848f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:42.311484 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dbec0f-2992-4810-9ad2-bb63a131848f admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:42.320737 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1083f1c8-e48d-4137-9185-e9a1b0fd55ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:42.321612 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1083f1c8-e48d-4137-9185-e9a1b0fd55ca admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:42.322078 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1083f1c8-e48d-4137-9185-e9a1b0fd55ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:42.322535 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1083f1c8-e48d-4137-9185-e9a1b0fd55ca admin admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:42.326015 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1083f1c8-e48d-4137-9185-e9a1b0fd55ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:42.328248 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1083f1c8-e48d-4137-9185-e9a1b0fd55ca admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:42.359072 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1076/2180] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:04:42 2022] POST /identity/v3/projects => generated 377 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 11:04:42.365019 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dbec0f-2992-4810-9ad2-bb63a131848f admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:42.403092 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1105/2181] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:04:42 2022] POST /identity/v3/projects => generated 385 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:04:42.407130 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1083f1c8-e48d-4137-9185-e9a1b0fd55ca admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:42.510743 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:04:42.544776 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dbec0f-2992-4810-9ad2-bb63a131848f admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:42.556387 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1083f1c8-e48d-4137-9185-e9a1b0fd55ca admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:42.562248 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d46ebe-ab25-417d-a4f8-dc6403e26bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:42.562990 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d46ebe-ab25-417d-a4f8-dc6403e26bd8 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:42.563391 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d46ebe-ab25-417d-a4f8-dc6403e26bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:42.563789 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d46ebe-ab25-417d-a4f8-dc6403e26bd8 admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:42.564492 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d46ebe-ab25-417d-a4f8-dc6403e26bd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:42.567260 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d46ebe-ab25-417d-a4f8-dc6403e26bd8 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:42.572068 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f5a774-c82b-47a5-a027-2c32fa250d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:42.572701 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f5a774-c82b-47a5-a027-2c32fa250d3c admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:42.572973 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f5a774-c82b-47a5-a027-2c32fa250d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:42.573255 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f5a774-c82b-47a5-a027-2c32fa250d3c admin admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:42.574315 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f5a774-c82b-47a5-a027-2c32fa250d3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:42.576253 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f5a774-c82b-47a5-a027-2c32fa250d3c admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:42.618843 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1106/2182] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:04:42 2022] POST /identity/v3/users => generated 293 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:04:42.623569 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d46ebe-ab25-417d-a4f8-dc6403e26bd8 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:42.626587 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1077/2183] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:04:42 2022] POST /identity/v3/users => generated 289 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:04:42.632281 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f5a774-c82b-47a5-a027-2c32fa250d3c admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:42.663242 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f5a774-c82b-47a5-a027-2c32fa250d3c admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:42.670585 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d46ebe-ab25-417d-a4f8-dc6403e26bd8 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:42.672276 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ede89d6-0fec-47b2-884c-35e7e528a8b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:42.672969 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede89d6-0fec-47b2-884c-35e7e528a8b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:42.673258 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede89d6-0fec-47b2-884c-35e7e528a8b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:42.673613 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede89d6-0fec-47b2-884c-35e7e528a8b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:42.674283 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ede89d6-0fec-47b2-884c-35e7e528a8b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:42.676342 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ede89d6-0fec-47b2-884c-35e7e528a8b1 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:42.693282 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9965f7f-f236-45f7-810a-bace4a015cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:42.696719 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1078/2184] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:04:42 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:04:42.696851 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9965f7f-f236-45f7-810a-bace4a015cc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:42.696851 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9965f7f-f236-45f7-810a-bace4a015cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:42.696851 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9965f7f-f236-45f7-810a-bace4a015cc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:42.696851 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9965f7f-f236-45f7-810a-bace4a015cc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:42.708616 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9965f7f-f236-45f7-810a-bace4a015cc1 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:42.712650 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ede89d6-0fec-47b2-884c-35e7e528a8b1 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:42.748088 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ede89d6-0fec-47b2-884c-35e7e528a8b1 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:42.764694 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db4b600-dc71-445b-ab8e-dfb8a80f4666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:42.765338 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4b600-dc71-445b-ab8e-dfb8a80f4666 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:42.765646 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4b600-dc71-445b-ab8e-dfb8a80f4666 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:42.765919 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4b600-dc71-445b-ab8e-dfb8a80f4666 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:42.766580 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db4b600-dc71-445b-ab8e-dfb8a80f4666 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:42.771249 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db4b600-dc71-445b-ab8e-dfb8a80f4666 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:42.773469 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1107/2185] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:04:42 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:04:42.780316 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9965f7f-f236-45f7-810a-bace4a015cc1 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:42.849573 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9965f7f-f236-45f7-810a-bace4a015cc1 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:42.865492 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1079/2186] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:04:42 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:04:42.872432 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db4b600-dc71-445b-ab8e-dfb8a80f4666 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:42.872594 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d551ab6-ba1b-444e-9c0d-99c88359dc8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:42.873643 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d551ab6-ba1b-444e-9c0d-99c88359dc8f admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:42.874095 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d551ab6-ba1b-444e-9c0d-99c88359dc8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:42.875947 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d551ab6-ba1b-444e-9c0d-99c88359dc8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:42.876850 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d551ab6-ba1b-444e-9c0d-99c88359dc8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:42.879820 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d551ab6-ba1b-444e-9c0d-99c88359dc8f admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:42.889661 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db4b600-dc71-445b-ab8e-dfb8a80f4666 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:42.900112 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1108/2187] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:04:42 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:04:42.903352 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d551ab6-ba1b-444e-9c0d-99c88359dc8f admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:42.919957 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d551ab6-ba1b-444e-9c0d-99c88359dc8f admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:42.920862 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61962e9f-9e0c-4367-b041-b4e6df38b123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:42.921655 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61962e9f-9e0c-4367-b041-b4e6df38b123 admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:42.921906 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61962e9f-9e0c-4367-b041-b4e6df38b123 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:42.922190 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61962e9f-9e0c-4367-b041-b4e6df38b123 admin admin] PATH_INFO: `/v3/projects/ba33e53a114d416aabdaf10df635234e/users/3863d0bcec574ad8ba0f88dbe8a91bbd/roles/719e5c62188d4f8a838987d6e72ca8f7` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:42.940928 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e344468-0d3c-442a-8784-65fd76acbb4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:42.941639 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e344468-0d3c-442a-8784-65fd76acbb4e admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:42.942484 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e344468-0d3c-442a-8784-65fd76acbb4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:42.942777 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e344468-0d3c-442a-8784-65fd76acbb4e admin admin] PATH_INFO: `/v3/projects/cf8aec43a7344c108477f07ef61484bc/users/2985b0743b554910b1e9ade5bc4fe369/roles/719e5c62188d4f8a838987d6e72ca8f7` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:42.970392 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61962e9f-9e0c-4367-b041-b4e6df38b123 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba33e53a114d416aabdaf10df635234e, user_id=3863d0bcec574ad8ba0f88dbe8a91bbd, role_id=719e5c62188d4f8a838987d6e72ca8f7)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:42.974807 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61962e9f-9e0c-4367-b041-b4e6df38b123 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:42.982227 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e344468-0d3c-442a-8784-65fd76acbb4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf8aec43a7344c108477f07ef61484bc, user_id=2985b0743b554910b1e9ade5bc4fe369, role_id=719e5c62188d4f8a838987d6e72ca8f7)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:42.986824 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e344468-0d3c-442a-8784-65fd76acbb4e admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:43.005572 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1080/2188] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:04:42 2022] PUT /identity/v3/projects/ba33e53a114d416aabdaf10df635234e/users/3863d0bcec574ad8ba0f88dbe8a91bbd/roles/719e5c62188d4f8a838987d6e72ca8f7 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:04:43.016588 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baf5357-7b4d-4a53-aee6-22d247926d63 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:43.016875 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baf5357-7b4d-4a53-aee6-22d247926d63 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:43.017150 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baf5357-7b4d-4a53-aee6-22d247926d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:43.019469 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1109/2189] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:04:42 2022] PUT /identity/v3/projects/cf8aec43a7344c108477f07ef61484bc/users/2985b0743b554910b1e9ade5bc4fe369/roles/719e5c62188d4f8a838987d6e72ca8f7 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:04:43.033301 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b0eaf7-c4ed-4b31-a625-eeb55c252a7e None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:43.034023 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b0eaf7-c4ed-4b31-a625-eeb55c252a7e None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:43.034974 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b0eaf7-c4ed-4b31-a625-eeb55c252a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:43.069918 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-7baf5357-7b4d-4a53-aee6-22d247926d63 None None] MFA Rules not processed for user `3863d0bcec574ad8ba0f88dbe8a91bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:04:43.071283 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-7baf5357-7b4d-4a53-aee6-22d247926d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:43.097471 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-e5b0eaf7-c4ed-4b31-a625-eeb55c252a7e None None] MFA Rules not processed for user `2985b0743b554910b1e9ade5bc4fe369`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:04:43.102822 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-e5b0eaf7-c4ed-4b31-a625-eeb55c252a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:43.133130 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:04:43.238143 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1081/2190] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:04:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:04:43.259799 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baf5357-7b4d-4a53-aee6-22d247926d63 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:43.263210 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-7baf5357-7b4d-4a53-aee6-22d247926d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:43.369620 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1110/2191] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:04:43 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:04:43.370518 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b0eaf7-c4ed-4b31-a625-eeb55c252a7e None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:43.476344 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baf5357-7b4d-4a53-aee6-22d247926d63 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:43.481358 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644c2a48-0ee5-4b0c-a8cd-6ecce1a49098 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77211d2dcef242c4a7fe2198556d5efc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:43.482825 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c2a48-0ee5-4b0c-a8cd-6ecce1a49098 service glance] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:43.483141 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c2a48-0ee5-4b0c-a8cd-6ecce1a49098 service glance] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:43.483818 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c2a48-0ee5-4b0c-a8cd-6ecce1a49098 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:43.506504 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644c2a48-0ee5-4b0c-a8cd-6ecce1a49098 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:43.508639 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644c2a48-0ee5-4b0c-a8cd-6ecce1a49098 service glance] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:43.524891 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b0eaf7-c4ed-4b31-a625-eeb55c252a7e None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:43.529982 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1082/2192] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:04:43 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:04:43.538261 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fca5ba6-a03e-4303-acf7-e8feb0dce80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:43.538899 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fca5ba6-a03e-4303-acf7-e8feb0dce80f admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:43.539179 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fca5ba6-a03e-4303-acf7-e8feb0dce80f admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:43.539453 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fca5ba6-a03e-4303-acf7-e8feb0dce80f admin admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:43.540359 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fca5ba6-a03e-4303-acf7-e8feb0dce80f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:43.544531 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fca5ba6-a03e-4303-acf7-e8feb0dce80f admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:43.600963 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:04:43.617806 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1111/2193] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:04:43 2022] POST /identity/v3/projects => generated 385 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:04:43.622481 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644c2a48-0ee5-4b0c-a8cd-6ecce1a49098 service glance] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:43.638978 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644c2a48-0ee5-4b0c-a8cd-6ecce1a49098 service glance] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:43.778171 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d71600b-f985-4643-8cae-d99a5592e6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:43.779233 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d71600b-f985-4643-8cae-d99a5592e6dc admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:43.779734 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d71600b-f985-4643-8cae-d99a5592e6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:43.780095 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d71600b-f985-4643-8cae-d99a5592e6dc admin admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:43.780880 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d71600b-f985-4643-8cae-d99a5592e6dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:43.783783 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d71600b-f985-4643-8cae-d99a5592e6dc admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:43.818231 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1083/2194] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:04:43 2022] POST /identity/v3/users => generated 299 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:04:43.819004 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fca5ba6-a03e-4303-acf7-e8feb0dce80f admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:43.830869 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fca5ba6-a03e-4303-acf7-e8feb0dce80f admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:43.836640 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa80cbf-f491-450d-b936-b92477472efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:43.837452 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa80cbf-f491-450d-b936-b92477472efb admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:43.837861 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa80cbf-f491-450d-b936-b92477472efb admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:43.838247 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa80cbf-f491-450d-b936-b92477472efb admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:43.838998 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa80cbf-f491-450d-b936-b92477472efb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:43.854350 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa80cbf-f491-450d-b936-b92477472efb admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:43.884242 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d71600b-f985-4643-8cae-d99a5592e6dc admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:43.889724 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1112/2195] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:04:43 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 11:04:43.902987 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d71600b-f985-4643-8cae-d99a5592e6dc admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:43.908973 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a3ab83-542e-4277-bd9c-e8002d13c587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:43.910625 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3ab83-542e-4277-bd9c-e8002d13c587 admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:43.911335 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3ab83-542e-4277-bd9c-e8002d13c587 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:43.912610 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3ab83-542e-4277-bd9c-e8002d13c587 admin admin] PATH_INFO: `/v3/projects/8e8aaabb61854b7581fe167fa6f63e3f/users/0f5b548964df43d9bcc1148a4abc999b/roles/127fdc7ef05b4e0b98a940b334e5fcab` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:43.950910 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a3ab83-542e-4277-bd9c-e8002d13c587 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e8aaabb61854b7581fe167fa6f63e3f, user_id=0f5b548964df43d9bcc1148a4abc999b, role_id=127fdc7ef05b4e0b98a940b334e5fcab)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:43.954385 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a3ab83-542e-4277-bd9c-e8002d13c587 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:43.982386 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1084/2196] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:04:43 2022] PUT /identity/v3/projects/8e8aaabb61854b7581fe167fa6f63e3f/users/0f5b548964df43d9bcc1148a4abc999b/roles/127fdc7ef05b4e0b98a940b334e5fcab => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:04:43.983598 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa80cbf-f491-450d-b936-b92477472efb admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:44.014453 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa80cbf-f491-450d-b936-b92477472efb admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:44.192416 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0315ce8a-a20e-4ecc-9686-6b1e3058a13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:44.193122 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0315ce8a-a20e-4ecc-9686-6b1e3058a13a admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:44.233479 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0315ce8a-a20e-4ecc-9686-6b1e3058a13a admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:44.233843 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0315ce8a-a20e-4ecc-9686-6b1e3058a13a admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:44.238034 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0315ce8a-a20e-4ecc-9686-6b1e3058a13a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:44.264490 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0315ce8a-a20e-4ecc-9686-6b1e3058a13a admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:44.314038 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1113/2197] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:04:43 2022] GET /identity/v3/roles => generated 1420 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:04:44.317857 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a3ab83-542e-4277-bd9c-e8002d13c587 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:44.338102 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a3ab83-542e-4277-bd9c-e8002d13c587 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:44.357801 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29efeff8-e316-4c0a-819e-36d91f172772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:44.359561 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29efeff8-e316-4c0a-819e-36d91f172772 admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:44.359796 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29efeff8-e316-4c0a-819e-36d91f172772 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:44.360076 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29efeff8-e316-4c0a-819e-36d91f172772 admin admin] PATH_INFO: `/v3/projects/8e8aaabb61854b7581fe167fa6f63e3f/users/0f5b548964df43d9bcc1148a4abc999b/roles/127fdc7ef05b4e0b98a940b334e5fcab` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:44.369199 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29efeff8-e316-4c0a-819e-36d91f172772 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e8aaabb61854b7581fe167fa6f63e3f, user_id=0f5b548964df43d9bcc1148a4abc999b, role_id=127fdc7ef05b4e0b98a940b334e5fcab)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:44.379867 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29efeff8-e316-4c0a-819e-36d91f172772 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:44.430820 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1085/2198] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:04:44 2022] PUT /identity/v3/projects/8e8aaabb61854b7581fe167fa6f63e3f/users/0f5b548964df43d9bcc1148a4abc999b/roles/127fdc7ef05b4e0b98a940b334e5fcab => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:04:44.450120 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f22a54-a60b-49d3-8f5c-c3039c43dc63 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:44.450407 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f22a54-a60b-49d3-8f5c-c3039c43dc63 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:44.450912 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f22a54-a60b-49d3-8f5c-c3039c43dc63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:44.537567 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-d3f22a54-a60b-49d3-8f5c-c3039c43dc63 None None] MFA Rules not processed for user `0f5b548964df43d9bcc1148a4abc999b`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:04:44.539150 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-d3f22a54-a60b-49d3-8f5c-c3039c43dc63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:44.764701 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1114/2199] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:04:44 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:04:44.777499 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29efeff8-e316-4c0a-819e-36d91f172772 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:44.779464 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-29efeff8-e316-4c0a-819e-36d91f172772 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:44.895333 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:04:44.992969 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29efeff8-e316-4c0a-819e-36d91f172772 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:45.005983 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb538ab-4cb1-4346-8fb2-3ab8d812fcc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b8a09704b9b4ab2bffb813796ec6e77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:45.006713 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb538ab-4cb1-4346-8fb2-3ab8d812fcc2 service cinder] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:45.007059 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb538ab-4cb1-4346-8fb2-3ab8d812fcc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:45.007538 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb538ab-4cb1-4346-8fb2-3ab8d812fcc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:45.028503 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb538ab-4cb1-4346-8fb2-3ab8d812fcc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:45.030627 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb538ab-4cb1-4346-8fb2-3ab8d812fcc2 service cinder] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:45.061702 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1086/2200] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:04:44 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:04:45.181442 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f22a54-a60b-49d3-8f5c-c3039c43dc63 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:45.301995 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f22a54-a60b-49d3-8f5c-c3039c43dc63 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:45.306820 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc71eca-e5a6-463a-b401-6a85260aab55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:45.307462 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc71eca-e5a6-463a-b401-6a85260aab55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:45.307739 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc71eca-e5a6-463a-b401-6a85260aab55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:45.310303 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc71eca-e5a6-463a-b401-6a85260aab55 admin admin] PATH_INFO: `/v3/users/2985b0743b554910b1e9ade5bc4fe369` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:45.312637 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc71eca-e5a6-463a-b401-6a85260aab55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2985b0743b554910b1e9ade5bc4fe369)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:45.314999 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc71eca-e5a6-463a-b401-6a85260aab55 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:45.327939 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:04:45.400877 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-fbc71eca-e5a6-463a-b401-6a85260aab55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2985b0743b554910b1e9ade5bc4fe369'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:45.401847 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-fbc71eca-e5a6-463a-b401-6a85260aab55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2985b0743b554910b1e9ade5bc4fe369'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:45.412398 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-fbc71eca-e5a6-463a-b401-6a85260aab55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2985b0743b554910b1e9ade5bc4fe369'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:45.430687 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-fbc71eca-e5a6-463a-b401-6a85260aab55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2985b0743b554910b1e9ade5bc4fe369'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:45.443001 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-fbc71eca-e5a6-463a-b401-6a85260aab55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2985b0743b554910b1e9ade5bc4fe369'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:45.455794 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1115/2201] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:04:45 2022] DELETE /identity/v3/users/2985b0743b554910b1e9ade5bc4fe369 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:04:45.456935 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c6597f-b8fa-4705-849a-8b75c7dd5dbc None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:45.457158 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c6597f-b8fa-4705-849a-8b75c7dd5dbc None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:45.457678 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c6597f-b8fa-4705-849a-8b75c7dd5dbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:45.498360 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-e4c6597f-b8fa-4705-849a-8b75c7dd5dbc None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:04:45.499961 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-e4c6597f-b8fa-4705-849a-8b75c7dd5dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:45.598928 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1087/2202] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:04:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:04:45.606457 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc71eca-e5a6-463a-b401-6a85260aab55 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:45.608693 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-fbc71eca-e5a6-463a-b401-6a85260aab55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:45.694553 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc71eca-e5a6-463a-b401-6a85260aab55 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:45.701024 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8e9cd1-ebe4-403d-94c1-df7b8a996211 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:45.702016 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e9cd1-ebe4-403d-94c1-df7b8a996211 service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:45.702540 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e9cd1-ebe4-403d-94c1-df7b8a996211 service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:45.703018 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e9cd1-ebe4-403d-94c1-df7b8a996211 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:45.717264 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8e9cd1-ebe4-403d-94c1-df7b8a996211 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:45.719028 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8e9cd1-ebe4-403d-94c1-df7b8a996211 service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:45.734239 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1116/2203] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:04:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:04:46.420878 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c6597f-b8fa-4705-849a-8b75c7dd5dbc None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:46.423987 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-e4c6597f-b8fa-4705-849a-8b75c7dd5dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:46.486618 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c6597f-b8fa-4705-849a-8b75c7dd5dbc None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:46.516320 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35d0ba2-f8f6-46f0-9176-68f7a74bd3bd None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:46.517201 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35d0ba2-f8f6-46f0-9176-68f7a74bd3bd None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:46.517792 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35d0ba2-f8f6-46f0-9176-68f7a74bd3bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:46.537188 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d8114c-2f0b-473d-96a0-9fcf7f6317e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:46.538153 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d8114c-2f0b-473d-96a0-9fcf7f6317e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:46.538614 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d8114c-2f0b-473d-96a0-9fcf7f6317e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:46.539038 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d8114c-2f0b-473d-96a0-9fcf7f6317e6 admin admin] PATH_INFO: `/v3/projects/cf8aec43a7344c108477f07ef61484bc` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:46.540695 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d8114c-2f0b-473d-96a0-9fcf7f6317e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf8aec43a7344c108477f07ef61484bc)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:46.542812 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d8114c-2f0b-473d-96a0-9fcf7f6317e6 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:46.598378 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-a35d0ba2-f8f6-46f0-9176-68f7a74bd3bd None None] MFA Rules not processed for user `d67b6b603ba545bea43921012cf08278`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:04:46.600250 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-a35d0ba2-f8f6-46f0-9176-68f7a74bd3bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:46.636626 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-41d8114c-2f0b-473d-96a0-9fcf7f6317e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf8aec43a7344c108477f07ef61484bc', 'request_id': 'req-41d8114c-2f0b-473d-96a0-9fcf7f6317e6'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:46.654332 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-41d8114c-2f0b-473d-96a0-9fcf7f6317e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf8aec43a7344c108477f07ef61484bc', 'request_id': 'req-41d8114c-2f0b-473d-96a0-9fcf7f6317e6'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:46.672045 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-41d8114c-2f0b-473d-96a0-9fcf7f6317e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf8aec43a7344c108477f07ef61484bc', 'request_id': 'req-41d8114c-2f0b-473d-96a0-9fcf7f6317e6'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:46.709582 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-41d8114c-2f0b-473d-96a0-9fcf7f6317e6 admin admin] The token cache is being invalidate because project cf8aec43a7344c108477f07ef61484bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:04:46.709582 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-41d8114c-2f0b-473d-96a0-9fcf7f6317e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:46.709582 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-41d8114c-2f0b-473d-96a0-9fcf7f6317e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:46.709582 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1088/2204] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:04:46 2022] DELETE /identity/v3/projects/cf8aec43a7344c108477f07ef61484bc => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:04:46.721763 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d8114c-2f0b-473d-96a0-9fcf7f6317e6 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:46.721763 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-41d8114c-2f0b-473d-96a0-9fcf7f6317e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:46.793856 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1117/2205] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:04:46 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:04:46.806846 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35d0ba2-f8f6-46f0-9176-68f7a74bd3bd None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:46.811457 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-a35d0ba2-f8f6-46f0-9176-68f7a74bd3bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:46.876906 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:04:46.921094 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:04:46.977129 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d8114c-2f0b-473d-96a0-9fcf7f6317e6 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:46.995107 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cf35f9-d19b-46a1-8572-6d1377ceb377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:46.997751 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf35f9-d19b-46a1-8572-6d1377ceb377 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:46.998038 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf35f9-d19b-46a1-8572-6d1377ceb377 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:46.998317 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf35f9-d19b-46a1-8572-6d1377ceb377 admin admin] PATH_INFO: `/v3/users/0f5b548964df43d9bcc1148a4abc999b` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:47.000941 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cf35f9-d19b-46a1-8572-6d1377ceb377 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f5b548964df43d9bcc1148a4abc999b)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:47.039786 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cf35f9-d19b-46a1-8572-6d1377ceb377 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:47.104008 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35d0ba2-f8f6-46f0-9176-68f7a74bd3bd None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:47.159578 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-54cf35f9-d19b-46a1-8572-6d1377ceb377 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f5b548964df43d9bcc1148a4abc999b'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:47.198728 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-54cf35f9-d19b-46a1-8572-6d1377ceb377 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f5b548964df43d9bcc1148a4abc999b'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:47.199592 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-54cf35f9-d19b-46a1-8572-6d1377ceb377 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f5b548964df43d9bcc1148a4abc999b'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:47.205592 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-54cf35f9-d19b-46a1-8572-6d1377ceb377 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f5b548964df43d9bcc1148a4abc999b'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:47.212517 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-54cf35f9-d19b-46a1-8572-6d1377ceb377 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f5b548964df43d9bcc1148a4abc999b'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:47.271729 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1089/2206] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:04:46 2022] DELETE /identity/v3/users/0f5b548964df43d9bcc1148a4abc999b => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:04:47.346757 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede92245-0fe0-449e-bb41-fb1ae99e1301 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a005d8f0c46d44c7b6f2201a54717b12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:47.347444 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede92245-0fe0-449e-bb41-fb1ae99e1301 service nova] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:47.347854 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede92245-0fe0-449e-bb41-fb1ae99e1301 service nova] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:47.348208 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede92245-0fe0-449e-bb41-fb1ae99e1301 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:47.354499 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-ede92245-0fe0-449e-bb41-fb1ae99e1301 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:47.523041 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede92245-0fe0-449e-bb41-fb1ae99e1301 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:47.524912 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede92245-0fe0-449e-bb41-fb1ae99e1301 service nova] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:47.563023 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1118/2207] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:04:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 756 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:04:47.882522 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cf35f9-d19b-46a1-8572-6d1377ceb377 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:47.884222 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-54cf35f9-d19b-46a1-8572-6d1377ceb377 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:48.062945 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cf35f9-d19b-46a1-8572-6d1377ceb377 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:48.071164 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d394c3-778a-4a23-8122-d06a3f658e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:48.073732 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d394c3-778a-4a23-8122-d06a3f658e32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:48.074325 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d394c3-778a-4a23-8122-d06a3f658e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:48.074620 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d394c3-778a-4a23-8122-d06a3f658e32 admin admin] PATH_INFO: `/v3/projects/8e8aaabb61854b7581fe167fa6f63e3f` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:48.084954 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d394c3-778a-4a23-8122-d06a3f658e32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e8aaabb61854b7581fe167fa6f63e3f)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:48.087010 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d394c3-778a-4a23-8122-d06a3f658e32 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:48.187431 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-b1d394c3-778a-4a23-8122-d06a3f658e32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e8aaabb61854b7581fe167fa6f63e3f', 'request_id': 'req-b1d394c3-778a-4a23-8122-d06a3f658e32'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:48.208928 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-b1d394c3-778a-4a23-8122-d06a3f658e32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e8aaabb61854b7581fe167fa6f63e3f', 'request_id': 'req-b1d394c3-778a-4a23-8122-d06a3f658e32'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:48.219764 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-b1d394c3-778a-4a23-8122-d06a3f658e32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e8aaabb61854b7581fe167fa6f63e3f', 'request_id': 'req-b1d394c3-778a-4a23-8122-d06a3f658e32'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:48.248700 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-b1d394c3-778a-4a23-8122-d06a3f658e32 admin admin] The token cache is being invalidate because project 8e8aaabb61854b7581fe167fa6f63e3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:04:48.248700 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-b1d394c3-778a-4a23-8122-d06a3f658e32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:48.248700 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-b1d394c3-778a-4a23-8122-d06a3f658e32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:48.248700 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1090/2208] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:04:47 2022] DELETE /identity/v3/projects/8e8aaabb61854b7581fe167fa6f63e3f => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:04:48.250340 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5fe229-ee3f-41e9-893d-6ba66a1a6ed4 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:48.250706 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5fe229-ee3f-41e9-893d-6ba66a1a6ed4 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:48.251056 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5fe229-ee3f-41e9-893d-6ba66a1a6ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:48.282421 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-3a5fe229-ee3f-41e9-893d-6ba66a1a6ed4 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:04:48.284540 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-3a5fe229-ee3f-41e9-893d-6ba66a1a6ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:48.365253 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:04:48.404472 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1119/2209] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:04:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:04:48.412388 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1ffd5-3b54-4926-a436-8c3bdeec266e None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:48.412790 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1ffd5-3b54-4926-a436-8c3bdeec266e None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:48.412955 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1ffd5-3b54-4926-a436-8c3bdeec266e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:48.433572 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:04:48.456079 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-59b1ffd5-3b54-4926-a436-8c3bdeec266e None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:04:48.458618 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-59b1ffd5-3b54-4926-a436-8c3bdeec266e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:48.468906 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1091/2210] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:04:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:04:48.474813 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5fe229-ee3f-41e9-893d-6ba66a1a6ed4 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:48.489778 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5fe229-ee3f-41e9-893d-6ba66a1a6ed4 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:48.515257 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37e0594-1181-4f36-96e2-d44461a11638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:48.516097 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e0594-1181-4f36-96e2-d44461a11638 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:48.516560 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e0594-1181-4f36-96e2-d44461a11638 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:48.516988 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e0594-1181-4f36-96e2-d44461a11638 admin admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:48.517898 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37e0594-1181-4f36-96e2-d44461a11638 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:04:48.518488 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37e0594-1181-4f36-96e2-d44461a11638 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:48.521228 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37e0594-1181-4f36-96e2-d44461a11638 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:48.539169 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1120/2211] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Aug 18 11:04:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:04:48.544202 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b1ffd5-3b54-4926-a436-8c3bdeec266e None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:48.556693 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b1ffd5-3b54-4926-a436-8c3bdeec266e None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:48.564549 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734ab949-0367-4bfc-9b78-f01c0569248c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:48.565874 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734ab949-0367-4bfc-9b78-f01c0569248c admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:48.566166 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734ab949-0367-4bfc-9b78-f01c0569248c admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:48.566674 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734ab949-0367-4bfc-9b78-f01c0569248c admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:48.567596 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734ab949-0367-4bfc-9b78-f01c0569248c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:48.571367 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734ab949-0367-4bfc-9b78-f01c0569248c admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:48.631554 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1092/2212] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:04:48 2022] POST /identity/v3/projects => generated 381 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:04:48.631916 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37e0594-1181-4f36-96e2-d44461a11638 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:48.650465 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37e0594-1181-4f36-96e2-d44461a11638 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:48.793393 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9c0cc5-b21f-4434-9d8a-5c6e90db8964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:48.796806 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c0cc5-b21f-4434-9d8a-5c6e90db8964 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:48.797458 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c0cc5-b21f-4434-9d8a-5c6e90db8964 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:48.797962 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c0cc5-b21f-4434-9d8a-5c6e90db8964 admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:48.798806 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9c0cc5-b21f-4434-9d8a-5c6e90db8964 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:48.802183 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9c0cc5-b21f-4434-9d8a-5c6e90db8964 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:48.847869 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1121/2213] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:04:48 2022] POST /identity/v3/users => generated 291 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:04:48.850297 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734ab949-0367-4bfc-9b78-f01c0569248c admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:48.874321 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734ab949-0367-4bfc-9b78-f01c0569248c admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:48.885088 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f65e0d-185f-4de5-afcc-79ed41d32119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:48.885767 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f65e0d-185f-4de5-afcc-79ed41d32119 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:48.886052 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f65e0d-185f-4de5-afcc-79ed41d32119 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:48.886324 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f65e0d-185f-4de5-afcc-79ed41d32119 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:48.887185 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f65e0d-185f-4de5-afcc-79ed41d32119 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:48.889043 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f65e0d-185f-4de5-afcc-79ed41d32119 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:48.917888 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9c0cc5-b21f-4434-9d8a-5c6e90db8964 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:48.922346 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1093/2214] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:04:48 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:04:48.955368 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9c0cc5-b21f-4434-9d8a-5c6e90db8964 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:48.967488 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fafc64-1887-4333-9e6b-f932dcc8169c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:48.970279 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fafc64-1887-4333-9e6b-f932dcc8169c admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:48.970565 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fafc64-1887-4333-9e6b-f932dcc8169c admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:48.973135 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fafc64-1887-4333-9e6b-f932dcc8169c admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:48.973935 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fafc64-1887-4333-9e6b-f932dcc8169c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:48.980381 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fafc64-1887-4333-9e6b-f932dcc8169c admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:49.009337 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1122/2215] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:04:48 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:04:49.013368 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f65e0d-185f-4de5-afcc-79ed41d32119 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:49.031283 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f65e0d-185f-4de5-afcc-79ed41d32119 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:49.048323 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8856de8-cccc-4224-97e2-320f75bb4a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:49.049732 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8856de8-cccc-4224-97e2-320f75bb4a1c admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:49.050512 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8856de8-cccc-4224-97e2-320f75bb4a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:49.050791 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8856de8-cccc-4224-97e2-320f75bb4a1c admin admin] PATH_INFO: `/v3/projects/891b2a26c20341dc9c9dd370a4c67266/users/396fe50b9f684d50bb59a7e1398d0c4e/roles/719e5c62188d4f8a838987d6e72ca8f7` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:49.095226 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8856de8-cccc-4224-97e2-320f75bb4a1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=891b2a26c20341dc9c9dd370a4c67266, user_id=396fe50b9f684d50bb59a7e1398d0c4e, role_id=719e5c62188d4f8a838987d6e72ca8f7)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:49.100376 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8856de8-cccc-4224-97e2-320f75bb4a1c admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:49.130915 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1094/2216] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:04:49 2022] PUT /identity/v3/projects/891b2a26c20341dc9c9dd370a4c67266/users/396fe50b9f684d50bb59a7e1398d0c4e/roles/719e5c62188d4f8a838987d6e72ca8f7 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:04:49.149889 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b743e7d-2137-4a24-9691-d43baffb5daa None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:49.149889 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b743e7d-2137-4a24-9691-d43baffb5daa None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:49.149889 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b743e7d-2137-4a24-9691-d43baffb5daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:49.215332 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-7b743e7d-2137-4a24-9691-d43baffb5daa None None] MFA Rules not processed for user `396fe50b9f684d50bb59a7e1398d0c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:04:49.216816 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-7b743e7d-2137-4a24-9691-d43baffb5daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:49.365656 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1123/2217] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:04:49 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:04:49.370549 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8856de8-cccc-4224-97e2-320f75bb4a1c admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:49.529682 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8856de8-cccc-4224-97e2-320f75bb4a1c admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:49.540484 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8580b3d-2810-4bb4-b9dd-e4b87223b898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:49.541274 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8580b3d-2810-4bb4-b9dd-e4b87223b898 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:49.544641 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8580b3d-2810-4bb4-b9dd-e4b87223b898 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:49.545108 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8580b3d-2810-4bb4-b9dd-e4b87223b898 admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:49.547197 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8580b3d-2810-4bb4-b9dd-e4b87223b898 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:49.549388 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8580b3d-2810-4bb4-b9dd-e4b87223b898 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:49.599179 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1095/2218] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:04:49 2022] POST /identity/v3/projects => generated 383 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 11:04:49.603776 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b743e7d-2137-4a24-9691-d43baffb5daa None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:49.620298 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b743e7d-2137-4a24-9691-d43baffb5daa None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:49.696421 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3382fa54-9f90-4721-bd9a-cdd45159553b None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:49.696713 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3382fa54-9f90-4721-bd9a-cdd45159553b None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:49.696996 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3382fa54-9f90-4721-bd9a-cdd45159553b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:49.713426 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:04:49.719270 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-3382fa54-9f90-4721-bd9a-cdd45159553b None None] MFA Rules not processed for user `b6e7022d0e4c4b00b92f12a65963d9e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:04:49.720525 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-3382fa54-9f90-4721-bd9a-cdd45159553b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:49.733431 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1553388e-ba3d-45ff-b4c2-61572413083c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:49.734088 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1553388e-ba3d-45ff-b4c2-61572413083c admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:49.734387 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1553388e-ba3d-45ff-b4c2-61572413083c admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:49.734656 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1553388e-ba3d-45ff-b4c2-61572413083c admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:49.735306 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1553388e-ba3d-45ff-b4c2-61572413083c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:49.737421 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1553388e-ba3d-45ff-b4c2-61572413083c admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:49.762814 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1124/2219] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:04:49 2022] POST /identity/v3/users => generated 298 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 11:04:49.766952 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1553388e-ba3d-45ff-b4c2-61572413083c admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:49.779216 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1553388e-ba3d-45ff-b4c2-61572413083c admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:49.788004 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1a7c1e-93e9-4db7-8361-486af4773892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:49.788849 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1a7c1e-93e9-4db7-8361-486af4773892 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:49.789288 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1a7c1e-93e9-4db7-8361-486af4773892 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:49.789683 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1a7c1e-93e9-4db7-8361-486af4773892 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:49.791937 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1a7c1e-93e9-4db7-8361-486af4773892 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:49.795011 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1a7c1e-93e9-4db7-8361-486af4773892 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:49.812337 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1125/2220] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:04:49 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 11:04:49.812539 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1096/2221] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:04:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:04:49.813872 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1a7c1e-93e9-4db7-8361-486af4773892 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:49.826287 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1a7c1e-93e9-4db7-8361-486af4773892 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:49.832807 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8a858e-1ec8-4331-86c6-59c075fa54a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:49.833557 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a858e-1ec8-4331-86c6-59c075fa54a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:49.833855 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a858e-1ec8-4331-86c6-59c075fa54a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:49.834155 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a858e-1ec8-4331-86c6-59c075fa54a3 admin admin] PATH_INFO: `/v3/projects/62e6578cf74f4f4997d8fb85198c0117/users/cbbd9c86117f4e3dbc51a6be0339afe7/roles/127fdc7ef05b4e0b98a940b334e5fcab` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:49.866808 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8a858e-1ec8-4331-86c6-59c075fa54a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62e6578cf74f4f4997d8fb85198c0117, user_id=cbbd9c86117f4e3dbc51a6be0339afe7, role_id=127fdc7ef05b4e0b98a940b334e5fcab)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:49.870306 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8a858e-1ec8-4331-86c6-59c075fa54a3 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:49.892786 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1126/2222] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:04:49 2022] PUT /identity/v3/projects/62e6578cf74f4f4997d8fb85198c0117/users/cbbd9c86117f4e3dbc51a6be0339afe7/roles/127fdc7ef05b4e0b98a940b334e5fcab => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:04:49.897574 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3382fa54-9f90-4721-bd9a-cdd45159553b None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:49.914008 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3382fa54-9f90-4721-bd9a-cdd45159553b None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:49.976354 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:04:50.009381 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063959db-d2dc-45fa-8511-81089333ef54 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:50.009701 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063959db-d2dc-45fa-8511-81089333ef54 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:50.010000 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063959db-d2dc-45fa-8511-81089333ef54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:50.022756 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a669c1-a6c7-42c6-be03-15b5347a0659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:50.023465 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a669c1-a6c7-42c6-be03-15b5347a0659 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:50.024281 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a669c1-a6c7-42c6-be03-15b5347a0659 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:50.024664 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a669c1-a6c7-42c6-be03-15b5347a0659 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:50.025383 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a669c1-a6c7-42c6-be03-15b5347a0659 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:50.027384 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a669c1-a6c7-42c6-be03-15b5347a0659 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:50.030158 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-063959db-d2dc-45fa-8511-81089333ef54 None None] MFA Rules not processed for user `074cfcc7943349a490b29cd4ae3364cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:04:50.031003 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-063959db-d2dc-45fa-8511-81089333ef54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:50.041746 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1097/2223] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:04:49 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:04:50.059254 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a669c1-a6c7-42c6-be03-15b5347a0659 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:50.114515 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a669c1-a6c7-42c6-be03-15b5347a0659 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:50.119803 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606cddc8-ae6e-4d50-bb2b-5b172329a6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:50.121985 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606cddc8-ae6e-4d50-bb2b-5b172329a6a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:50.122306 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606cddc8-ae6e-4d50-bb2b-5b172329a6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:50.122593 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606cddc8-ae6e-4d50-bb2b-5b172329a6a5 admin admin] PATH_INFO: `/v3/projects/62e6578cf74f4f4997d8fb85198c0117/users/cbbd9c86117f4e3dbc51a6be0339afe7/roles/127fdc7ef05b4e0b98a940b334e5fcab` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:50.125394 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606cddc8-ae6e-4d50-bb2b-5b172329a6a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62e6578cf74f4f4997d8fb85198c0117, user_id=cbbd9c86117f4e3dbc51a6be0339afe7, role_id=127fdc7ef05b4e0b98a940b334e5fcab)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:50.127225 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1127/2224] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:04:50 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:04:50.128780 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606cddc8-ae6e-4d50-bb2b-5b172329a6a5 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:50.153565 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1098/2225] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:04:50 2022] PUT /identity/v3/projects/62e6578cf74f4f4997d8fb85198c0117/users/cbbd9c86117f4e3dbc51a6be0339afe7/roles/127fdc7ef05b4e0b98a940b334e5fcab => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:04:50.156545 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a156ce6-da58-4e47-957a-e117ae61ebbd None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:50.156836 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a156ce6-da58-4e47-957a-e117ae61ebbd None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:50.157112 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a156ce6-da58-4e47-957a-e117ae61ebbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:50.193054 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-8a156ce6-da58-4e47-957a-e117ae61ebbd None None] MFA Rules not processed for user `cbbd9c86117f4e3dbc51a6be0339afe7`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:04:50.195044 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-8a156ce6-da58-4e47-957a-e117ae61ebbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:50.302248 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1128/2226] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:04:50 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:04:50.371426 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606cddc8-ae6e-4d50-bb2b-5b172329a6a5 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:50.375091 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-606cddc8-ae6e-4d50-bb2b-5b172329a6a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:50.498223 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606cddc8-ae6e-4d50-bb2b-5b172329a6a5 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:50.508188 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f048e-20bb-4145-817a-0894f7d46b60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b8a09704b9b4ab2bffb813796ec6e77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:50.508994 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f048e-20bb-4145-817a-0894f7d46b60 service cinder] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:50.509600 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f048e-20bb-4145-817a-0894f7d46b60 service cinder] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:50.510161 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f048e-20bb-4145-817a-0894f7d46b60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:50.525086 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52f048e-20bb-4145-817a-0894f7d46b60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:50.530021 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52f048e-20bb-4145-817a-0894f7d46b60 service cinder] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:50.556750 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1099/2227] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:04:50 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:04:50.670118 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a156ce6-da58-4e47-957a-e117ae61ebbd None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:50.687660 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a156ce6-da58-4e47-957a-e117ae61ebbd None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:50.694255 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6881d455-511e-409e-8f00-26353f06b939 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b8a09704b9b4ab2bffb813796ec6e77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:50.695087 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6881d455-511e-409e-8f00-26353f06b939 service cinder] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:50.695685 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6881d455-511e-409e-8f00-26353f06b939 service cinder] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:50.696272 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6881d455-511e-409e-8f00-26353f06b939 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:50.740722 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:04:50.778895 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6881d455-511e-409e-8f00-26353f06b939 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:50.780543 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6881d455-511e-409e-8f00-26353f06b939 service cinder] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:50.793272 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1129/2228] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:04:50 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:04:55.883427 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f048e-20bb-4145-817a-0894f7d46b60 service cinder] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:56.008437 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f048e-20bb-4145-817a-0894f7d46b60 service cinder] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:56.016914 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acfa83c-d451-4f45-ba52-eb81a6974216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:56.016914 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acfa83c-d451-4f45-ba52-eb81a6974216 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:56.016914 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acfa83c-d451-4f45-ba52-eb81a6974216 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:56.016914 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acfa83c-d451-4f45-ba52-eb81a6974216 admin admin] PATH_INFO: `/v3/users/396fe50b9f684d50bb59a7e1398d0c4e` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:56.017403 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acfa83c-d451-4f45-ba52-eb81a6974216 admin admin] RBAC: Authorizing `identity:delete_user(user_id=396fe50b9f684d50bb59a7e1398d0c4e)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:56.017843 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acfa83c-d451-4f45-ba52-eb81a6974216 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:56.075184 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-0acfa83c-d451-4f45-ba52-eb81a6974216 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '396fe50b9f684d50bb59a7e1398d0c4e'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:56.085609 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-0acfa83c-d451-4f45-ba52-eb81a6974216 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '396fe50b9f684d50bb59a7e1398d0c4e'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:56.086285 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-0acfa83c-d451-4f45-ba52-eb81a6974216 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '396fe50b9f684d50bb59a7e1398d0c4e'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:56.086962 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-0acfa83c-d451-4f45-ba52-eb81a6974216 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '396fe50b9f684d50bb59a7e1398d0c4e'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:56.089167 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:04:56.097648 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-0acfa83c-d451-4f45-ba52-eb81a6974216 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '396fe50b9f684d50bb59a7e1398d0c4e'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:56.117465 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1100/2229] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:04:55 2022] DELETE /identity/v3/users/396fe50b9f684d50bb59a7e1398d0c4e => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:04:56.122864 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be91b917-4e80-41f8-961f-fcab38015372 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:56.123375 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be91b917-4e80-41f8-961f-fcab38015372 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:56.123537 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be91b917-4e80-41f8-961f-fcab38015372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:56.146043 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-be91b917-4e80-41f8-961f-fcab38015372 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:04:56.147385 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-be91b917-4e80-41f8-961f-fcab38015372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:56.222564 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1130/2230] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:04:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:04:56.232789 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acfa83c-d451-4f45-ba52-eb81a6974216 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:56.234297 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-0acfa83c-d451-4f45-ba52-eb81a6974216 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:56.308370 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acfa83c-d451-4f45-ba52-eb81a6974216 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:56.313292 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826c273b-a0ed-4cd3-bd3f-3a2bfc17b5b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:56.314148 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c273b-a0ed-4cd3-bd3f-3a2bfc17b5b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:56.314460 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c273b-a0ed-4cd3-bd3f-3a2bfc17b5b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:56.314745 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c273b-a0ed-4cd3-bd3f-3a2bfc17b5b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:56.325200 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826c273b-a0ed-4cd3-bd3f-3a2bfc17b5b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:56.326788 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826c273b-a0ed-4cd3-bd3f-3a2bfc17b5b0 service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:56.337251 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1101/2231] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:04:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:04:56.664118 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be91b917-4e80-41f8-961f-fcab38015372 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:56.667298 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-be91b917-4e80-41f8-961f-fcab38015372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:56.695721 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be91b917-4e80-41f8-961f-fcab38015372 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:56.701164 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272d7fef-504d-42cc-90d6-35c173e3d87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:56.701844 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272d7fef-504d-42cc-90d6-35c173e3d87b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:56.702121 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272d7fef-504d-42cc-90d6-35c173e3d87b admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:56.702420 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272d7fef-504d-42cc-90d6-35c173e3d87b admin admin] PATH_INFO: `/v3/projects/891b2a26c20341dc9c9dd370a4c67266` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:56.703554 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272d7fef-504d-42cc-90d6-35c173e3d87b admin admin] RBAC: Authorizing `identity:delete_project(project_id=891b2a26c20341dc9c9dd370a4c67266)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:56.705447 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272d7fef-504d-42cc-90d6-35c173e3d87b admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:56.754980 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-272d7fef-504d-42cc-90d6-35c173e3d87b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '891b2a26c20341dc9c9dd370a4c67266', 'request_id': 'req-272d7fef-504d-42cc-90d6-35c173e3d87b'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:56.763873 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-272d7fef-504d-42cc-90d6-35c173e3d87b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '891b2a26c20341dc9c9dd370a4c67266', 'request_id': 'req-272d7fef-504d-42cc-90d6-35c173e3d87b'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:56.770766 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-272d7fef-504d-42cc-90d6-35c173e3d87b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '891b2a26c20341dc9c9dd370a4c67266', 'request_id': 'req-272d7fef-504d-42cc-90d6-35c173e3d87b'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:56.781579 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-272d7fef-504d-42cc-90d6-35c173e3d87b admin admin] The token cache is being invalidate because project 891b2a26c20341dc9c9dd370a4c67266 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:04:56.781871 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-272d7fef-504d-42cc-90d6-35c173e3d87b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:56.782532 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-272d7fef-504d-42cc-90d6-35c173e3d87b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:56.784657 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1131/2232] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:04:56 2022] DELETE /identity/v3/projects/891b2a26c20341dc9c9dd370a4c67266 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:04:56.788758 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826c273b-a0ed-4cd3-bd3f-3a2bfc17b5b0 service neutron] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:56.799301 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826c273b-a0ed-4cd3-bd3f-3a2bfc17b5b0 service neutron] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:56.895381 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49424cba-4c4d-4c7b-b6e5-8c56bd6b8b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:56.896195 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49424cba-4c4d-4c7b-b6e5-8c56bd6b8b57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:56.896485 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49424cba-4c4d-4c7b-b6e5-8c56bd6b8b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:56.896762 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49424cba-4c4d-4c7b-b6e5-8c56bd6b8b57 admin admin] PATH_INFO: `/v3/users/cbbd9c86117f4e3dbc51a6be0339afe7` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:56.898030 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49424cba-4c4d-4c7b-b6e5-8c56bd6b8b57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbbd9c86117f4e3dbc51a6be0339afe7)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:56.900569 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49424cba-4c4d-4c7b-b6e5-8c56bd6b8b57 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:56.967568 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-49424cba-4c4d-4c7b-b6e5-8c56bd6b8b57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbbd9c86117f4e3dbc51a6be0339afe7'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:56.976749 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-49424cba-4c4d-4c7b-b6e5-8c56bd6b8b57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbbd9c86117f4e3dbc51a6be0339afe7'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:56.977375 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-49424cba-4c4d-4c7b-b6e5-8c56bd6b8b57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbbd9c86117f4e3dbc51a6be0339afe7'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:56.978096 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-49424cba-4c4d-4c7b-b6e5-8c56bd6b8b57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbbd9c86117f4e3dbc51a6be0339afe7'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:56.986538 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-49424cba-4c4d-4c7b-b6e5-8c56bd6b8b57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbbd9c86117f4e3dbc51a6be0339afe7'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:57.018909 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:04:57.030120 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1102/2233] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:04:56 2022] DELETE /identity/v3/users/cbbd9c86117f4e3dbc51a6be0339afe7 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:04:57.450023 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272d7fef-504d-42cc-90d6-35c173e3d87b admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:57.452976 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-272d7fef-504d-42cc-90d6-35c173e3d87b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:57.474139 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272d7fef-504d-42cc-90d6-35c173e3d87b admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:57.580306 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:04:57.593848 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db9f4d0-0ae8-49c2-b323-2d1d4006c209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:57.596096 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9f4d0-0ae8-49c2-b323-2d1d4006c209 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:57.596890 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9f4d0-0ae8-49c2-b323-2d1d4006c209 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:57.598036 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9f4d0-0ae8-49c2-b323-2d1d4006c209 admin admin] PATH_INFO: `/v3/projects/62e6578cf74f4f4997d8fb85198c0117` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:57.600764 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db9f4d0-0ae8-49c2-b323-2d1d4006c209 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62e6578cf74f4f4997d8fb85198c0117)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:57.603303 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db9f4d0-0ae8-49c2-b323-2d1d4006c209 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:57.661174 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-4db9f4d0-0ae8-49c2-b323-2d1d4006c209 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62e6578cf74f4f4997d8fb85198c0117', 'request_id': 'req-4db9f4d0-0ae8-49c2-b323-2d1d4006c209'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:57.669588 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-4db9f4d0-0ae8-49c2-b323-2d1d4006c209 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62e6578cf74f4f4997d8fb85198c0117', 'request_id': 'req-4db9f4d0-0ae8-49c2-b323-2d1d4006c209'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:57.677281 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-4db9f4d0-0ae8-49c2-b323-2d1d4006c209 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62e6578cf74f4f4997d8fb85198c0117', 'request_id': 'req-4db9f4d0-0ae8-49c2-b323-2d1d4006c209'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:57.687868 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-4db9f4d0-0ae8-49c2-b323-2d1d4006c209 admin admin] The token cache is being invalidate because project 62e6578cf74f4f4997d8fb85198c0117 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:04:57.688156 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-4db9f4d0-0ae8-49c2-b323-2d1d4006c209 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:57.689089 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-4db9f4d0-0ae8-49c2-b323-2d1d4006c209 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:04:57.691443 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1132/2234] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:04:57 2022] DELETE /identity/v3/projects/62e6578cf74f4f4997d8fb85198c0117 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:04:57.696772 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3bdc0c-d5cc-4b1d-9968-0a8fb69721c1 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:57.697060 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3bdc0c-d5cc-4b1d-9968-0a8fb69721c1 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:57.697335 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3bdc0c-d5cc-4b1d-9968-0a8fb69721c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:57.719670 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-2a3bdc0c-d5cc-4b1d-9968-0a8fb69721c1 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:04:57.720992 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-2a3bdc0c-d5cc-4b1d-9968-0a8fb69721c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:57.784852 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1103/2235] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:04:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:04:57.794889 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b8639b-1c94-4e01-adac-34d728ef922a None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:57.795251 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b8639b-1c94-4e01-adac-34d728ef922a None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:57.795673 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b8639b-1c94-4e01-adac-34d728ef922a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:57.818723 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-43b8639b-1c94-4e01-adac-34d728ef922a None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:04:57.819870 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-43b8639b-1c94-4e01-adac-34d728ef922a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:57.828470 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1133/2236] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:04:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:04:57.833722 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3bdc0c-d5cc-4b1d-9968-0a8fb69721c1 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:57.844044 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3bdc0c-d5cc-4b1d-9968-0a8fb69721c1 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:57.850049 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371daa17-9569-418b-9ad1-d1437e537e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:57.850705 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371daa17-9569-418b-9ad1-d1437e537e33 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:57.850979 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371daa17-9569-418b-9ad1-d1437e537e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:57.851274 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371daa17-9569-418b-9ad1-d1437e537e33 admin admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:57.852061 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371daa17-9569-418b-9ad1-d1437e537e33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:04:57.852391 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371daa17-9569-418b-9ad1-d1437e537e33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:57.854087 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371daa17-9569-418b-9ad1-d1437e537e33 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:57.866643 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1104/2237] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Aug 18 11:04:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:04:57.871554 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b8639b-1c94-4e01-adac-34d728ef922a None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:57.881448 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b8639b-1c94-4e01-adac-34d728ef922a None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:57.886367 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16354e83-89a5-4805-b519-88156cfabf19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:57.886990 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16354e83-89a5-4805-b519-88156cfabf19 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:57.887272 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16354e83-89a5-4805-b519-88156cfabf19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:57.887545 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16354e83-89a5-4805-b519-88156cfabf19 admin admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:57.888182 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16354e83-89a5-4805-b519-88156cfabf19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:57.890167 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16354e83-89a5-4805-b519-88156cfabf19 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:57.925638 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1134/2238] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:04:57 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:04:57.929786 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371daa17-9569-418b-9ad1-d1437e537e33 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:57.939988 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371daa17-9569-418b-9ad1-d1437e537e33 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:58.002343 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccc3055-0237-4cc2-9d3f-36d73a08f110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:58.003759 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc3055-0237-4cc2-9d3f-36d73a08f110 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:58.004170 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc3055-0237-4cc2-9d3f-36d73a08f110 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:58.004413 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc3055-0237-4cc2-9d3f-36d73a08f110 admin admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:58.005007 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccc3055-0237-4cc2-9d3f-36d73a08f110 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:58.007071 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccc3055-0237-4cc2-9d3f-36d73a08f110 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:58.033587 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1105/2239] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:04:57 2022] POST /identity/v3/users => generated 292 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:04:58.035386 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16354e83-89a5-4805-b519-88156cfabf19 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:58.046984 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16354e83-89a5-4805-b519-88156cfabf19 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:58.052145 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c9a06e-5a34-41a6-a939-bdaa7d2d5532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:58.052869 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c9a06e-5a34-41a6-a939-bdaa7d2d5532 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:58.053217 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c9a06e-5a34-41a6-a939-bdaa7d2d5532 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:58.053581 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c9a06e-5a34-41a6-a939-bdaa7d2d5532 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:58.054302 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c9a06e-5a34-41a6-a939-bdaa7d2d5532 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:58.055970 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c9a06e-5a34-41a6-a939-bdaa7d2d5532 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:58.067562 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1135/2240] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:04:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:04:58.071405 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccc3055-0237-4cc2-9d3f-36d73a08f110 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:58.082079 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccc3055-0237-4cc2-9d3f-36d73a08f110 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:58.087004 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280beaa1-5cb8-4ef0-a327-bffa1ffc14cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:58.087647 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280beaa1-5cb8-4ef0-a327-bffa1ffc14cd admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:58.087925 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280beaa1-5cb8-4ef0-a327-bffa1ffc14cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:58.088191 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280beaa1-5cb8-4ef0-a327-bffa1ffc14cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:58.088833 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280beaa1-5cb8-4ef0-a327-bffa1ffc14cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:58.090521 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280beaa1-5cb8-4ef0-a327-bffa1ffc14cd admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:58.102878 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1106/2241] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:04:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:04:58.107215 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c9a06e-5a34-41a6-a939-bdaa7d2d5532 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:58.117785 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c9a06e-5a34-41a6-a939-bdaa7d2d5532 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:58.122464 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cfe1d7-f733-45bb-84df-77c16e52fbba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:58.123138 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cfe1d7-f733-45bb-84df-77c16e52fbba admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:58.123420 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cfe1d7-f733-45bb-84df-77c16e52fbba admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:58.123701 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cfe1d7-f733-45bb-84df-77c16e52fbba admin admin] PATH_INFO: `/v3/projects/f82e2f0e567d40c9ac67c502753d715a/users/3c3820af26ea4a2fbb85c8dc85801d9c/roles/719e5c62188d4f8a838987d6e72ca8f7` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:58.140183 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cfe1d7-f733-45bb-84df-77c16e52fbba admin admin] RBAC: Authorizing `identity:create_grant(project_id=f82e2f0e567d40c9ac67c502753d715a, user_id=3c3820af26ea4a2fbb85c8dc85801d9c, role_id=719e5c62188d4f8a838987d6e72ca8f7)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:58.143263 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cfe1d7-f733-45bb-84df-77c16e52fbba admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:58.157778 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1136/2242] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:04:58 2022] PUT /identity/v3/projects/f82e2f0e567d40c9ac67c502753d715a/users/3c3820af26ea4a2fbb85c8dc85801d9c/roles/719e5c62188d4f8a838987d6e72ca8f7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:04:58.170968 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8af74e-f117-4b4b-8193-0bdd1d76a1cc None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:58.171394 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8af74e-f117-4b4b-8193-0bdd1d76a1cc None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:58.171675 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8af74e-f117-4b4b-8193-0bdd1d76a1cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:58.209616 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-3d8af74e-f117-4b4b-8193-0bdd1d76a1cc None None] MFA Rules not processed for user `3c3820af26ea4a2fbb85c8dc85801d9c`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:04:58.209616 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-3d8af74e-f117-4b4b-8193-0bdd1d76a1cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:58.271803 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:04:58.292438 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1107/2243] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:04:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:04:58.297726 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cfe1d7-f733-45bb-84df-77c16e52fbba admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:58.369169 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cfe1d7-f733-45bb-84df-77c16e52fbba admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:58.373879 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de361317-454d-4a34-9b55-2cd9e7738f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:58.374483 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de361317-454d-4a34-9b55-2cd9e7738f81 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:58.374766 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de361317-454d-4a34-9b55-2cd9e7738f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:58.375043 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de361317-454d-4a34-9b55-2cd9e7738f81 admin admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:58.375686 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de361317-454d-4a34-9b55-2cd9e7738f81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:58.378838 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de361317-454d-4a34-9b55-2cd9e7738f81 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:58.406508 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1137/2244] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:04:58 2022] POST /identity/v3/projects => generated 383 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:04:58.411491 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8af74e-f117-4b4b-8193-0bdd1d76a1cc None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:58.431435 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8af74e-f117-4b4b-8193-0bdd1d76a1cc None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:58.501225 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e83e51-3ba7-4353-a6cb-88fcbaf2cc32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:58.501874 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e83e51-3ba7-4353-a6cb-88fcbaf2cc32 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:58.502155 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e83e51-3ba7-4353-a6cb-88fcbaf2cc32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:58.502452 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e83e51-3ba7-4353-a6cb-88fcbaf2cc32 admin admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:58.503701 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e83e51-3ba7-4353-a6cb-88fcbaf2cc32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:58.505663 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e83e51-3ba7-4353-a6cb-88fcbaf2cc32 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:58.526038 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1108/2245] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:04:58 2022] POST /identity/v3/users => generated 298 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:04:58.530276 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de361317-454d-4a34-9b55-2cd9e7738f81 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:58.537015 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:04:58.542346 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de361317-454d-4a34-9b55-2cd9e7738f81 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:58.548295 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25791371-6c7f-48be-b757-946d2f8b41ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:58.549132 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25791371-6c7f-48be-b757-946d2f8b41ed admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:58.550027 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25791371-6c7f-48be-b757-946d2f8b41ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:58.550520 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25791371-6c7f-48be-b757-946d2f8b41ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:58.551253 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25791371-6c7f-48be-b757-946d2f8b41ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:58.553051 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25791371-6c7f-48be-b757-946d2f8b41ed admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:58.563673 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1138/2246] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:04:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:04:58.568786 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e83e51-3ba7-4353-a6cb-88fcbaf2cc32 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:58.579331 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e83e51-3ba7-4353-a6cb-88fcbaf2cc32 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:58.584484 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54efb4d-c77d-476e-a252-1655e666afeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:58.585176 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54efb4d-c77d-476e-a252-1655e666afeb admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:58.585562 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54efb4d-c77d-476e-a252-1655e666afeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:58.585769 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54efb4d-c77d-476e-a252-1655e666afeb admin admin] PATH_INFO: `/v3/projects/7ef00ea509e649b6939ac7d3d2b82dd5/users/812acea8a42b42c591aa6d0767dcd264/roles/127fdc7ef05b4e0b98a940b334e5fcab` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:58.604419 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54efb4d-c77d-476e-a252-1655e666afeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ef00ea509e649b6939ac7d3d2b82dd5, user_id=812acea8a42b42c591aa6d0767dcd264, role_id=127fdc7ef05b4e0b98a940b334e5fcab)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:58.607530 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54efb4d-c77d-476e-a252-1655e666afeb admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:58.628401 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1109/2247] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:04:58 2022] PUT /identity/v3/projects/7ef00ea509e649b6939ac7d3d2b82dd5/users/812acea8a42b42c591aa6d0767dcd264/roles/127fdc7ef05b4e0b98a940b334e5fcab => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:04:58.631198 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25791371-6c7f-48be-b757-946d2f8b41ed admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:58.642520 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25791371-6c7f-48be-b757-946d2f8b41ed admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:58.743929 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5227ee-1850-4b6e-882d-a9a93012b89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:58.744592 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5227ee-1850-4b6e-882d-a9a93012b89f admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:58.745563 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5227ee-1850-4b6e-882d-a9a93012b89f admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:58.745855 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5227ee-1850-4b6e-882d-a9a93012b89f admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:58.746512 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5227ee-1850-4b6e-882d-a9a93012b89f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:58.748117 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5227ee-1850-4b6e-882d-a9a93012b89f admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:58.762910 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1139/2248] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:04:58 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:04:58.764099 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54efb4d-c77d-476e-a252-1655e666afeb admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:58.776205 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54efb4d-c77d-476e-a252-1655e666afeb admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:58.781372 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0809a822-d340-4c7b-9037-fd4d9e90fe99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:58.782082 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0809a822-d340-4c7b-9037-fd4d9e90fe99 admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:58.782367 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0809a822-d340-4c7b-9037-fd4d9e90fe99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:58.782636 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0809a822-d340-4c7b-9037-fd4d9e90fe99 admin admin] PATH_INFO: `/v3/projects/7ef00ea509e649b6939ac7d3d2b82dd5/users/812acea8a42b42c591aa6d0767dcd264/roles/127fdc7ef05b4e0b98a940b334e5fcab` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:58.785330 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0809a822-d340-4c7b-9037-fd4d9e90fe99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ef00ea509e649b6939ac7d3d2b82dd5, user_id=812acea8a42b42c591aa6d0767dcd264, role_id=127fdc7ef05b4e0b98a940b334e5fcab)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:58.788718 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0809a822-d340-4c7b-9037-fd4d9e90fe99 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:58.808620 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1110/2249] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:04:58 2022] PUT /identity/v3/projects/7ef00ea509e649b6939ac7d3d2b82dd5/users/812acea8a42b42c591aa6d0767dcd264/roles/127fdc7ef05b4e0b98a940b334e5fcab => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:04:58.817608 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b762982e-8df0-4bae-be5e-325d75be2977 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:58.818063 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b762982e-8df0-4bae-be5e-325d75be2977 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:58.818701 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b762982e-8df0-4bae-be5e-325d75be2977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:58.852397 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-b762982e-8df0-4bae-be5e-325d75be2977 None None] MFA Rules not processed for user `812acea8a42b42c591aa6d0767dcd264`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:04:58.853681 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-b762982e-8df0-4bae-be5e-325d75be2977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:58.927287 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1140/2250] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:04:58 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:04:58.938421 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0809a822-d340-4c7b-9037-fd4d9e90fe99 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:04:58.940211 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-0809a822-d340-4c7b-9037-fd4d9e90fe99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:04:59.010058 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0809a822-d340-4c7b-9037-fd4d9e90fe99 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:04:59.015631 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874a77db-78ac-4f96-892f-70b1760e58e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b8a09704b9b4ab2bffb813796ec6e77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:04:59.016245 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a77db-78ac-4f96-892f-70b1760e58e8 service cinder] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:04:59.016526 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a77db-78ac-4f96-892f-70b1760e58e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:04:59.016801 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a77db-78ac-4f96-892f-70b1760e58e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:04:59.085058 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874a77db-78ac-4f96-892f-70b1760e58e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:04:59.086541 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874a77db-78ac-4f96-892f-70b1760e58e8 service cinder] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:04:59.090469 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:04:59.101640 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1111/2251] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:04:58 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:05:05.636821 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b762982e-8df0-4bae-be5e-325d75be2977 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:05.649138 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b762982e-8df0-4bae-be5e-325d75be2977 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:05.652765 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9660fc9d-0c5d-428b-a11b-342ad89e502c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b8a09704b9b4ab2bffb813796ec6e77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:05.653373 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9660fc9d-0c5d-428b-a11b-342ad89e502c service cinder] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:05.653705 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9660fc9d-0c5d-428b-a11b-342ad89e502c service cinder] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:05.653986 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9660fc9d-0c5d-428b-a11b-342ad89e502c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:05.664417 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9660fc9d-0c5d-428b-a11b-342ad89e502c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:05.666157 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9660fc9d-0c5d-428b-a11b-342ad89e502c service cinder] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:05.676404 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1141/2252] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:05:05 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:05:07.812984 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874a77db-78ac-4f96-892f-70b1760e58e8 service cinder] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:07.814606 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-874a77db-78ac-4f96-892f-70b1760e58e8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:07.883781 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874a77db-78ac-4f96-892f-70b1760e58e8 service cinder] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:07.889957 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b436941-8ff4-45de-aed3-4652a10e3e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:07.890910 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b436941-8ff4-45de-aed3-4652a10e3e53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:07.891240 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b436941-8ff4-45de-aed3-4652a10e3e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:07.891511 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b436941-8ff4-45de-aed3-4652a10e3e53 admin admin] PATH_INFO: `/v3/users/3b0426b673ca444f8a99eb49e367a32d` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:07.893913 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b436941-8ff4-45de-aed3-4652a10e3e53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b0426b673ca444f8a99eb49e367a32d)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:07.897002 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b436941-8ff4-45de-aed3-4652a10e3e53 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:07.945444 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-1b436941-8ff4-45de-aed3-4652a10e3e53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b0426b673ca444f8a99eb49e367a32d'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:07.953345 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-1b436941-8ff4-45de-aed3-4652a10e3e53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b0426b673ca444f8a99eb49e367a32d'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:07.954069 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-1b436941-8ff4-45de-aed3-4652a10e3e53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b0426b673ca444f8a99eb49e367a32d'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:07.954687 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-1b436941-8ff4-45de-aed3-4652a10e3e53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b0426b673ca444f8a99eb49e367a32d'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:07.962799 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-1b436941-8ff4-45de-aed3-4652a10e3e53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b0426b673ca444f8a99eb49e367a32d'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:07.979854 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1112/2253] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:05:07 2022] DELETE /identity/v3/users/3b0426b673ca444f8a99eb49e367a32d => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:05:07.984386 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eb59d0-7984-4cf6-9e4b-46ad4d7936bd None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:07.984869 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eb59d0-7984-4cf6-9e4b-46ad4d7936bd None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:07.984963 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eb59d0-7984-4cf6-9e4b-46ad4d7936bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:08.007346 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-04eb59d0-7984-4cf6-9e4b-46ad4d7936bd None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:05:08.008656 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-04eb59d0-7984-4cf6-9e4b-46ad4d7936bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:08.071379 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1142/2254] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:05:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:05:08.082055 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b436941-8ff4-45de-aed3-4652a10e3e53 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:08.083466 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-1b436941-8ff4-45de-aed3-4652a10e3e53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:08.146910 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b436941-8ff4-45de-aed3-4652a10e3e53 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:08.150957 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec08be29-3a1f-4627-8ccd-0490848e77d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:08.151605 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08be29-3a1f-4627-8ccd-0490848e77d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:08.151882 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08be29-3a1f-4627-8ccd-0490848e77d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:08.152149 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08be29-3a1f-4627-8ccd-0490848e77d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:08.161792 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec08be29-3a1f-4627-8ccd-0490848e77d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:08.163207 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec08be29-3a1f-4627-8ccd-0490848e77d0 service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:08.172917 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1113/2255] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:05:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:05:08.488885 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eb59d0-7984-4cf6-9e4b-46ad4d7936bd None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:08.492220 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-04eb59d0-7984-4cf6-9e4b-46ad4d7936bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:08.507875 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:05:08.514787 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eb59d0-7984-4cf6-9e4b-46ad4d7936bd None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:08.522533 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8af4ad-6abf-41da-ae61-31da541d7586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:08.526400 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8af4ad-6abf-41da-ae61-31da541d7586 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:08.526871 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8af4ad-6abf-41da-ae61-31da541d7586 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:08.527130 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8af4ad-6abf-41da-ae61-31da541d7586 admin admin] PATH_INFO: `/v3/projects/de73affa93cf4fa8b772a8384280c2e3` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:08.529263 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8af4ad-6abf-41da-ae61-31da541d7586 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de73affa93cf4fa8b772a8384280c2e3)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:08.532634 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8af4ad-6abf-41da-ae61-31da541d7586 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:08.594267 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-2f8af4ad-6abf-41da-ae61-31da541d7586 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de73affa93cf4fa8b772a8384280c2e3', 'request_id': 'req-2f8af4ad-6abf-41da-ae61-31da541d7586'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:08.603386 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-2f8af4ad-6abf-41da-ae61-31da541d7586 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de73affa93cf4fa8b772a8384280c2e3', 'request_id': 'req-2f8af4ad-6abf-41da-ae61-31da541d7586'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:08.610212 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-2f8af4ad-6abf-41da-ae61-31da541d7586 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de73affa93cf4fa8b772a8384280c2e3', 'request_id': 'req-2f8af4ad-6abf-41da-ae61-31da541d7586'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:08.625119 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-2f8af4ad-6abf-41da-ae61-31da541d7586 admin admin] The token cache is being invalidate because project de73affa93cf4fa8b772a8384280c2e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:05:08.625304 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-2f8af4ad-6abf-41da-ae61-31da541d7586 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:08.626102 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-2f8af4ad-6abf-41da-ae61-31da541d7586 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:08.628193 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1143/2256] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:05:08 2022] DELETE /identity/v3/projects/de73affa93cf4fa8b772a8384280c2e3 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:05:08.634339 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0713050-540f-469c-87f5-5da838a43b60 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:08.634683 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0713050-540f-469c-87f5-5da838a43b60 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:08.634965 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0713050-540f-469c-87f5-5da838a43b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:08.659735 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-a0713050-540f-469c-87f5-5da838a43b60 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:05:08.660998 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-a0713050-540f-469c-87f5-5da838a43b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:08.676526 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:05:08.736570 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1114/2257] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:05:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:05:08.749941 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f168b-b1fe-4c6e-a1ac-e46a639429ec None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:08.750436 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f168b-b1fe-4c6e-a1ac-e46a639429ec None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:08.751543 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f168b-b1fe-4c6e-a1ac-e46a639429ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:08.774458 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-532f168b-b1fe-4c6e-a1ac-e46a639429ec None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:05:08.775690 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-532f168b-b1fe-4c6e-a1ac-e46a639429ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:08.784892 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1144/2258] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:05:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:05:08.789713 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0713050-540f-469c-87f5-5da838a43b60 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:08.805460 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0713050-540f-469c-87f5-5da838a43b60 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:08.810238 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb82fea-82cb-40de-b156-9287ee1fbcb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:08.810854 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb82fea-82cb-40de-b156-9287ee1fbcb3 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:08.811471 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb82fea-82cb-40de-b156-9287ee1fbcb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:08.811741 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb82fea-82cb-40de-b156-9287ee1fbcb3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:08.812420 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb82fea-82cb-40de-b156-9287ee1fbcb3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:05:08.812698 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb82fea-82cb-40de-b156-9287ee1fbcb3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:08.814395 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb82fea-82cb-40de-b156-9287ee1fbcb3 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:08.827959 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1115/2259] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Aug 18 11:05:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:05:08.839598 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532f168b-b1fe-4c6e-a1ac-e46a639429ec None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:08.850686 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532f168b-b1fe-4c6e-a1ac-e46a639429ec None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:08.855388 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e85e5e3-4bdf-4278-b1bc-d909bfd5a14c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:08.855986 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85e5e3-4bdf-4278-b1bc-d909bfd5a14c admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:08.856264 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85e5e3-4bdf-4278-b1bc-d909bfd5a14c admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:08.856532 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85e5e3-4bdf-4278-b1bc-d909bfd5a14c admin admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:08.857161 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e85e5e3-4bdf-4278-b1bc-d909bfd5a14c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:08.859127 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e85e5e3-4bdf-4278-b1bc-d909bfd5a14c admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:08.891431 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1145/2260] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:05:08 2022] POST /identity/v3/projects => generated 389 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:05:08.892569 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb82fea-82cb-40de-b156-9287ee1fbcb3 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:08.905431 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb82fea-82cb-40de-b156-9287ee1fbcb3 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:08.974900 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4473c20f-0eae-48b5-a153-84cf6d6bd0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:08.985198 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4473c20f-0eae-48b5-a153-84cf6d6bd0ff admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:08.985619 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4473c20f-0eae-48b5-a153-84cf6d6bd0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:08.985959 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4473c20f-0eae-48b5-a153-84cf6d6bd0ff admin admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:08.986745 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4473c20f-0eae-48b5-a153-84cf6d6bd0ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:08.988776 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4473c20f-0eae-48b5-a153-84cf6d6bd0ff admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:09.017049 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1116/2261] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:05:08 2022] POST /identity/v3/users => generated 295 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 11:05:09.018921 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e85e5e3-4bdf-4278-b1bc-d909bfd5a14c admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:09.029989 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e85e5e3-4bdf-4278-b1bc-d909bfd5a14c admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:09.035346 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff081296-06d6-4e47-babf-8cf8611eabef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:09.035942 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff081296-06d6-4e47-babf-8cf8611eabef admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:09.036297 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff081296-06d6-4e47-babf-8cf8611eabef admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:09.036485 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff081296-06d6-4e47-babf-8cf8611eabef admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:09.037120 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff081296-06d6-4e47-babf-8cf8611eabef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:09.038753 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff081296-06d6-4e47-babf-8cf8611eabef admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:09.048821 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1146/2262] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:05:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:05:09.053051 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4473c20f-0eae-48b5-a153-84cf6d6bd0ff admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:09.070634 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4473c20f-0eae-48b5-a153-84cf6d6bd0ff admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:09.075650 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a1f452-a0ae-483b-9618-41c6a55f426c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:09.076289 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a1f452-a0ae-483b-9618-41c6a55f426c admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:09.076566 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a1f452-a0ae-483b-9618-41c6a55f426c admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:09.076923 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a1f452-a0ae-483b-9618-41c6a55f426c admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:09.077524 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a1f452-a0ae-483b-9618-41c6a55f426c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:09.079216 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a1f452-a0ae-483b-9618-41c6a55f426c admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:09.090915 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1117/2263] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:05:09 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:05:09.095088 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff081296-06d6-4e47-babf-8cf8611eabef admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:09.105672 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff081296-06d6-4e47-babf-8cf8611eabef admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:09.110273 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f932a9-1b5a-424d-88da-b61220b2c1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:09.110916 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f932a9-1b5a-424d-88da-b61220b2c1e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:09.111191 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f932a9-1b5a-424d-88da-b61220b2c1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:09.111491 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f932a9-1b5a-424d-88da-b61220b2c1e8 admin admin] PATH_INFO: `/v3/projects/f90ac35d39944964b6c09838b28f6a2b/users/db066400959541c488a801ae68dedc39/roles/719e5c62188d4f8a838987d6e72ca8f7` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:09.125988 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f932a9-1b5a-424d-88da-b61220b2c1e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f90ac35d39944964b6c09838b28f6a2b, user_id=db066400959541c488a801ae68dedc39, role_id=719e5c62188d4f8a838987d6e72ca8f7)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:09.128621 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f932a9-1b5a-424d-88da-b61220b2c1e8 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:09.141608 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1147/2264] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:05:09 2022] PUT /identity/v3/projects/f90ac35d39944964b6c09838b28f6a2b/users/db066400959541c488a801ae68dedc39/roles/719e5c62188d4f8a838987d6e72ca8f7 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:05:09.156438 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd99f34-a8a5-49cd-952b-aebb1843e6db None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:09.156922 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd99f34-a8a5-49cd-952b-aebb1843e6db None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:09.157078 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd99f34-a8a5-49cd-952b-aebb1843e6db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:09.187626 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-fcd99f34-a8a5-49cd-952b-aebb1843e6db None None] MFA Rules not processed for user `db066400959541c488a801ae68dedc39`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:05:09.188859 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-fcd99f34-a8a5-49cd-952b-aebb1843e6db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:09.269261 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1118/2265] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:05:09 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:05:09.281694 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f932a9-1b5a-424d-88da-b61220b2c1e8 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:09.284420 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-b2f932a9-1b5a-424d-88da-b61220b2c1e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:09.357759 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f932a9-1b5a-424d-88da-b61220b2c1e8 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:09.361424 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a1e56c-dc5f-4a4d-a3bc-eb2814e542c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b8a09704b9b4ab2bffb813796ec6e77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:09.362727 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a1e56c-dc5f-4a4d-a3bc-eb2814e542c4 service cinder] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:09.363003 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a1e56c-dc5f-4a4d-a3bc-eb2814e542c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:09.363272 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a1e56c-dc5f-4a4d-a3bc-eb2814e542c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:09.372020 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a1e56c-dc5f-4a4d-a3bc-eb2814e542c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:09.373451 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a1e56c-dc5f-4a4d-a3bc-eb2814e542c4 service cinder] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:09.382908 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1148/2266] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:05:09 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:05:10.665963 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd99f34-a8a5-49cd-952b-aebb1843e6db None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:10.667720 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-fcd99f34-a8a5-49cd-952b-aebb1843e6db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:10.688728 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:05:10.742748 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd99f34-a8a5-49cd-952b-aebb1843e6db None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:10.748502 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaf3020-02a1-4922-be2a-df2f1afacfc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:10.749320 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaf3020-02a1-4922-be2a-df2f1afacfc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:10.749697 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaf3020-02a1-4922-be2a-df2f1afacfc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:10.750045 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaf3020-02a1-4922-be2a-df2f1afacfc6 admin admin] PATH_INFO: `/v3/users/3c3820af26ea4a2fbb85c8dc85801d9c` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:10.751340 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaf3020-02a1-4922-be2a-df2f1afacfc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c3820af26ea4a2fbb85c8dc85801d9c)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:10.754441 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaf3020-02a1-4922-be2a-df2f1afacfc6 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:10.859030 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-acaf3020-02a1-4922-be2a-df2f1afacfc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c3820af26ea4a2fbb85c8dc85801d9c'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:10.880346 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-acaf3020-02a1-4922-be2a-df2f1afacfc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c3820af26ea4a2fbb85c8dc85801d9c'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:10.881848 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-acaf3020-02a1-4922-be2a-df2f1afacfc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c3820af26ea4a2fbb85c8dc85801d9c'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:10.882542 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-acaf3020-02a1-4922-be2a-df2f1afacfc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c3820af26ea4a2fbb85c8dc85801d9c'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:10.892808 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-acaf3020-02a1-4922-be2a-df2f1afacfc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c3820af26ea4a2fbb85c8dc85801d9c'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:10.919742 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d9e3ee-77d8-4cb9-8c2f-044f7f14c26f None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:10.920222 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d9e3ee-77d8-4cb9-8c2f-044f7f14c26f None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:10.920332 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d9e3ee-77d8-4cb9-8c2f-044f7f14c26f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:10.922871 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1119/2267] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:05:10 2022] DELETE /identity/v3/users/3c3820af26ea4a2fbb85c8dc85801d9c => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:05:10.927504 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea7860-5aa9-4c2f-a077-5231964b7c7c None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:10.927789 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea7860-5aa9-4c2f-a077-5231964b7c7c None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:10.928065 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea7860-5aa9-4c2f-a077-5231964b7c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:10.947653 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-07d9e3ee-77d8-4cb9-8c2f-044f7f14c26f None None] MFA Rules not processed for user `bcacf809f13043ab90716607160a70db`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:05:10.948368 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-07d9e3ee-77d8-4cb9-8c2f-044f7f14c26f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:10.968122 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-c4ea7860-5aa9-4c2f-a077-5231964b7c7c None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:05:10.969471 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-c4ea7860-5aa9-4c2f-a077-5231964b7c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:10.974124 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:05:11.048202 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1149/2268] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Aug 18 11:05:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:05:11.064040 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1120/2269] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:05:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:05:11.085600 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459eeec-711d-4210-80a5-82afaae36e9c None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:11.086069 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459eeec-711d-4210-80a5-82afaae36e9c None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:11.086788 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459eeec-711d-4210-80a5-82afaae36e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:11.092076 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ea7860-5aa9-4c2f-a077-5231964b7c7c None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:11.094382 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-c4ea7860-5aa9-4c2f-a077-5231964b7c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:11.112764 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-4459eeec-711d-4210-80a5-82afaae36e9c None None] MFA Rules not processed for user `57e117589fc14e4d9d8d8494bddf9c12`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:05:11.114074 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-4459eeec-711d-4210-80a5-82afaae36e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:11.158742 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:05:11.181849 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ea7860-5aa9-4c2f-a077-5231964b7c7c None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:11.185750 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab45a122-24f1-4e83-afb7-84479a12965a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:11.186413 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45a122-24f1-4e83-afb7-84479a12965a service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:11.186723 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45a122-24f1-4e83-afb7-84479a12965a service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:11.186997 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45a122-24f1-4e83-afb7-84479a12965a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:11.191921 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1150/2270] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:05:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:05:11.192780 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4459eeec-711d-4210-80a5-82afaae36e9c None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:11.194094 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-4459eeec-711d-4210-80a5-82afaae36e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:11.202380 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab45a122-24f1-4e83-afb7-84479a12965a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:11.204307 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab45a122-24f1-4e83-afb7-84479a12965a service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:11.216585 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1121/2271] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:05:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:05:11.282923 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4459eeec-711d-4210-80a5-82afaae36e9c None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:11.288961 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a928252c-19fe-4bf7-8237-bb4d4841c7ff service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f97e906b1922419d8511ab1c8b9c86e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:11.289613 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a928252c-19fe-4bf7-8237-bb4d4841c7ff service swift] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:11.289899 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a928252c-19fe-4bf7-8237-bb4d4841c7ff service swift] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:11.290169 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a928252c-19fe-4bf7-8237-bb4d4841c7ff service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:11.301240 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a928252c-19fe-4bf7-8237-bb4d4841c7ff service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:11.303022 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a928252c-19fe-4bf7-8237-bb4d4841c7ff service swift] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:11.312328 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1151/2272] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Aug 18 11:05:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 11:05:11.561505 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab45a122-24f1-4e83-afb7-84479a12965a service neutron] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:11.563003 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-ab45a122-24f1-4e83-afb7-84479a12965a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:11.576278 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab45a122-24f1-4e83-afb7-84479a12965a service neutron] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:11.581470 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2163e582-6697-4c2d-8be0-b20529fad49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:11.582197 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2163e582-6697-4c2d-8be0-b20529fad49d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:11.582477 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2163e582-6697-4c2d-8be0-b20529fad49d admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:11.582751 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2163e582-6697-4c2d-8be0-b20529fad49d admin admin] PATH_INFO: `/v3/projects/f82e2f0e567d40c9ac67c502753d715a` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:11.583904 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2163e582-6697-4c2d-8be0-b20529fad49d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f82e2f0e567d40c9ac67c502753d715a)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:11.585880 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2163e582-6697-4c2d-8be0-b20529fad49d admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:11.636011 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-2163e582-6697-4c2d-8be0-b20529fad49d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f82e2f0e567d40c9ac67c502753d715a', 'request_id': 'req-2163e582-6697-4c2d-8be0-b20529fad49d'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:11.642913 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-2163e582-6697-4c2d-8be0-b20529fad49d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f82e2f0e567d40c9ac67c502753d715a', 'request_id': 'req-2163e582-6697-4c2d-8be0-b20529fad49d'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:11.649407 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-2163e582-6697-4c2d-8be0-b20529fad49d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f82e2f0e567d40c9ac67c502753d715a', 'request_id': 'req-2163e582-6697-4c2d-8be0-b20529fad49d'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:11.661352 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-2163e582-6697-4c2d-8be0-b20529fad49d admin admin] The token cache is being invalidate because project f82e2f0e567d40c9ac67c502753d715a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:05:11.661671 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-2163e582-6697-4c2d-8be0-b20529fad49d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:11.662306 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-2163e582-6697-4c2d-8be0-b20529fad49d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:11.663769 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1122/2273] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:05:11 2022] DELETE /identity/v3/projects/f82e2f0e567d40c9ac67c502753d715a => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:05:11.668194 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a928252c-19fe-4bf7-8237-bb4d4841c7ff service swift] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:11.679070 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a928252c-19fe-4bf7-8237-bb4d4841c7ff service swift] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:11.733859 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077ad4a2-d165-4101-a82a-22abe1cb0a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:11.734405 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ad4a2-d165-4101-a82a-22abe1cb0a84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:11.734678 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ad4a2-d165-4101-a82a-22abe1cb0a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:11.734945 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ad4a2-d165-4101-a82a-22abe1cb0a84 admin admin] PATH_INFO: `/v3/users/812acea8a42b42c591aa6d0767dcd264` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:11.736066 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077ad4a2-d165-4101-a82a-22abe1cb0a84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=812acea8a42b42c591aa6d0767dcd264)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:11.738757 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077ad4a2-d165-4101-a82a-22abe1cb0a84 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:11.743300 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:05:11.786899 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-077ad4a2-d165-4101-a82a-22abe1cb0a84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '812acea8a42b42c591aa6d0767dcd264'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:11.787567 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-077ad4a2-d165-4101-a82a-22abe1cb0a84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '812acea8a42b42c591aa6d0767dcd264'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:11.795104 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-077ad4a2-d165-4101-a82a-22abe1cb0a84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '812acea8a42b42c591aa6d0767dcd264'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:11.809373 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-077ad4a2-d165-4101-a82a-22abe1cb0a84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '812acea8a42b42c591aa6d0767dcd264'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:11.817425 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-077ad4a2-d165-4101-a82a-22abe1cb0a84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '812acea8a42b42c591aa6d0767dcd264'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:11.823520 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1152/2274] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:05:11 2022] DELETE /identity/v3/users/812acea8a42b42c591aa6d0767dcd264 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:05:12.102570 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2163e582-6697-4c2d-8be0-b20529fad49d admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:12.104030 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-2163e582-6697-4c2d-8be0-b20529fad49d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:12.117986 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2163e582-6697-4c2d-8be0-b20529fad49d admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:12.184079 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae5ac56-9f84-41a8-b143-c614f41c7341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:12.184842 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae5ac56-9f84-41a8-b143-c614f41c7341 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:12.185120 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae5ac56-9f84-41a8-b143-c614f41c7341 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:12.185393 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae5ac56-9f84-41a8-b143-c614f41c7341 admin admin] PATH_INFO: `/v3/projects/7ef00ea509e649b6939ac7d3d2b82dd5` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:12.186558 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae5ac56-9f84-41a8-b143-c614f41c7341 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ef00ea509e649b6939ac7d3d2b82dd5)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:12.188439 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae5ac56-9f84-41a8-b143-c614f41c7341 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:12.242314 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-7ae5ac56-9f84-41a8-b143-c614f41c7341 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ef00ea509e649b6939ac7d3d2b82dd5', 'request_id': 'req-7ae5ac56-9f84-41a8-b143-c614f41c7341'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:12.249825 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-7ae5ac56-9f84-41a8-b143-c614f41c7341 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ef00ea509e649b6939ac7d3d2b82dd5', 'request_id': 'req-7ae5ac56-9f84-41a8-b143-c614f41c7341'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:12.256353 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-7ae5ac56-9f84-41a8-b143-c614f41c7341 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ef00ea509e649b6939ac7d3d2b82dd5', 'request_id': 'req-7ae5ac56-9f84-41a8-b143-c614f41c7341'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:12.258580 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:05:12.270441 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-7ae5ac56-9f84-41a8-b143-c614f41c7341 admin admin] The token cache is being invalidate because project 7ef00ea509e649b6939ac7d3d2b82dd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:05:12.270734 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-7ae5ac56-9f84-41a8-b143-c614f41c7341 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:12.271405 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-7ae5ac56-9f84-41a8-b143-c614f41c7341 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:12.272909 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1123/2275] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:05:12 2022] DELETE /identity/v3/projects/7ef00ea509e649b6939ac7d3d2b82dd5 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:05:12.279210 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f124c74e-2a58-4b80-bc64-ca20521510c8 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:12.279717 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f124c74e-2a58-4b80-bc64-ca20521510c8 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:12.279811 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f124c74e-2a58-4b80-bc64-ca20521510c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:12.301254 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-f124c74e-2a58-4b80-bc64-ca20521510c8 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:05:12.302646 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-f124c74e-2a58-4b80-bc64-ca20521510c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:12.360823 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1153/2276] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:05:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:05:12.370297 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e88932-4855-4060-a53e-fd54097df317 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:12.370588 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e88932-4855-4060-a53e-fd54097df317 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:12.370874 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e88932-4855-4060-a53e-fd54097df317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:12.391107 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-24e88932-4855-4060-a53e-fd54097df317 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:05:12.392310 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-24e88932-4855-4060-a53e-fd54097df317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:12.400168 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1124/2277] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:05:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:05:12.404929 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f124c74e-2a58-4b80-bc64-ca20521510c8 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:12.417720 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f124c74e-2a58-4b80-bc64-ca20521510c8 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:12.423318 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f930b40-cdb1-472e-a2f6-9b7dc5169b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:12.424033 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f930b40-cdb1-472e-a2f6-9b7dc5169b9e admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:12.425105 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f930b40-cdb1-472e-a2f6-9b7dc5169b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:12.425499 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f930b40-cdb1-472e-a2f6-9b7dc5169b9e admin admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:12.426200 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f930b40-cdb1-472e-a2f6-9b7dc5169b9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:05:12.426506 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f930b40-cdb1-472e-a2f6-9b7dc5169b9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:12.428104 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f930b40-cdb1-472e-a2f6-9b7dc5169b9e admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:12.439930 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1154/2278] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Aug 18 11:05:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:05:12.444623 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e88932-4855-4060-a53e-fd54097df317 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:12.454206 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e88932-4855-4060-a53e-fd54097df317 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:12.459030 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106cdd35-43c9-4754-8c37-32715b960da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:12.459636 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106cdd35-43c9-4754-8c37-32715b960da2 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:12.459917 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106cdd35-43c9-4754-8c37-32715b960da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:12.460201 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106cdd35-43c9-4754-8c37-32715b960da2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:12.460836 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106cdd35-43c9-4754-8c37-32715b960da2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:12.462776 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106cdd35-43c9-4754-8c37-32715b960da2 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:12.491749 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1125/2279] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:05:12 2022] POST /identity/v3/projects => generated 361 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:05:12.495582 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f930b40-cdb1-472e-a2f6-9b7dc5169b9e admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:12.505562 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f930b40-cdb1-472e-a2f6-9b7dc5169b9e admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:12.561182 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e06738-5be1-4b60-97bf-d27283546e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:12.561817 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e06738-5be1-4b60-97bf-d27283546e97 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:12.562094 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e06738-5be1-4b60-97bf-d27283546e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:12.562362 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e06738-5be1-4b60-97bf-d27283546e97 admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:12.562989 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e06738-5be1-4b60-97bf-d27283546e97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:12.564891 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e06738-5be1-4b60-97bf-d27283546e97 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:12.581960 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:05:12.587607 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1155/2280] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:05:12 2022] POST /identity/v3/users => generated 281 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:05:12.592072 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106cdd35-43c9-4754-8c37-32715b960da2 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:12.603743 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106cdd35-43c9-4754-8c37-32715b960da2 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:12.608371 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b54ec6-162a-4612-99df-54ad0d5bc495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:12.608968 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b54ec6-162a-4612-99df-54ad0d5bc495 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:12.609249 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b54ec6-162a-4612-99df-54ad0d5bc495 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:12.609539 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b54ec6-162a-4612-99df-54ad0d5bc495 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:12.610270 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b54ec6-162a-4612-99df-54ad0d5bc495 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:12.612364 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b54ec6-162a-4612-99df-54ad0d5bc495 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:12.622843 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1126/2281] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:05:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 11:05:12.627049 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e06738-5be1-4b60-97bf-d27283546e97 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:12.637867 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e06738-5be1-4b60-97bf-d27283546e97 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:12.642642 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d631a82-f26e-4d8a-a61b-891f5e1b5940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:12.644297 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d631a82-f26e-4d8a-a61b-891f5e1b5940 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:12.644562 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d631a82-f26e-4d8a-a61b-891f5e1b5940 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:12.644840 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d631a82-f26e-4d8a-a61b-891f5e1b5940 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:12.645492 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d631a82-f26e-4d8a-a61b-891f5e1b5940 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:12.647119 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d631a82-f26e-4d8a-a61b-891f5e1b5940 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:12.657955 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1156/2282] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:05:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:05:12.663396 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b54ec6-162a-4612-99df-54ad0d5bc495 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:12.674045 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b54ec6-162a-4612-99df-54ad0d5bc495 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:12.678847 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d327a81-c0ff-41d2-bfdd-ebfa746d02c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:12.679500 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d327a81-c0ff-41d2-bfdd-ebfa746d02c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:12.679824 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d327a81-c0ff-41d2-bfdd-ebfa746d02c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:12.680138 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d327a81-c0ff-41d2-bfdd-ebfa746d02c5 admin admin] PATH_INFO: `/v3/projects/5710e35dd4cc421b8bd4326f3d5e8467/users/47b39f60053243a8ba60b65d77561363/roles/719e5c62188d4f8a838987d6e72ca8f7` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:12.695125 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d327a81-c0ff-41d2-bfdd-ebfa746d02c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5710e35dd4cc421b8bd4326f3d5e8467, user_id=47b39f60053243a8ba60b65d77561363, role_id=719e5c62188d4f8a838987d6e72ca8f7)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:12.697931 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d327a81-c0ff-41d2-bfdd-ebfa746d02c5 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:12.713364 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1127/2283] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:05:12 2022] PUT /identity/v3/projects/5710e35dd4cc421b8bd4326f3d5e8467/users/47b39f60053243a8ba60b65d77561363/roles/719e5c62188d4f8a838987d6e72ca8f7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:05:12.727379 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126cd6b9-483c-4d64-8b57-45ba75036b90 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:12.727702 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126cd6b9-483c-4d64-8b57-45ba75036b90 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:12.727980 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126cd6b9-483c-4d64-8b57-45ba75036b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:12.760943 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-126cd6b9-483c-4d64-8b57-45ba75036b90 None None] MFA Rules not processed for user `47b39f60053243a8ba60b65d77561363`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:05:12.762120 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-126cd6b9-483c-4d64-8b57-45ba75036b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:12.829278 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1157/2284] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:05:12 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:05:12.863779 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d327a81-c0ff-41d2-bfdd-ebfa746d02c5 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:12.867166 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-6d327a81-c0ff-41d2-bfdd-ebfa746d02c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:12.930299 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d327a81-c0ff-41d2-bfdd-ebfa746d02c5 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:12.934024 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ac19b9-8cdb-4d07-9e05-0c37387ca5e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b8a09704b9b4ab2bffb813796ec6e77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:12.934630 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac19b9-8cdb-4d07-9e05-0c37387ca5e6 service cinder] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:12.934914 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac19b9-8cdb-4d07-9e05-0c37387ca5e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:12.935190 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac19b9-8cdb-4d07-9e05-0c37387ca5e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:12.944355 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ac19b9-8cdb-4d07-9e05-0c37387ca5e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:12.945896 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ac19b9-8cdb-4d07-9e05-0c37387ca5e6 service cinder] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:12.955134 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1128/2285] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:05:12 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:05:12.970635 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126cd6b9-483c-4d64-8b57-45ba75036b90 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:13.032503 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126cd6b9-483c-4d64-8b57-45ba75036b90 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:13.037108 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4386f3a8-914e-4dd7-b2ac-88a4ec09c807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:13.037756 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386f3a8-914e-4dd7-b2ac-88a4ec09c807 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:13.038031 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386f3a8-914e-4dd7-b2ac-88a4ec09c807 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:13.038300 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386f3a8-914e-4dd7-b2ac-88a4ec09c807 admin admin] PATH_INFO: `/v3/users/47b39f60053243a8ba60b65d77561363` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:13.039449 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4386f3a8-914e-4dd7-b2ac-88a4ec09c807 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47b39f60053243a8ba60b65d77561363)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:13.041641 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4386f3a8-914e-4dd7-b2ac-88a4ec09c807 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:13.100050 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-4386f3a8-914e-4dd7-b2ac-88a4ec09c807 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47b39f60053243a8ba60b65d77561363'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:13.102038 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-4386f3a8-914e-4dd7-b2ac-88a4ec09c807 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47b39f60053243a8ba60b65d77561363'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:13.110718 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-4386f3a8-914e-4dd7-b2ac-88a4ec09c807 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47b39f60053243a8ba60b65d77561363'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:13.126036 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-4386f3a8-914e-4dd7-b2ac-88a4ec09c807 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47b39f60053243a8ba60b65d77561363'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:13.136331 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-4386f3a8-914e-4dd7-b2ac-88a4ec09c807 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47b39f60053243a8ba60b65d77561363'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:13.137925 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:05:13.146377 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1158/2286] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:05:12 2022] DELETE /identity/v3/users/47b39f60053243a8ba60b65d77561363 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:05:13.151017 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb2378-c263-4f53-9f98-281b07866c3b None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:13.151514 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb2378-c263-4f53-9f98-281b07866c3b None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:13.151607 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb2378-c263-4f53-9f98-281b07866c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:13.170807 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-2fdb2378-c263-4f53-9f98-281b07866c3b None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:05:13.172021 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-2fdb2378-c263-4f53-9f98-281b07866c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:13.235905 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1129/2287] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:05:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:05:13.245840 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4386f3a8-914e-4dd7-b2ac-88a4ec09c807 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:13.247256 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-4386f3a8-914e-4dd7-b2ac-88a4ec09c807 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:13.304613 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4386f3a8-914e-4dd7-b2ac-88a4ec09c807 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:13.308361 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e848d27-52bf-4d5f-98a8-1c145ff88945 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:13.308972 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e848d27-52bf-4d5f-98a8-1c145ff88945 service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:13.309252 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e848d27-52bf-4d5f-98a8-1c145ff88945 service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:13.309541 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e848d27-52bf-4d5f-98a8-1c145ff88945 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:13.319515 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e848d27-52bf-4d5f-98a8-1c145ff88945 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:13.320971 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e848d27-52bf-4d5f-98a8-1c145ff88945 service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:13.331082 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1159/2288] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:05:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:05:13.602005 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdb2378-c263-4f53-9f98-281b07866c3b None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:13.603744 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-2fdb2378-c263-4f53-9f98-281b07866c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:13.620088 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdb2378-c263-4f53-9f98-281b07866c3b None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:13.626139 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c06082e-4ccc-47fb-8171-32b9d5210126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:13.627071 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c06082e-4ccc-47fb-8171-32b9d5210126 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:13.627415 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c06082e-4ccc-47fb-8171-32b9d5210126 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:13.627992 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c06082e-4ccc-47fb-8171-32b9d5210126 admin admin] PATH_INFO: `/v3/projects/5710e35dd4cc421b8bd4326f3d5e8467` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:13.629374 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c06082e-4ccc-47fb-8171-32b9d5210126 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5710e35dd4cc421b8bd4326f3d5e8467)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:13.631325 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c06082e-4ccc-47fb-8171-32b9d5210126 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:13.697894 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:05:13.726604 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-3c06082e-4ccc-47fb-8171-32b9d5210126 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5710e35dd4cc421b8bd4326f3d5e8467', 'request_id': 'req-3c06082e-4ccc-47fb-8171-32b9d5210126'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:13.736370 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-3c06082e-4ccc-47fb-8171-32b9d5210126 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5710e35dd4cc421b8bd4326f3d5e8467', 'request_id': 'req-3c06082e-4ccc-47fb-8171-32b9d5210126'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:13.744363 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-3c06082e-4ccc-47fb-8171-32b9d5210126 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5710e35dd4cc421b8bd4326f3d5e8467', 'request_id': 'req-3c06082e-4ccc-47fb-8171-32b9d5210126'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:13.757923 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-3c06082e-4ccc-47fb-8171-32b9d5210126 admin admin] The token cache is being invalidate because project 5710e35dd4cc421b8bd4326f3d5e8467 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:05:13.758212 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-3c06082e-4ccc-47fb-8171-32b9d5210126 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:13.758864 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-3c06082e-4ccc-47fb-8171-32b9d5210126 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:13.760428 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1130/2289] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:05:13 2022] DELETE /identity/v3/projects/5710e35dd4cc421b8bd4326f3d5e8467 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:05:13.765254 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6b0652-7a31-43a4-a521-93a3fd19de3a None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:13.765609 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6b0652-7a31-43a4-a521-93a3fd19de3a None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:13.765851 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6b0652-7a31-43a4-a521-93a3fd19de3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:13.787501 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-5f6b0652-7a31-43a4-a521-93a3fd19de3a None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:05:13.788727 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-5f6b0652-7a31-43a4-a521-93a3fd19de3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:13.859367 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1160/2290] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:05:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:05:13.867961 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e42c6-ca34-43b1-bebc-26728649add6 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:13.868248 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e42c6-ca34-43b1-bebc-26728649add6 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:13.868578 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e42c6-ca34-43b1-bebc-26728649add6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:13.891258 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-2e3e42c6-ca34-43b1-bebc-26728649add6 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:05:13.892934 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-2e3e42c6-ca34-43b1-bebc-26728649add6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:13.902667 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1131/2291] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:05:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:05:13.907465 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6b0652-7a31-43a4-a521-93a3fd19de3a None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:13.931872 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6b0652-7a31-43a4-a521-93a3fd19de3a None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:13.937276 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f911ac-ce01-4e1c-9ccf-9bbdce126c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:13.938102 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f911ac-ce01-4e1c-9ccf-9bbdce126c43 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:13.938418 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f911ac-ce01-4e1c-9ccf-9bbdce126c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:13.938742 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f911ac-ce01-4e1c-9ccf-9bbdce126c43 admin admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:13.939344 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f911ac-ce01-4e1c-9ccf-9bbdce126c43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:05:13.939678 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f911ac-ce01-4e1c-9ccf-9bbdce126c43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:13.941968 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f911ac-ce01-4e1c-9ccf-9bbdce126c43 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:13.975682 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1161/2292] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Aug 18 11:05:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:05:13.977725 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3e42c6-ca34-43b1-bebc-26728649add6 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:13.989223 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3e42c6-ca34-43b1-bebc-26728649add6 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:13.996248 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c3cff7-262d-4202-a0c7-7bdb94dc2407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:13.996960 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3cff7-262d-4202-a0c7-7bdb94dc2407 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:13.997248 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3cff7-262d-4202-a0c7-7bdb94dc2407 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:13.997619 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3cff7-262d-4202-a0c7-7bdb94dc2407 admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:13.998333 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c3cff7-262d-4202-a0c7-7bdb94dc2407 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:14.000314 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c3cff7-262d-4202-a0c7-7bdb94dc2407 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:14.040689 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1132/2293] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:05:13 2022] POST /identity/v3/projects => generated 375 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:05:14.044687 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f911ac-ce01-4e1c-9ccf-9bbdce126c43 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:14.056400 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f911ac-ce01-4e1c-9ccf-9bbdce126c43 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:14.123916 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872ca252-7758-4903-910b-76da4ab2ae2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:14.123916 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ca252-7758-4903-910b-76da4ab2ae2e admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:14.124313 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ca252-7758-4903-910b-76da4ab2ae2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:14.124739 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ca252-7758-4903-910b-76da4ab2ae2e admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:14.125306 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872ca252-7758-4903-910b-76da4ab2ae2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:14.127906 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872ca252-7758-4903-910b-76da4ab2ae2e admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:14.153667 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1162/2294] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:05:14 2022] POST /identity/v3/users => generated 288 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:05:14.157369 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c3cff7-262d-4202-a0c7-7bdb94dc2407 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:14.171007 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c3cff7-262d-4202-a0c7-7bdb94dc2407 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:14.178136 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dddcc73-6a43-4713-b8ae-d190e1f3e158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:14.178768 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dddcc73-6a43-4713-b8ae-d190e1f3e158 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:14.179080 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dddcc73-6a43-4713-b8ae-d190e1f3e158 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:14.179301 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dddcc73-6a43-4713-b8ae-d190e1f3e158 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:14.179953 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dddcc73-6a43-4713-b8ae-d190e1f3e158 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:14.181605 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dddcc73-6a43-4713-b8ae-d190e1f3e158 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:14.193392 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1133/2295] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:05:14 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:05:14.197468 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872ca252-7758-4903-910b-76da4ab2ae2e admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:14.221772 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872ca252-7758-4903-910b-76da4ab2ae2e admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:14.235320 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e07ec5a-90ee-47fe-9cb1-ad788474b00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:14.236127 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07ec5a-90ee-47fe-9cb1-ad788474b00f admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:14.236616 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07ec5a-90ee-47fe-9cb1-ad788474b00f admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:14.237776 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07ec5a-90ee-47fe-9cb1-ad788474b00f admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:14.238585 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e07ec5a-90ee-47fe-9cb1-ad788474b00f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:14.240394 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e07ec5a-90ee-47fe-9cb1-ad788474b00f admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:14.253606 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1163/2296] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:05:14 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:05:14.263161 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dddcc73-6a43-4713-b8ae-d190e1f3e158 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:14.275790 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dddcc73-6a43-4713-b8ae-d190e1f3e158 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:14.281286 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607f3f8d-0785-4862-83d7-8b803df37159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:14.281972 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607f3f8d-0785-4862-83d7-8b803df37159 admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:14.282584 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607f3f8d-0785-4862-83d7-8b803df37159 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:14.282867 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607f3f8d-0785-4862-83d7-8b803df37159 admin admin] PATH_INFO: `/v3/projects/708ed01b420d454a98315e3b6ced5c98/users/599ea262d3774aff88eda3672e0346c4/roles/719e5c62188d4f8a838987d6e72ca8f7` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:14.301140 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607f3f8d-0785-4862-83d7-8b803df37159 admin admin] RBAC: Authorizing `identity:create_grant(project_id=708ed01b420d454a98315e3b6ced5c98, user_id=599ea262d3774aff88eda3672e0346c4, role_id=719e5c62188d4f8a838987d6e72ca8f7)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:14.306606 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607f3f8d-0785-4862-83d7-8b803df37159 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:14.327123 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1134/2297] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:05:14 2022] PUT /identity/v3/projects/708ed01b420d454a98315e3b6ced5c98/users/599ea262d3774aff88eda3672e0346c4/roles/719e5c62188d4f8a838987d6e72ca8f7 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:05:14.340325 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97397c9c-e9a8-4cf7-9296-981195ff0e68 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:14.340924 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97397c9c-e9a8-4cf7-9296-981195ff0e68 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:14.341202 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97397c9c-e9a8-4cf7-9296-981195ff0e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:14.357389 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:05:14.376046 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-97397c9c-e9a8-4cf7-9296-981195ff0e68 None None] MFA Rules not processed for user `599ea262d3774aff88eda3672e0346c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:05:14.378327 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-97397c9c-e9a8-4cf7-9296-981195ff0e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:14.463415 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1164/2298] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:05:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:05:14.469009 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607f3f8d-0785-4862-83d7-8b803df37159 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:14.583732 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607f3f8d-0785-4862-83d7-8b803df37159 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:14.589990 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9086ef66-bb4d-40fc-a377-28ffc19fffcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:14.590603 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9086ef66-bb4d-40fc-a377-28ffc19fffcb admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:14.590884 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9086ef66-bb4d-40fc-a377-28ffc19fffcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:14.591156 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9086ef66-bb4d-40fc-a377-28ffc19fffcb admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:14.591900 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9086ef66-bb4d-40fc-a377-28ffc19fffcb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:14.593848 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9086ef66-bb4d-40fc-a377-28ffc19fffcb admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:14.629246 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1135/2299] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:05:14 2022] POST /identity/v3/projects => generated 375 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:05:14.633619 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97397c9c-e9a8-4cf7-9296-981195ff0e68 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:14.646832 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97397c9c-e9a8-4cf7-9296-981195ff0e68 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:14.724080 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2c4525-477f-42e8-a3e1-4eb1e8bdd0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:14.724699 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c4525-477f-42e8-a3e1-4eb1e8bdd0f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:14.725055 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c4525-477f-42e8-a3e1-4eb1e8bdd0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:14.725256 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c4525-477f-42e8-a3e1-4eb1e8bdd0f2 admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:14.725944 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2c4525-477f-42e8-a3e1-4eb1e8bdd0f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:14.727910 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2c4525-477f-42e8-a3e1-4eb1e8bdd0f2 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:14.764581 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1165/2300] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:05:14 2022] POST /identity/v3/users => generated 288 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 11:05:14.769762 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9086ef66-bb4d-40fc-a377-28ffc19fffcb admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:14.782306 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9086ef66-bb4d-40fc-a377-28ffc19fffcb admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:14.789081 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bfd8f6-e295-4b7e-b60a-c6f975f1de15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:14.790034 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bfd8f6-e295-4b7e-b60a-c6f975f1de15 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:14.790204 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bfd8f6-e295-4b7e-b60a-c6f975f1de15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:14.790824 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bfd8f6-e295-4b7e-b60a-c6f975f1de15 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:14.791603 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bfd8f6-e295-4b7e-b60a-c6f975f1de15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:14.793387 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bfd8f6-e295-4b7e-b60a-c6f975f1de15 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:14.807978 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1136/2301] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:05:14 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 11:05:14.812942 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2c4525-477f-42e8-a3e1-4eb1e8bdd0f2 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:14.824162 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2c4525-477f-42e8-a3e1-4eb1e8bdd0f2 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:14.829258 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc8c2f1-59a7-4fd0-89bf-66a0e44fd3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:14.829907 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc8c2f1-59a7-4fd0-89bf-66a0e44fd3be admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:14.830184 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc8c2f1-59a7-4fd0-89bf-66a0e44fd3be admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:14.832105 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc8c2f1-59a7-4fd0-89bf-66a0e44fd3be admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:14.832253 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc8c2f1-59a7-4fd0-89bf-66a0e44fd3be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:14.833824 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc8c2f1-59a7-4fd0-89bf-66a0e44fd3be admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:14.845585 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1166/2302] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:05:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 11:05:14.850911 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bfd8f6-e295-4b7e-b60a-c6f975f1de15 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:14.864877 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bfd8f6-e295-4b7e-b60a-c6f975f1de15 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:14.871199 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4aaccf-c1e3-4996-a8f1-c8b11cc9690f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:14.872220 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4aaccf-c1e3-4996-a8f1-c8b11cc9690f admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:14.872625 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4aaccf-c1e3-4996-a8f1-c8b11cc9690f admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:14.873018 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4aaccf-c1e3-4996-a8f1-c8b11cc9690f admin admin] PATH_INFO: `/v3/projects/2d894790e8b14cf88abdc4c0c201d100/users/0023fade0ad14b1d97a85e500d26e42e/roles/719e5c62188d4f8a838987d6e72ca8f7` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:14.895081 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4aaccf-c1e3-4996-a8f1-c8b11cc9690f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d894790e8b14cf88abdc4c0c201d100, user_id=0023fade0ad14b1d97a85e500d26e42e, role_id=719e5c62188d4f8a838987d6e72ca8f7)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:14.899618 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4aaccf-c1e3-4996-a8f1-c8b11cc9690f admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:14.909114 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:05:14.916336 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1137/2303] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:05:14 2022] PUT /identity/v3/projects/2d894790e8b14cf88abdc4c0c201d100/users/0023fade0ad14b1d97a85e500d26e42e/roles/719e5c62188d4f8a838987d6e72ca8f7 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:05:14.928374 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a7869-3277-4247-8e47-5c842ec77dfa None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:14.928762 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a7869-3277-4247-8e47-5c842ec77dfa None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:14.929108 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a7869-3277-4247-8e47-5c842ec77dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:14.962749 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-6c5a7869-3277-4247-8e47-5c842ec77dfa None None] MFA Rules not processed for user `0023fade0ad14b1d97a85e500d26e42e`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:05:14.964064 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-6c5a7869-3277-4247-8e47-5c842ec77dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:15.055176 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1167/2304] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:05:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:05:15.056241 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4aaccf-c1e3-4996-a8f1-c8b11cc9690f admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:15.141864 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4aaccf-c1e3-4996-a8f1-c8b11cc9690f admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:15.148296 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83121b7c-4c8c-40be-b74a-914c2144b9cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:15.149323 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83121b7c-4c8c-40be-b74a-914c2144b9cb admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:15.149879 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83121b7c-4c8c-40be-b74a-914c2144b9cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:15.150378 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83121b7c-4c8c-40be-b74a-914c2144b9cb admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:15.151065 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83121b7c-4c8c-40be-b74a-914c2144b9cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:15.156155 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83121b7c-4c8c-40be-b74a-914c2144b9cb admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:15.197058 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1138/2305] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:05:15 2022] POST /identity/v3/projects => generated 375 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:05:15.201295 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a7869-3277-4247-8e47-5c842ec77dfa None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:15.214928 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:05:15.224638 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a7869-3277-4247-8e47-5c842ec77dfa None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:15.319342 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4e4b7c-8601-4bd4-92b6-25c3e5686806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:15.319964 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e4b7c-8601-4bd4-92b6-25c3e5686806 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:15.320387 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e4b7c-8601-4bd4-92b6-25c3e5686806 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:15.320663 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e4b7c-8601-4bd4-92b6-25c3e5686806 admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:15.321348 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4e4b7c-8601-4bd4-92b6-25c3e5686806 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:15.323959 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4e4b7c-8601-4bd4-92b6-25c3e5686806 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:15.352106 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1168/2306] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:05:15 2022] POST /identity/v3/users => generated 294 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:05:15.355955 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83121b7c-4c8c-40be-b74a-914c2144b9cb admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:15.372742 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83121b7c-4c8c-40be-b74a-914c2144b9cb admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:15.378578 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18d5995-0a8f-4a94-8ced-badb942f5637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:15.379379 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18d5995-0a8f-4a94-8ced-badb942f5637 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:15.379821 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18d5995-0a8f-4a94-8ced-badb942f5637 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:15.380432 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18d5995-0a8f-4a94-8ced-badb942f5637 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:15.381084 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18d5995-0a8f-4a94-8ced-badb942f5637 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:15.383109 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18d5995-0a8f-4a94-8ced-badb942f5637 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:15.397736 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1139/2307] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:05:15 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:05:15.400410 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4e4b7c-8601-4bd4-92b6-25c3e5686806 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:15.413635 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4e4b7c-8601-4bd4-92b6-25c3e5686806 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:15.421658 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f05691-c25c-4c3c-af95-5dec15cbde24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:15.422464 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f05691-c25c-4c3c-af95-5dec15cbde24 admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:15.422699 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f05691-c25c-4c3c-af95-5dec15cbde24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:15.422942 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f05691-c25c-4c3c-af95-5dec15cbde24 admin admin] PATH_INFO: `/v3/projects/c7a9cacb4fbf4b2884b986090018761c/users/1ebbf9bf547a47bb82fe1cbb2819e620/roles/127fdc7ef05b4e0b98a940b334e5fcab` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:15.445078 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f05691-c25c-4c3c-af95-5dec15cbde24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7a9cacb4fbf4b2884b986090018761c, user_id=1ebbf9bf547a47bb82fe1cbb2819e620, role_id=127fdc7ef05b4e0b98a940b334e5fcab)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:15.461385 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f05691-c25c-4c3c-af95-5dec15cbde24 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:15.517322 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1169/2308] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:05:15 2022] PUT /identity/v3/projects/c7a9cacb4fbf4b2884b986090018761c/users/1ebbf9bf547a47bb82fe1cbb2819e620/roles/127fdc7ef05b4e0b98a940b334e5fcab => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:05:15.522352 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18d5995-0a8f-4a94-8ced-badb942f5637 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:15.535375 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18d5995-0a8f-4a94-8ced-badb942f5637 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:15.617658 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86ba1f3-c5a6-494b-8ccb-b7880fa4d577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:15.618928 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86ba1f3-c5a6-494b-8ccb-b7880fa4d577 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:15.619217 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86ba1f3-c5a6-494b-8ccb-b7880fa4d577 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:15.619495 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86ba1f3-c5a6-494b-8ccb-b7880fa4d577 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:15.620151 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86ba1f3-c5a6-494b-8ccb-b7880fa4d577 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:15.621791 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86ba1f3-c5a6-494b-8ccb-b7880fa4d577 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:15.634010 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1140/2309] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:05:15 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:05:15.638255 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f05691-c25c-4c3c-af95-5dec15cbde24 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:15.652509 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f05691-c25c-4c3c-af95-5dec15cbde24 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:15.660029 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342b42ae-450f-4fdc-9bf1-d3672543d28e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:15.660870 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342b42ae-450f-4fdc-9bf1-d3672543d28e admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:15.661207 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342b42ae-450f-4fdc-9bf1-d3672543d28e admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:15.661483 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342b42ae-450f-4fdc-9bf1-d3672543d28e admin admin] PATH_INFO: `/v3/projects/c7a9cacb4fbf4b2884b986090018761c/users/1ebbf9bf547a47bb82fe1cbb2819e620/roles/127fdc7ef05b4e0b98a940b334e5fcab` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:15.664971 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342b42ae-450f-4fdc-9bf1-d3672543d28e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7a9cacb4fbf4b2884b986090018761c, user_id=1ebbf9bf547a47bb82fe1cbb2819e620, role_id=127fdc7ef05b4e0b98a940b334e5fcab)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:15.668437 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342b42ae-450f-4fdc-9bf1-d3672543d28e admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:15.682320 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1170/2310] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:05:15 2022] PUT /identity/v3/projects/c7a9cacb4fbf4b2884b986090018761c/users/1ebbf9bf547a47bb82fe1cbb2819e620/roles/127fdc7ef05b4e0b98a940b334e5fcab => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:05:15.692678 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e844304e-79b6-49cb-ba10-a0de54418fbf None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:15.692988 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e844304e-79b6-49cb-ba10-a0de54418fbf None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:15.693249 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e844304e-79b6-49cb-ba10-a0de54418fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:15.732552 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-e844304e-79b6-49cb-ba10-a0de54418fbf None None] MFA Rules not processed for user `1ebbf9bf547a47bb82fe1cbb2819e620`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:05:15.734325 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-e844304e-79b6-49cb-ba10-a0de54418fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:15.813858 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:05:15.826786 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1141/2311] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:05:15 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:05:15.840615 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342b42ae-450f-4fdc-9bf1-d3672543d28e admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:15.842627 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-342b42ae-450f-4fdc-9bf1-d3672543d28e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:15.922204 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342b42ae-450f-4fdc-9bf1-d3672543d28e admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:15.928696 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28d4f19-ac89-4426-9989-39b365453633 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b8a09704b9b4ab2bffb813796ec6e77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:15.930318 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d4f19-ac89-4426-9989-39b365453633 service cinder] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:15.930926 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d4f19-ac89-4426-9989-39b365453633 service cinder] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:15.931606 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d4f19-ac89-4426-9989-39b365453633 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:16.063205 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28d4f19-ac89-4426-9989-39b365453633 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:16.066067 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28d4f19-ac89-4426-9989-39b365453633 service cinder] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:16.076817 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1171/2312] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:05:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:05:19.943359 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e844304e-79b6-49cb-ba10-a0de54418fbf None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:19.944906 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-e844304e-79b6-49cb-ba10-a0de54418fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:19.963013 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e844304e-79b6-49cb-ba10-a0de54418fbf None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:19.967028 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ed1c93-47f7-4ff4-851e-c8046af23a2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b8a09704b9b4ab2bffb813796ec6e77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:19.967791 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed1c93-47f7-4ff4-851e-c8046af23a2e service cinder] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:19.968165 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed1c93-47f7-4ff4-851e-c8046af23a2e service cinder] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:19.968450 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed1c93-47f7-4ff4-851e-c8046af23a2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:20.089591 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ed1c93-47f7-4ff4-851e-c8046af23a2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:20.091134 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ed1c93-47f7-4ff4-851e-c8046af23a2e service cinder] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:20.102023 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1142/2313] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:05:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:05:23.308327 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28d4f19-ac89-4426-9989-39b365453633 service cinder] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:23.322510 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28d4f19-ac89-4426-9989-39b365453633 service cinder] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:23.326898 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9409dd-cfe4-4034-8298-3cd02c275f8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b8a09704b9b4ab2bffb813796ec6e77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:23.327534 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9409dd-cfe4-4034-8298-3cd02c275f8a service cinder] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:23.327796 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9409dd-cfe4-4034-8298-3cd02c275f8a service cinder] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:23.328377 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9409dd-cfe4-4034-8298-3cd02c275f8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:23.343277 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9409dd-cfe4-4034-8298-3cd02c275f8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:23.345181 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9409dd-cfe4-4034-8298-3cd02c275f8a service cinder] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:23.360986 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:05:23.371610 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1172/2314] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:05:23 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:05:27.940204 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ed1c93-47f7-4ff4-851e-c8046af23a2e service cinder] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:28.151393 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ed1c93-47f7-4ff4-851e-c8046af23a2e service cinder] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:28.162635 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99474d8-f293-4fda-a689-0e2364793bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:28.166673 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99474d8-f293-4fda-a689-0e2364793bb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:28.166673 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99474d8-f293-4fda-a689-0e2364793bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:28.167992 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99474d8-f293-4fda-a689-0e2364793bb5 admin admin] PATH_INFO: `/v3/users/599ea262d3774aff88eda3672e0346c4` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:28.169312 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99474d8-f293-4fda-a689-0e2364793bb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=599ea262d3774aff88eda3672e0346c4)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:28.187898 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99474d8-f293-4fda-a689-0e2364793bb5 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:28.281991 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-e99474d8-f293-4fda-a689-0e2364793bb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '599ea262d3774aff88eda3672e0346c4'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:28.291427 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-e99474d8-f293-4fda-a689-0e2364793bb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '599ea262d3774aff88eda3672e0346c4'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:28.292170 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-e99474d8-f293-4fda-a689-0e2364793bb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '599ea262d3774aff88eda3672e0346c4'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:28.292999 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-e99474d8-f293-4fda-a689-0e2364793bb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '599ea262d3774aff88eda3672e0346c4'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:28.308180 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-e99474d8-f293-4fda-a689-0e2364793bb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '599ea262d3774aff88eda3672e0346c4'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:28.343906 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0fd017-bcdf-4c8f-a43e-d65d75ca20e4 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:28.344688 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0fd017-bcdf-4c8f-a43e-d65d75ca20e4 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:28.344688 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0fd017-bcdf-4c8f-a43e-d65d75ca20e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:28.347205 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1143/2315] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:05:27 2022] DELETE /identity/v3/users/599ea262d3774aff88eda3672e0346c4 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:05:28.366827 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-bf0fd017-bcdf-4c8f-a43e-d65d75ca20e4 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:05:28.368127 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-bf0fd017-bcdf-4c8f-a43e-d65d75ca20e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:28.510758 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99474d8-f293-4fda-a689-0e2364793bb5 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:28.512223 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-e99474d8-f293-4fda-a689-0e2364793bb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:28.515590 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1173/2316] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:05:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:05:28.556014 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:05:28.655354 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99474d8-f293-4fda-a689-0e2364793bb5 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:28.661018 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef7a732-f07f-497b-998d-0b79e52bea1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:28.661687 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef7a732-f07f-497b-998d-0b79e52bea1b service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:28.661968 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef7a732-f07f-497b-998d-0b79e52bea1b service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:28.662251 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef7a732-f07f-497b-998d-0b79e52bea1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:28.675253 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef7a732-f07f-497b-998d-0b79e52bea1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:28.676713 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef7a732-f07f-497b-998d-0b79e52bea1b service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:28.690258 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1144/2317] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:05:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 11:05:29.085750 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0fd017-bcdf-4c8f-a43e-d65d75ca20e4 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:29.087558 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-bf0fd017-bcdf-4c8f-a43e-d65d75ca20e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:29.105292 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0fd017-bcdf-4c8f-a43e-d65d75ca20e4 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:29.123351 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e826ede-88ce-4096-a99e-9f19efb5dfca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:29.124045 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e826ede-88ce-4096-a99e-9f19efb5dfca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:29.124596 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e826ede-88ce-4096-a99e-9f19efb5dfca admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:29.125497 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e826ede-88ce-4096-a99e-9f19efb5dfca admin admin] PATH_INFO: `/v3/projects/708ed01b420d454a98315e3b6ced5c98` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:29.144482 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e826ede-88ce-4096-a99e-9f19efb5dfca admin admin] RBAC: Authorizing `identity:delete_project(project_id=708ed01b420d454a98315e3b6ced5c98)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:29.147964 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e826ede-88ce-4096-a99e-9f19efb5dfca admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:29.264033 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-9e826ede-88ce-4096-a99e-9f19efb5dfca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '708ed01b420d454a98315e3b6ced5c98', 'request_id': 'req-9e826ede-88ce-4096-a99e-9f19efb5dfca'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:29.282920 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-9e826ede-88ce-4096-a99e-9f19efb5dfca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '708ed01b420d454a98315e3b6ced5c98', 'request_id': 'req-9e826ede-88ce-4096-a99e-9f19efb5dfca'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:29.298346 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-9e826ede-88ce-4096-a99e-9f19efb5dfca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '708ed01b420d454a98315e3b6ced5c98', 'request_id': 'req-9e826ede-88ce-4096-a99e-9f19efb5dfca'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:29.313880 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-9e826ede-88ce-4096-a99e-9f19efb5dfca admin admin] The token cache is being invalidate because project 708ed01b420d454a98315e3b6ced5c98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:05:29.314509 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-9e826ede-88ce-4096-a99e-9f19efb5dfca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:29.317091 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-9e826ede-88ce-4096-a99e-9f19efb5dfca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:29.319376 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1174/2318] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:05:29 2022] DELETE /identity/v3/projects/708ed01b420d454a98315e3b6ced5c98 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:05:29.323959 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef7a732-f07f-497b-998d-0b79e52bea1b service neutron] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:29.340887 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef7a732-f07f-497b-998d-0b79e52bea1b service neutron] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:29.433833 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a877a1-148d-46e5-9f25-5eca835efdc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:29.434482 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a877a1-148d-46e5-9f25-5eca835efdc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:29.434761 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a877a1-148d-46e5-9f25-5eca835efdc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:29.435030 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a877a1-148d-46e5-9f25-5eca835efdc5 admin admin] PATH_INFO: `/v3/users/0023fade0ad14b1d97a85e500d26e42e` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:29.436714 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a877a1-148d-46e5-9f25-5eca835efdc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0023fade0ad14b1d97a85e500d26e42e)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:29.443068 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a877a1-148d-46e5-9f25-5eca835efdc5 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:29.554226 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-b4a877a1-148d-46e5-9f25-5eca835efdc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0023fade0ad14b1d97a85e500d26e42e'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:29.569391 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-b4a877a1-148d-46e5-9f25-5eca835efdc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0023fade0ad14b1d97a85e500d26e42e'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:29.570968 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-b4a877a1-148d-46e5-9f25-5eca835efdc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0023fade0ad14b1d97a85e500d26e42e'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:29.572054 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-b4a877a1-148d-46e5-9f25-5eca835efdc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0023fade0ad14b1d97a85e500d26e42e'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:29.591195 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-b4a877a1-148d-46e5-9f25-5eca835efdc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0023fade0ad14b1d97a85e500d26e42e'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:29.668043 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1145/2319] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:05:29 2022] DELETE /identity/v3/users/0023fade0ad14b1d97a85e500d26e42e => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:05:29.961920 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e826ede-88ce-4096-a99e-9f19efb5dfca admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:29.965668 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-9e826ede-88ce-4096-a99e-9f19efb5dfca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:29.983333 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e826ede-88ce-4096-a99e-9f19efb5dfca admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:30.088171 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58f3254-fb08-4df7-aac4-4ddc4590d730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:30.093687 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f3254-fb08-4df7-aac4-4ddc4590d730 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:30.094330 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f3254-fb08-4df7-aac4-4ddc4590d730 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:30.094613 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f3254-fb08-4df7-aac4-4ddc4590d730 admin admin] PATH_INFO: `/v3/users/db066400959541c488a801ae68dedc39` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:30.113678 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58f3254-fb08-4df7-aac4-4ddc4590d730 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db066400959541c488a801ae68dedc39)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:30.115662 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58f3254-fb08-4df7-aac4-4ddc4590d730 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:30.197596 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:05:30.243970 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-c58f3254-fb08-4df7-aac4-4ddc4590d730 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db066400959541c488a801ae68dedc39'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:30.245111 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-c58f3254-fb08-4df7-aac4-4ddc4590d730 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db066400959541c488a801ae68dedc39'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:30.255447 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-c58f3254-fb08-4df7-aac4-4ddc4590d730 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db066400959541c488a801ae68dedc39'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:30.278324 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-c58f3254-fb08-4df7-aac4-4ddc4590d730 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db066400959541c488a801ae68dedc39'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:30.291411 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-c58f3254-fb08-4df7-aac4-4ddc4590d730 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db066400959541c488a801ae68dedc39'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:30.304465 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1175/2320] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:05:29 2022] DELETE /identity/v3/users/db066400959541c488a801ae68dedc39 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:05:30.307343 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f05cd-1803-4f90-9fe2-3aad0f5dd336 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:30.307662 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f05cd-1803-4f90-9fe2-3aad0f5dd336 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:30.307961 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f05cd-1803-4f90-9fe2-3aad0f5dd336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:30.365328 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-818f05cd-1803-4f90-9fe2-3aad0f5dd336 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:05:30.367924 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-818f05cd-1803-4f90-9fe2-3aad0f5dd336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:30.413872 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58f3254-fb08-4df7-aac4-4ddc4590d730 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:30.415452 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-c58f3254-fb08-4df7-aac4-4ddc4590d730 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:30.491331 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:05:30.589948 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1146/2321] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:05:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:05:30.649013 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818f05cd-1803-4f90-9fe2-3aad0f5dd336 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:30.650625 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-818f05cd-1803-4f90-9fe2-3aad0f5dd336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:30.673429 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58f3254-fb08-4df7-aac4-4ddc4590d730 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:30.703869 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceef097-7161-4bc2-a33b-d45152db589b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:30.704557 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceef097-7161-4bc2-a33b-d45152db589b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:30.704836 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceef097-7161-4bc2-a33b-d45152db589b admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:30.705188 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceef097-7161-4bc2-a33b-d45152db589b admin admin] PATH_INFO: `/v3/projects/2d894790e8b14cf88abdc4c0c201d100` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:30.706469 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceef097-7161-4bc2-a33b-d45152db589b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d894790e8b14cf88abdc4c0c201d100)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:30.708740 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceef097-7161-4bc2-a33b-d45152db589b admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:30.809658 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818f05cd-1803-4f90-9fe2-3aad0f5dd336 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:30.834492 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-5ceef097-7161-4bc2-a33b-d45152db589b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d894790e8b14cf88abdc4c0c201d100', 'request_id': 'req-5ceef097-7161-4bc2-a33b-d45152db589b'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:30.848994 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-5ceef097-7161-4bc2-a33b-d45152db589b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d894790e8b14cf88abdc4c0c201d100', 'request_id': 'req-5ceef097-7161-4bc2-a33b-d45152db589b'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:30.865503 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-5ceef097-7161-4bc2-a33b-d45152db589b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d894790e8b14cf88abdc4c0c201d100', 'request_id': 'req-5ceef097-7161-4bc2-a33b-d45152db589b'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:30.881590 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-5ceef097-7161-4bc2-a33b-d45152db589b admin admin] The token cache is being invalidate because project 2d894790e8b14cf88abdc4c0c201d100 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:05:30.881786 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-5ceef097-7161-4bc2-a33b-d45152db589b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:30.882667 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-5ceef097-7161-4bc2-a33b-d45152db589b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:30.884211 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1176/2322] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:05:30 2022] DELETE /identity/v3/projects/2d894790e8b14cf88abdc4c0c201d100 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:05:30.885082 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceef097-7161-4bc2-a33b-d45152db589b admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:30.888471 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-5ceef097-7161-4bc2-a33b-d45152db589b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:30.901648 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf46d299-dfe4-4a00-95eb-16566ed6d930 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:30.902282 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46d299-dfe4-4a00-95eb-16566ed6d930 service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:30.902562 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46d299-dfe4-4a00-95eb-16566ed6d930 service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:30.902834 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46d299-dfe4-4a00-95eb-16566ed6d930 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:30.907201 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-bf46d299-dfe4-4a00-95eb-16566ed6d930 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:30.950103 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:05:31.006097 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceef097-7161-4bc2-a33b-d45152db589b admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:31.010483 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf46d299-dfe4-4a00-95eb-16566ed6d930 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:31.012488 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf46d299-dfe4-4a00-95eb-16566ed6d930 service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:31.014325 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1be4541-1ca0-4fc0-9186-4f47bfe01bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:31.015222 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1be4541-1ca0-4fc0-9186-4f47bfe01bf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:31.015662 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1be4541-1ca0-4fc0-9186-4f47bfe01bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:31.016820 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1be4541-1ca0-4fc0-9186-4f47bfe01bf4 admin admin] PATH_INFO: `/v3/users/3863d0bcec574ad8ba0f88dbe8a91bbd` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:31.018338 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1be4541-1ca0-4fc0-9186-4f47bfe01bf4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3863d0bcec574ad8ba0f88dbe8a91bbd)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:31.020686 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1be4541-1ca0-4fc0-9186-4f47bfe01bf4 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:31.037326 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1147/2323] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:05:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:05:31.038693 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf46d299-dfe4-4a00-95eb-16566ed6d930 service neutron] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:31.040135 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-bf46d299-dfe4-4a00-95eb-16566ed6d930 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:31.083018 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf46d299-dfe4-4a00-95eb-16566ed6d930 service neutron] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:31.102237 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d00c161-667e-470f-bbc9-34dc8496a4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:31.102915 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d00c161-667e-470f-bbc9-34dc8496a4c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:31.103209 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d00c161-667e-470f-bbc9-34dc8496a4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:31.103462 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d00c161-667e-470f-bbc9-34dc8496a4c8 admin admin] PATH_INFO: `/v3/users/1ebbf9bf547a47bb82fe1cbb2819e620` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:31.105906 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d00c161-667e-470f-bbc9-34dc8496a4c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ebbf9bf547a47bb82fe1cbb2819e620)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:31.108239 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d00c161-667e-470f-bbc9-34dc8496a4c8 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:31.109644 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-a1be4541-1ca0-4fc0-9186-4f47bfe01bf4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3863d0bcec574ad8ba0f88dbe8a91bbd'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:31.111808 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-a1be4541-1ca0-4fc0-9186-4f47bfe01bf4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3863d0bcec574ad8ba0f88dbe8a91bbd'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:31.131944 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-a1be4541-1ca0-4fc0-9186-4f47bfe01bf4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3863d0bcec574ad8ba0f88dbe8a91bbd'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:31.180976 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-a1be4541-1ca0-4fc0-9186-4f47bfe01bf4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3863d0bcec574ad8ba0f88dbe8a91bbd'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:31.192220 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:05:31.208846 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-a1be4541-1ca0-4fc0-9186-4f47bfe01bf4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3863d0bcec574ad8ba0f88dbe8a91bbd'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:31.219778 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-5d00c161-667e-470f-bbc9-34dc8496a4c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ebbf9bf547a47bb82fe1cbb2819e620'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:31.233312 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-5d00c161-667e-470f-bbc9-34dc8496a4c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ebbf9bf547a47bb82fe1cbb2819e620'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:31.234445 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-5d00c161-667e-470f-bbc9-34dc8496a4c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ebbf9bf547a47bb82fe1cbb2819e620'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:31.235786 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-5d00c161-667e-470f-bbc9-34dc8496a4c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ebbf9bf547a47bb82fe1cbb2819e620'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:31.243012 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1177/2324] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:05:30 2022] DELETE /identity/v3/users/3863d0bcec574ad8ba0f88dbe8a91bbd => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:05:31.252213 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e28e55-adaa-41bd-be26-5ddbb274e645 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:31.253081 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e28e55-adaa-41bd-be26-5ddbb274e645 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:31.253081 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e28e55-adaa-41bd-be26-5ddbb274e645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:31.253637 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-5d00c161-667e-470f-bbc9-34dc8496a4c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ebbf9bf547a47bb82fe1cbb2819e620'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:31.310177 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1148/2325] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:05:31 2022] DELETE /identity/v3/users/1ebbf9bf547a47bb82fe1cbb2819e620 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:05:31.334659 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-78e28e55-adaa-41bd-be26-5ddbb274e645 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:05:31.336516 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-78e28e55-adaa-41bd-be26-5ddbb274e645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:31.464225 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1178/2326] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:05:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:05:31.490404 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d00c161-667e-470f-bbc9-34dc8496a4c8 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:31.493703 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-5d00c161-667e-470f-bbc9-34dc8496a4c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:31.735459 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d00c161-667e-470f-bbc9-34dc8496a4c8 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:31.749073 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515f76fc-cbc3-431a-af9a-f25972a64060 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:31.750213 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f76fc-cbc3-431a-af9a-f25972a64060 service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:31.750905 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f76fc-cbc3-431a-af9a-f25972a64060 service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:31.751474 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f76fc-cbc3-431a-af9a-f25972a64060 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:31.774426 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e28e55-adaa-41bd-be26-5ddbb274e645 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:31.776702 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-78e28e55-adaa-41bd-be26-5ddbb274e645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:31.787218 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515f76fc-cbc3-431a-af9a-f25972a64060 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:31.788701 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515f76fc-cbc3-431a-af9a-f25972a64060 service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:31.803466 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e28e55-adaa-41bd-be26-5ddbb274e645 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:31.815040 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1149/2327] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:05:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:05:31.824758 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f82ddb-b078-4a29-860e-339ad6e2c005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:31.825682 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f82ddb-b078-4a29-860e-339ad6e2c005 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:31.826070 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f82ddb-b078-4a29-860e-339ad6e2c005 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:31.829468 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f82ddb-b078-4a29-860e-339ad6e2c005 admin admin] PATH_INFO: `/v3/projects/f90ac35d39944964b6c09838b28f6a2b` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:31.847472 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f82ddb-b078-4a29-860e-339ad6e2c005 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f90ac35d39944964b6c09838b28f6a2b)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:31.854039 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f82ddb-b078-4a29-860e-339ad6e2c005 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:32.012546 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:05:32.023931 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-78f82ddb-b078-4a29-860e-339ad6e2c005 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f90ac35d39944964b6c09838b28f6a2b', 'request_id': 'req-78f82ddb-b078-4a29-860e-339ad6e2c005'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:32.035721 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-78f82ddb-b078-4a29-860e-339ad6e2c005 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f90ac35d39944964b6c09838b28f6a2b', 'request_id': 'req-78f82ddb-b078-4a29-860e-339ad6e2c005'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:32.048743 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515f76fc-cbc3-431a-af9a-f25972a64060 service neutron] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:32.051269 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-515f76fc-cbc3-431a-af9a-f25972a64060 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:32.056195 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-78f82ddb-b078-4a29-860e-339ad6e2c005 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f90ac35d39944964b6c09838b28f6a2b', 'request_id': 'req-78f82ddb-b078-4a29-860e-339ad6e2c005'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:32.089962 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-78f82ddb-b078-4a29-860e-339ad6e2c005 admin admin] The token cache is being invalidate because project f90ac35d39944964b6c09838b28f6a2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:05:32.090392 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-78f82ddb-b078-4a29-860e-339ad6e2c005 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:32.092657 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515f76fc-cbc3-431a-af9a-f25972a64060 service neutron] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:32.093168 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-78f82ddb-b078-4a29-860e-339ad6e2c005 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:32.098237 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1179/2328] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:05:31 2022] DELETE /identity/v3/projects/f90ac35d39944964b6c09838b28f6a2b => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:05:32.103619 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be16d40-8bc4-4ba8-b04c-9ad64b6774ce None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:32.104047 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be16d40-8bc4-4ba8-b04c-9ad64b6774ce None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:32.104473 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be16d40-8bc4-4ba8-b04c-9ad64b6774ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:32.152954 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-0be16d40-8bc4-4ba8-b04c-9ad64b6774ce None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:05:32.157563 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-0be16d40-8bc4-4ba8-b04c-9ad64b6774ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:32.270319 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1180/2329] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:05:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:05:32.277609 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa15c02-d8be-4e5d-9967-5b8d829ae1cd None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:32.278100 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa15c02-d8be-4e5d-9967-5b8d829ae1cd None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:32.278487 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa15c02-d8be-4e5d-9967-5b8d829ae1cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:32.310897 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-9aa15c02-d8be-4e5d-9967-5b8d829ae1cd None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:05:32.312635 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-9aa15c02-d8be-4e5d-9967-5b8d829ae1cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:32.325818 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1181/2330] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:05:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:05:32.328317 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa15c02-d8be-4e5d-9967-5b8d829ae1cd None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:32.344434 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa15c02-d8be-4e5d-9967-5b8d829ae1cd None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:32.350639 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a15423-ca05-4d37-aa96-45dece2858e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:32.351319 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a15423-ca05-4d37-aa96-45dece2858e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:32.351841 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a15423-ca05-4d37-aa96-45dece2858e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:32.352495 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a15423-ca05-4d37-aa96-45dece2858e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:32.353377 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a15423-ca05-4d37-aa96-45dece2858e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:05:32.353895 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a15423-ca05-4d37-aa96-45dece2858e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:32.355790 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a15423-ca05-4d37-aa96-45dece2858e5 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:32.373267 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1182/2331] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Aug 18 11:05:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:05:32.379060 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a15423-ca05-4d37-aa96-45dece2858e5 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:32.407703 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a15423-ca05-4d37-aa96-45dece2858e5 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:32.439029 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5652b2d1-7ca0-45c6-927a-c6cfd5e21101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:32.441162 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652b2d1-7ca0-45c6-927a-c6cfd5e21101 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:32.443372 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652b2d1-7ca0-45c6-927a-c6cfd5e21101 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:32.444370 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652b2d1-7ca0-45c6-927a-c6cfd5e21101 admin admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:32.445244 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5652b2d1-7ca0-45c6-927a-c6cfd5e21101 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:32.446135 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12ae3da-7f7a-4ec9-bfa7-b3e3a47eab43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:32.462079 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12ae3da-7f7a-4ec9-bfa7-b3e3a47eab43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:32.464294 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12ae3da-7f7a-4ec9-bfa7-b3e3a47eab43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:32.465087 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12ae3da-7f7a-4ec9-bfa7-b3e3a47eab43 admin admin] PATH_INFO: `/v3/projects/c7a9cacb4fbf4b2884b986090018761c` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:32.466355 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5652b2d1-7ca0-45c6-927a-c6cfd5e21101 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:32.470418 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12ae3da-7f7a-4ec9-bfa7-b3e3a47eab43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7a9cacb4fbf4b2884b986090018761c)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:32.484070 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12ae3da-7f7a-4ec9-bfa7-b3e3a47eab43 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:32.595928 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1183/2332] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:05:32 2022] POST /identity/v3/projects => generated 395 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 11:05:32.603767 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5652b2d1-7ca0-45c6-927a-c6cfd5e21101 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:32.609341 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-5652b2d1-7ca0-45c6-927a-c6cfd5e21101 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:32.686125 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-b12ae3da-7f7a-4ec9-bfa7-b3e3a47eab43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7a9cacb4fbf4b2884b986090018761c', 'request_id': 'req-b12ae3da-7f7a-4ec9-bfa7-b3e3a47eab43'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:32.723140 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-b12ae3da-7f7a-4ec9-bfa7-b3e3a47eab43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7a9cacb4fbf4b2884b986090018761c', 'request_id': 'req-b12ae3da-7f7a-4ec9-bfa7-b3e3a47eab43'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:32.732152 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:05:32.757915 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-b12ae3da-7f7a-4ec9-bfa7-b3e3a47eab43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7a9cacb4fbf4b2884b986090018761c', 'request_id': 'req-b12ae3da-7f7a-4ec9-bfa7-b3e3a47eab43'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:32.780850 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5652b2d1-7ca0-45c6-927a-c6cfd5e21101 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:32.795789 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-b12ae3da-7f7a-4ec9-bfa7-b3e3a47eab43 admin admin] The token cache is being invalidate because project c7a9cacb4fbf4b2884b986090018761c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:05:32.796143 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-b12ae3da-7f7a-4ec9-bfa7-b3e3a47eab43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:32.798361 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-b12ae3da-7f7a-4ec9-bfa7-b3e3a47eab43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:32.807967 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1150/2333] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:05:32 2022] DELETE /identity/v3/projects/c7a9cacb4fbf4b2884b986090018761c => generated 0 bytes in 756 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:05:32.813870 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12ae3da-7f7a-4ec9-bfa7-b3e3a47eab43 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:32.818657 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-b12ae3da-7f7a-4ec9-bfa7-b3e3a47eab43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:32.904452 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:05:32.939373 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e04b02-77a6-4c08-b933-e354ca498a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:32.940522 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e04b02-77a6-4c08-b933-e354ca498a59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:32.940972 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e04b02-77a6-4c08-b933-e354ca498a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:32.941396 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e04b02-77a6-4c08-b933-e354ca498a59 admin admin] PATH_INFO: `/v3/projects/ba33e53a114d416aabdaf10df635234e` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:32.955610 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e04b02-77a6-4c08-b933-e354ca498a59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba33e53a114d416aabdaf10df635234e)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:32.957595 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e04b02-77a6-4c08-b933-e354ca498a59 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:33.022258 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12ae3da-7f7a-4ec9-bfa7-b3e3a47eab43 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:33.060481 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a93609a-48d4-4b31-a01f-1ecb034ef574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:33.061942 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a93609a-48d4-4b31-a01f-1ecb034ef574 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:33.062080 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a93609a-48d4-4b31-a01f-1ecb034ef574 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:33.062399 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a93609a-48d4-4b31-a01f-1ecb034ef574 admin admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:33.063179 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a93609a-48d4-4b31-a01f-1ecb034ef574 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:33.063297 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-c5e04b02-77a6-4c08-b933-e354ca498a59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba33e53a114d416aabdaf10df635234e', 'request_id': 'req-c5e04b02-77a6-4c08-b933-e354ca498a59'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:33.068114 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a93609a-48d4-4b31-a01f-1ecb034ef574 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:33.077021 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-c5e04b02-77a6-4c08-b933-e354ca498a59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba33e53a114d416aabdaf10df635234e', 'request_id': 'req-c5e04b02-77a6-4c08-b933-e354ca498a59'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:33.090140 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-c5e04b02-77a6-4c08-b933-e354ca498a59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba33e53a114d416aabdaf10df635234e', 'request_id': 'req-c5e04b02-77a6-4c08-b933-e354ca498a59'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:33.114586 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-c5e04b02-77a6-4c08-b933-e354ca498a59 admin admin] The token cache is being invalidate because project ba33e53a114d416aabdaf10df635234e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:05:33.114948 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-c5e04b02-77a6-4c08-b933-e354ca498a59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:33.115563 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-c5e04b02-77a6-4c08-b933-e354ca498a59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:33.118133 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1184/2334] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:05:32 2022] DELETE /identity/v3/projects/ba33e53a114d416aabdaf10df635234e => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:05:33.123539 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02c013-0628-4a76-9bad-c677d2714fdc None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:33.123882 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02c013-0628-4a76-9bad-c677d2714fdc None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:33.124165 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02c013-0628-4a76-9bad-c677d2714fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:33.124897 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1151/2335] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:05:32 2022] POST /identity/v3/users => generated 298 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:05:33.126205 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d3d81-249d-41db-b33d-d8552be85a94 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:33.126497 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d3d81-249d-41db-b33d-d8552be85a94 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:33.126793 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d3d81-249d-41db-b33d-d8552be85a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:33.163177 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-0f02c013-0628-4a76-9bad-c677d2714fdc None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:05:33.165029 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-0f02c013-0628-4a76-9bad-c677d2714fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:33.170561 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-f46d3d81-249d-41db-b33d-d8552be85a94 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:05:33.171898 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-f46d3d81-249d-41db-b33d-d8552be85a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:33.300812 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1185/2336] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:05:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:05:33.300812 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f02c013-0628-4a76-9bad-c677d2714fdc None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:33.300812 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-0f02c013-0628-4a76-9bad-c677d2714fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:33.317598 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f02c013-0628-4a76-9bad-c677d2714fdc None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:33.324422 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1152/2337] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:05:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:05:33.326025 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15119b2e-ad68-4a6c-8f02-b0006e811d43 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:33.326227 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15119b2e-ad68-4a6c-8f02-b0006e811d43 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:33.326506 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15119b2e-ad68-4a6c-8f02-b0006e811d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:33.332047 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a16616a-cf7f-419d-9ff9-735bc8bfbd83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:33.332784 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a16616a-cf7f-419d-9ff9-735bc8bfbd83 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:33.333136 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a16616a-cf7f-419d-9ff9-735bc8bfbd83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:33.333480 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a16616a-cf7f-419d-9ff9-735bc8bfbd83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:33.334254 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a16616a-cf7f-419d-9ff9-735bc8bfbd83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:33.335954 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a16616a-cf7f-419d-9ff9-735bc8bfbd83 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:33.359956 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1186/2338] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:05:33 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:05:33.362114 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493baeb-4328-4b27-9f7a-37c980cc6304 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:33.362487 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493baeb-4328-4b27-9f7a-37c980cc6304 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:33.362837 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493baeb-4328-4b27-9f7a-37c980cc6304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:33.390890 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-15119b2e-ad68-4a6c-8f02-b0006e811d43 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:05:33.392132 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-15119b2e-ad68-4a6c-8f02-b0006e811d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:33.401363 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-5493baeb-4328-4b27-9f7a-37c980cc6304 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:05:33.404514 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-5493baeb-4328-4b27-9f7a-37c980cc6304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:33.418789 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1153/2339] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:05:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:05:33.418789 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15119b2e-ad68-4a6c-8f02-b0006e811d43 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:33.426859 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1187/2340] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:05:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:05:33.428099 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5493baeb-4328-4b27-9f7a-37c980cc6304 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:33.438116 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15119b2e-ad68-4a6c-8f02-b0006e811d43 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:33.445873 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94931fb3-52bc-4ee7-890e-6c426a36447d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:33.446124 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94931fb3-52bc-4ee7-890e-6c426a36447d admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:33.446512 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94931fb3-52bc-4ee7-890e-6c426a36447d admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:33.446885 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94931fb3-52bc-4ee7-890e-6c426a36447d admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:33.447668 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94931fb3-52bc-4ee7-890e-6c426a36447d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:33.457158 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5493baeb-4328-4b27-9f7a-37c980cc6304 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:33.472137 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61df32e9-4834-4277-85ff-f45e83000133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:33.472902 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df32e9-4834-4277-85ff-f45e83000133 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:33.473190 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df32e9-4834-4277-85ff-f45e83000133 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:33.473544 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df32e9-4834-4277-85ff-f45e83000133 admin admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:33.474375 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61df32e9-4834-4277-85ff-f45e83000133 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:05:33.474737 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61df32e9-4834-4277-85ff-f45e83000133 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:33.479763 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61df32e9-4834-4277-85ff-f45e83000133 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:33.480634 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94931fb3-52bc-4ee7-890e-6c426a36447d admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:33.513564 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1188/2341] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Aug 18 11:05:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:05:33.514789 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1154/2342] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:05:33 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:05:33.517617 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61df32e9-4834-4277-85ff-f45e83000133 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:33.519549 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94931fb3-52bc-4ee7-890e-6c426a36447d admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:33.541761 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61df32e9-4834-4277-85ff-f45e83000133 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:33.547074 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94931fb3-52bc-4ee7-890e-6c426a36447d admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:33.555354 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975518fa-09be-4243-ac45-de64aa00621d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:33.555987 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975518fa-09be-4243-ac45-de64aa00621d admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:33.556291 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975518fa-09be-4243-ac45-de64aa00621d admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:33.556596 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975518fa-09be-4243-ac45-de64aa00621d admin admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:33.557289 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975518fa-09be-4243-ac45-de64aa00621d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:05:33.561689 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971b7ee0-456a-4c67-bd93-a1a6db2c89a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:33.562508 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b7ee0-456a-4c67-bd93-a1a6db2c89a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:33.562893 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b7ee0-456a-4c67-bd93-a1a6db2c89a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:33.563303 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975518fa-09be-4243-ac45-de64aa00621d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:33.563805 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b7ee0-456a-4c67-bd93-a1a6db2c89a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:33.565673 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975518fa-09be-4243-ac45-de64aa00621d admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:33.566084 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971b7ee0-456a-4c67-bd93-a1a6db2c89a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:33.571882 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971b7ee0-456a-4c67-bd93-a1a6db2c89a3 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:33.604378 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1189/2343] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Aug 18 11:05:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:05:33.605317 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975518fa-09be-4243-ac45-de64aa00621d admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:33.628977 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975518fa-09be-4243-ac45-de64aa00621d admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:33.646383 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f106ee1f-492c-4bb6-bba4-7b4a6dcbeecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:33.647070 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f106ee1f-492c-4bb6-bba4-7b4a6dcbeecd admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:33.647353 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f106ee1f-492c-4bb6-bba4-7b4a6dcbeecd admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:33.647655 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f106ee1f-492c-4bb6-bba4-7b4a6dcbeecd admin admin] PATH_INFO: `/v3/projects/c9f744c4d13146e58014ca04e4d12ad5/users/d27babe9c2cb4ec693f121717e970f2e/roles/719e5c62188d4f8a838987d6e72ca8f7` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:33.663252 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1155/2344] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:05:33 2022] POST /identity/v3/projects => generated 373 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:05:33.670653 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971b7ee0-456a-4c67-bd93-a1a6db2c89a3 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:33.682634 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f106ee1f-492c-4bb6-bba4-7b4a6dcbeecd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9f744c4d13146e58014ca04e4d12ad5, user_id=d27babe9c2cb4ec693f121717e970f2e, role_id=719e5c62188d4f8a838987d6e72ca8f7)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:33.685425 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f106ee1f-492c-4bb6-bba4-7b4a6dcbeecd admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:33.709850 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1190/2345] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:05:33 2022] PUT /identity/v3/projects/c9f744c4d13146e58014ca04e4d12ad5/users/d27babe9c2cb4ec693f121717e970f2e/roles/719e5c62188d4f8a838987d6e72ca8f7 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:05:33.711052 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f106ee1f-492c-4bb6-bba4-7b4a6dcbeecd admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:33.723950 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:05:33.787047 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:05:33.829168 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971b7ee0-456a-4c67-bd93-a1a6db2c89a3 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:33.836044 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7780a6a0-455f-4b3f-bc34-6cd3c4929ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:33.836280 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f106ee1f-492c-4bb6-bba4-7b4a6dcbeecd admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:33.837102 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7780a6a0-455f-4b3f-bc34-6cd3c4929ee1 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:33.837556 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7780a6a0-455f-4b3f-bc34-6cd3c4929ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:33.838158 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7780a6a0-455f-4b3f-bc34-6cd3c4929ee1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:33.839164 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7780a6a0-455f-4b3f-bc34-6cd3c4929ee1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:33.841757 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7780a6a0-455f-4b3f-bc34-6cd3c4929ee1 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:33.849980 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f7e7b9-bac5-4f0e-a78d-8bcf480e428e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:33.850951 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7e7b9-bac5-4f0e-a78d-8bcf480e428e admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:33.851270 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7e7b9-bac5-4f0e-a78d-8bcf480e428e admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:33.851567 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7e7b9-bac5-4f0e-a78d-8bcf480e428e admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:33.852346 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f7e7b9-bac5-4f0e-a78d-8bcf480e428e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:33.858978 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f7e7b9-bac5-4f0e-a78d-8bcf480e428e admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:33.889900 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1156/2346] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:05:33 2022] POST /identity/v3/projects => generated 373 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:05:33.893226 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f90990-8c3c-411c-b938-7902747ab597 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:33.894049 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f90990-8c3c-411c-b938-7902747ab597 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:33.894788 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f90990-8c3c-411c-b938-7902747ab597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:33.920787 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1191/2347] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:05:33 2022] POST /identity/v3/users => generated 287 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:05:33.921854 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f7e7b9-bac5-4f0e-a78d-8bcf480e428e admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:33.932440 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f7e7b9-bac5-4f0e-a78d-8bcf480e428e admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:33.940567 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-f0f90990-8c3c-411c-b938-7902747ab597 None None] MFA Rules not processed for user `d27babe9c2cb4ec693f121717e970f2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:05:33.944323 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-f0f90990-8c3c-411c-b938-7902747ab597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:34.028737 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d630273d-80d0-4c58-9bb9-157920842d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:34.029380 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d630273d-80d0-4c58-9bb9-157920842d96 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:34.029689 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d630273d-80d0-4c58-9bb9-157920842d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:34.029969 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d630273d-80d0-4c58-9bb9-157920842d96 admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:34.030614 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d630273d-80d0-4c58-9bb9-157920842d96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:34.032548 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d630273d-80d0-4c58-9bb9-157920842d96 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:34.046698 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1157/2348] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:05:33 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:05:34.047631 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f90990-8c3c-411c-b938-7902747ab597 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:34.067777 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f90990-8c3c-411c-b938-7902747ab597 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:34.073139 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1192/2349] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:05:33 2022] POST /identity/v3/users => generated 287 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:05:34.074512 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d630273d-80d0-4c58-9bb9-157920842d96 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:34.076620 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-d630273d-80d0-4c58-9bb9-157920842d96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:34.076754 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65788591-1d36-4c58-a040-36b13ca71db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:34.077597 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65788591-1d36-4c58-a040-36b13ca71db6 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:34.077951 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65788591-1d36-4c58-a040-36b13ca71db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:34.078337 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65788591-1d36-4c58-a040-36b13ca71db6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:34.079435 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65788591-1d36-4c58-a040-36b13ca71db6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:34.081580 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65788591-1d36-4c58-a040-36b13ca71db6 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:34.095792 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1158/2350] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:05:34 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:05:34.095792 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65788591-1d36-4c58-a040-36b13ca71db6 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:34.126435 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65788591-1d36-4c58-a040-36b13ca71db6 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:34.138775 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ad41e5-63a8-4631-b6ca-69273511ae97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:34.139708 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ad41e5-63a8-4631-b6ca-69273511ae97 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:34.140212 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ad41e5-63a8-4631-b6ca-69273511ae97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:34.140552 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ad41e5-63a8-4631-b6ca-69273511ae97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:34.143361 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ad41e5-63a8-4631-b6ca-69273511ae97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:34.146675 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ad41e5-63a8-4631-b6ca-69273511ae97 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:34.152840 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d630273d-80d0-4c58-9bb9-157920842d96 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:34.163400 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6443c1-f608-4256-8fa7-f04d90a51f55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b8a09704b9b4ab2bffb813796ec6e77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:34.164091 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6443c1-f608-4256-8fa7-f04d90a51f55 service cinder] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:34.164531 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6443c1-f608-4256-8fa7-f04d90a51f55 service cinder] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:34.164818 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6443c1-f608-4256-8fa7-f04d90a51f55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:34.169948 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1159/2351] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:05:34 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:05:34.170998 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ad41e5-63a8-4631-b6ca-69273511ae97 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:34.180864 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6443c1-f608-4256-8fa7-f04d90a51f55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:34.182552 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6443c1-f608-4256-8fa7-f04d90a51f55 service cinder] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:34.190121 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ad41e5-63a8-4631-b6ca-69273511ae97 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:34.194656 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1193/2352] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:05:34 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:05:34.199773 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e1d5d3-e234-4a3a-a7f6-511cea33200a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:34.200414 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e1d5d3-e234-4a3a-a7f6-511cea33200a admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:34.200774 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e1d5d3-e234-4a3a-a7f6-511cea33200a admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:34.200955 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e1d5d3-e234-4a3a-a7f6-511cea33200a admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:34.202160 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e1d5d3-e234-4a3a-a7f6-511cea33200a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:34.204288 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e1d5d3-e234-4a3a-a7f6-511cea33200a admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:34.209892 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6443c1-f608-4256-8fa7-f04d90a51f55 service cinder] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:34.223241 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1160/2353] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:05:34 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:05:34.224446 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e1d5d3-e234-4a3a-a7f6-511cea33200a admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:34.239244 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e1d5d3-e234-4a3a-a7f6-511cea33200a admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:34.240932 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6443c1-f608-4256-8fa7-f04d90a51f55 service cinder] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:34.245396 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b7f2b0-ea8d-4191-aeb2-3fa680d92ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:34.246468 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7f2b0-ea8d-4191-aeb2-3fa680d92ebe admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:34.246678 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7f2b0-ea8d-4191-aeb2-3fa680d92ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:34.246953 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7f2b0-ea8d-4191-aeb2-3fa680d92ebe admin admin] PATH_INFO: `/v3/projects/e7d4323d2f3845f9859abf0b6377e870/users/9306810a8e134cafb13d2aa17d0a5680/roles/719e5c62188d4f8a838987d6e72ca8f7` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:34.248867 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8529ca1f-99b2-4639-80af-c25837f812ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:34.249880 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8529ca1f-99b2-4639-80af-c25837f812ba admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:34.250321 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8529ca1f-99b2-4639-80af-c25837f812ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:34.250828 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8529ca1f-99b2-4639-80af-c25837f812ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:34.251704 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8529ca1f-99b2-4639-80af-c25837f812ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:34.254406 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8529ca1f-99b2-4639-80af-c25837f812ba admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:34.271478 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1194/2354] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:05:34 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:05:34.279622 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8529ca1f-99b2-4639-80af-c25837f812ba admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:34.309506 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8529ca1f-99b2-4639-80af-c25837f812ba admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:34.316894 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db190b00-b06b-4aa2-a381-6bbc2b93d9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:34.318215 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db190b00-b06b-4aa2-a381-6bbc2b93d9d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:34.318694 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db190b00-b06b-4aa2-a381-6bbc2b93d9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:34.319363 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db190b00-b06b-4aa2-a381-6bbc2b93d9d4 admin admin] PATH_INFO: `/v3/projects/3d71314dc1ce439f9ddc91e1534c17f9/users/83d9700f02e14e4e9701a6ad23a20ad3/roles/719e5c62188d4f8a838987d6e72ca8f7` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:34.324387 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b7f2b0-ea8d-4191-aeb2-3fa680d92ebe admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7d4323d2f3845f9859abf0b6377e870, user_id=9306810a8e134cafb13d2aa17d0a5680, role_id=719e5c62188d4f8a838987d6e72ca8f7)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:34.328188 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b7f2b0-ea8d-4191-aeb2-3fa680d92ebe admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:34.336186 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:05:34.346458 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db190b00-b06b-4aa2-a381-6bbc2b93d9d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d71314dc1ce439f9ddc91e1534c17f9, user_id=83d9700f02e14e4e9701a6ad23a20ad3, role_id=719e5c62188d4f8a838987d6e72ca8f7)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:34.350281 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db190b00-b06b-4aa2-a381-6bbc2b93d9d4 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:34.376244 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1161/2355] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:05:34 2022] PUT /identity/v3/projects/e7d4323d2f3845f9859abf0b6377e870/users/9306810a8e134cafb13d2aa17d0a5680/roles/719e5c62188d4f8a838987d6e72ca8f7 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:05:34.388253 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19880eaa-8e3c-4840-ae2c-df195a45a7f2 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:34.388602 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19880eaa-8e3c-4840-ae2c-df195a45a7f2 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:34.388826 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19880eaa-8e3c-4840-ae2c-df195a45a7f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:34.399994 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1195/2356] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:05:34 2022] PUT /identity/v3/projects/3d71314dc1ce439f9ddc91e1534c17f9/users/83d9700f02e14e4e9701a6ad23a20ad3/roles/719e5c62188d4f8a838987d6e72ca8f7 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:05:34.402079 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66cb4e5-2fdc-4e35-8360-991b8e6fdbf8 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:34.402625 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66cb4e5-2fdc-4e35-8360-991b8e6fdbf8 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:34.402968 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66cb4e5-2fdc-4e35-8360-991b8e6fdbf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:34.464678 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-19880eaa-8e3c-4840-ae2c-df195a45a7f2 None None] MFA Rules not processed for user `9306810a8e134cafb13d2aa17d0a5680`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:05:34.466381 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-19880eaa-8e3c-4840-ae2c-df195a45a7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:34.490779 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-b66cb4e5-2fdc-4e35-8360-991b8e6fdbf8 None None] MFA Rules not processed for user `83d9700f02e14e4e9701a6ad23a20ad3`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:05:34.492021 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-b66cb4e5-2fdc-4e35-8360-991b8e6fdbf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:34.616036 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:05:34.650124 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1196/2357] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:05:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:05:34.660343 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66cb4e5-2fdc-4e35-8360-991b8e6fdbf8 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:34.670578 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1162/2358] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:05:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:05:34.733076 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66cb4e5-2fdc-4e35-8360-991b8e6fdbf8 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:34.738627 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5830a2-d95a-46d8-a0d2-4e73dc0d9906 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b8a09704b9b4ab2bffb813796ec6e77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:34.739516 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5830a2-d95a-46d8-a0d2-4e73dc0d9906 service cinder] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:34.739801 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5830a2-d95a-46d8-a0d2-4e73dc0d9906 service cinder] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:34.740140 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5830a2-d95a-46d8-a0d2-4e73dc0d9906 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:34.755567 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5830a2-d95a-46d8-a0d2-4e73dc0d9906 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:34.757169 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5830a2-d95a-46d8-a0d2-4e73dc0d9906 service cinder] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:34.774570 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1197/2359] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:05:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 11:05:34.936927 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19880eaa-8e3c-4840-ae2c-df195a45a7f2 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:34.955254 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-19880eaa-8e3c-4840-ae2c-df195a45a7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:35.011085 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19880eaa-8e3c-4840-ae2c-df195a45a7f2 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:35.035501 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83330f33-c008-4026-85ef-aec00a00c136 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b8a09704b9b4ab2bffb813796ec6e77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:35.035501 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83330f33-c008-4026-85ef-aec00a00c136 service cinder] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:35.035501 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83330f33-c008-4026-85ef-aec00a00c136 service cinder] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:35.035501 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83330f33-c008-4026-85ef-aec00a00c136 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:35.078411 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83330f33-c008-4026-85ef-aec00a00c136 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:35.098216 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83330f33-c008-4026-85ef-aec00a00c136 service cinder] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:35.151997 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1163/2360] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:05:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:05:35.203157 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5830a2-d95a-46d8-a0d2-4e73dc0d9906 service cinder] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:35.351265 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5830a2-d95a-46d8-a0d2-4e73dc0d9906 service cinder] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:35.358600 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31b2172-f10a-4f55-ad78-f72048595bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:35.362398 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31b2172-f10a-4f55-ad78-f72048595bae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:35.362804 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31b2172-f10a-4f55-ad78-f72048595bae admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:35.363185 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31b2172-f10a-4f55-ad78-f72048595bae admin admin] PATH_INFO: `/v3/users/9306810a8e134cafb13d2aa17d0a5680` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:35.367740 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31b2172-f10a-4f55-ad78-f72048595bae admin admin] RBAC: Authorizing `identity:delete_user(user_id=9306810a8e134cafb13d2aa17d0a5680)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:35.369947 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31b2172-f10a-4f55-ad78-f72048595bae admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:35.422447 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:05:35.494506 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-a31b2172-f10a-4f55-ad78-f72048595bae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9306810a8e134cafb13d2aa17d0a5680'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:35.495253 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-a31b2172-f10a-4f55-ad78-f72048595bae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9306810a8e134cafb13d2aa17d0a5680'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:35.512571 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-a31b2172-f10a-4f55-ad78-f72048595bae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9306810a8e134cafb13d2aa17d0a5680'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:35.547202 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-a31b2172-f10a-4f55-ad78-f72048595bae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9306810a8e134cafb13d2aa17d0a5680'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:35.562366 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-a31b2172-f10a-4f55-ad78-f72048595bae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9306810a8e134cafb13d2aa17d0a5680'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:35.593953 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1198/2361] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:05:35 2022] DELETE /identity/v3/users/9306810a8e134cafb13d2aa17d0a5680 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:05:35.594153 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936c01a-f539-4c6c-a2cf-90344e5e2330 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:35.594153 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936c01a-f539-4c6c-a2cf-90344e5e2330 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:35.594153 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936c01a-f539-4c6c-a2cf-90344e5e2330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:35.640876 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-7936c01a-f539-4c6c-a2cf-90344e5e2330 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:05:35.644964 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-7936c01a-f539-4c6c-a2cf-90344e5e2330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:35.839978 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1164/2362] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:05:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:05:35.856759 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31b2172-f10a-4f55-ad78-f72048595bae admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:35.858544 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-a31b2172-f10a-4f55-ad78-f72048595bae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:35.950351 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31b2172-f10a-4f55-ad78-f72048595bae admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:35.955048 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1caf8d-52ed-4cba-b18d-b8890724701c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:35.955885 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1caf8d-52ed-4cba-b18d-b8890724701c service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:35.956350 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1caf8d-52ed-4cba-b18d-b8890724701c service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:35.956828 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1caf8d-52ed-4cba-b18d-b8890724701c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:35.971238 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1caf8d-52ed-4cba-b18d-b8890724701c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:35.973118 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1caf8d-52ed-4cba-b18d-b8890724701c service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:35.992305 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1199/2363] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:05:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:05:36.526149 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7936c01a-f539-4c6c-a2cf-90344e5e2330 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:36.528207 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-7936c01a-f539-4c6c-a2cf-90344e5e2330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:36.557477 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7936c01a-f539-4c6c-a2cf-90344e5e2330 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:36.573131 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d925ae85-0727-4270-88b7-f3bde9cab671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:36.573835 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d925ae85-0727-4270-88b7-f3bde9cab671 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:36.574124 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d925ae85-0727-4270-88b7-f3bde9cab671 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:36.574399 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d925ae85-0727-4270-88b7-f3bde9cab671 admin admin] PATH_INFO: `/v3/projects/e7d4323d2f3845f9859abf0b6377e870` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:36.583567 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d925ae85-0727-4270-88b7-f3bde9cab671 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7d4323d2f3845f9859abf0b6377e870)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:36.588580 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d925ae85-0727-4270-88b7-f3bde9cab671 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:36.764087 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-d925ae85-0727-4270-88b7-f3bde9cab671 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7d4323d2f3845f9859abf0b6377e870', 'request_id': 'req-d925ae85-0727-4270-88b7-f3bde9cab671'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:36.776611 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-d925ae85-0727-4270-88b7-f3bde9cab671 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7d4323d2f3845f9859abf0b6377e870', 'request_id': 'req-d925ae85-0727-4270-88b7-f3bde9cab671'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:36.786560 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-d925ae85-0727-4270-88b7-f3bde9cab671 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7d4323d2f3845f9859abf0b6377e870', 'request_id': 'req-d925ae85-0727-4270-88b7-f3bde9cab671'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:36.803797 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-d925ae85-0727-4270-88b7-f3bde9cab671 admin admin] The token cache is being invalidate because project e7d4323d2f3845f9859abf0b6377e870 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:05:36.804407 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-d925ae85-0727-4270-88b7-f3bde9cab671 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:36.805287 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-d925ae85-0727-4270-88b7-f3bde9cab671 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:36.808200 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1165/2364] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:05:36 2022] DELETE /identity/v3/projects/e7d4323d2f3845f9859abf0b6377e870 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:05:41.497187 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1caf8d-52ed-4cba-b18d-b8890724701c service neutron] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:41.498840 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-bf1caf8d-52ed-4cba-b18d-b8890724701c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:41.517057 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1caf8d-52ed-4cba-b18d-b8890724701c service neutron] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:41.619088 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa62d021-719a-47c8-bb5d-a4dbbd06cded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:41.620195 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa62d021-719a-47c8-bb5d-a4dbbd06cded admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:41.620844 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa62d021-719a-47c8-bb5d-a4dbbd06cded admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:41.621461 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa62d021-719a-47c8-bb5d-a4dbbd06cded admin admin] PATH_INFO: `/v3/users/83d9700f02e14e4e9701a6ad23a20ad3` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:41.623919 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa62d021-719a-47c8-bb5d-a4dbbd06cded admin admin] RBAC: Authorizing `identity:delete_user(user_id=83d9700f02e14e4e9701a6ad23a20ad3)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:41.628886 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa62d021-719a-47c8-bb5d-a4dbbd06cded admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:41.705084 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:05:41.708863 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-aa62d021-719a-47c8-bb5d-a4dbbd06cded admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83d9700f02e14e4e9701a6ad23a20ad3'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:41.710117 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-aa62d021-719a-47c8-bb5d-a4dbbd06cded admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83d9700f02e14e4e9701a6ad23a20ad3'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:41.723341 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-aa62d021-719a-47c8-bb5d-a4dbbd06cded admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83d9700f02e14e4e9701a6ad23a20ad3'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:41.742586 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-aa62d021-719a-47c8-bb5d-a4dbbd06cded admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83d9700f02e14e4e9701a6ad23a20ad3'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:41.754202 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-aa62d021-719a-47c8-bb5d-a4dbbd06cded admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83d9700f02e14e4e9701a6ad23a20ad3'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:41.762011 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1200/2365] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:05:41 2022] DELETE /identity/v3/users/83d9700f02e14e4e9701a6ad23a20ad3 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:05:41.766014 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2669d3-0914-4c71-afec-4bfd1031a308 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:41.766682 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2669d3-0914-4c71-afec-4bfd1031a308 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:41.766682 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2669d3-0914-4c71-afec-4bfd1031a308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:41.789239 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-ea2669d3-0914-4c71-afec-4bfd1031a308 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:05:41.790614 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-ea2669d3-0914-4c71-afec-4bfd1031a308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:41.853498 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:05:41.881941 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa62d021-719a-47c8-bb5d-a4dbbd06cded admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:41.884012 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-aa62d021-719a-47c8-bb5d-a4dbbd06cded admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:41.892478 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1166/2366] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:05:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:05:41.981024 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa62d021-719a-47c8-bb5d-a4dbbd06cded admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:41.987611 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9245e24-0410-488f-aef5-391b028388e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:41.988218 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9245e24-0410-488f-aef5-391b028388e4 service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:41.988502 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9245e24-0410-488f-aef5-391b028388e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:41.988784 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9245e24-0410-488f-aef5-391b028388e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:42.004591 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9245e24-0410-488f-aef5-391b028388e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:42.006232 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9245e24-0410-488f-aef5-391b028388e4 service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:42.020768 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1201/2367] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:05:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 11:05:43.044667 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2669d3-0914-4c71-afec-4bfd1031a308 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:43.046337 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-ea2669d3-0914-4c71-afec-4bfd1031a308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:43.076084 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2669d3-0914-4c71-afec-4bfd1031a308 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:43.092236 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9236f85b-ea62-433c-8e61-51d7f7d43356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:43.092924 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9236f85b-ea62-433c-8e61-51d7f7d43356 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:43.093214 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9236f85b-ea62-433c-8e61-51d7f7d43356 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:43.093499 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9236f85b-ea62-433c-8e61-51d7f7d43356 admin admin] PATH_INFO: `/v3/projects/3d71314dc1ce439f9ddc91e1534c17f9` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:43.095308 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9236f85b-ea62-433c-8e61-51d7f7d43356 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d71314dc1ce439f9ddc91e1534c17f9)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:43.099574 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9236f85b-ea62-433c-8e61-51d7f7d43356 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:43.182375 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-9236f85b-ea62-433c-8e61-51d7f7d43356 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d71314dc1ce439f9ddc91e1534c17f9', 'request_id': 'req-9236f85b-ea62-433c-8e61-51d7f7d43356'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:43.193241 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-9236f85b-ea62-433c-8e61-51d7f7d43356 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d71314dc1ce439f9ddc91e1534c17f9', 'request_id': 'req-9236f85b-ea62-433c-8e61-51d7f7d43356'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:43.201274 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-9236f85b-ea62-433c-8e61-51d7f7d43356 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d71314dc1ce439f9ddc91e1534c17f9', 'request_id': 'req-9236f85b-ea62-433c-8e61-51d7f7d43356'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:43.219634 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-9236f85b-ea62-433c-8e61-51d7f7d43356 admin admin] The token cache is being invalidate because project 3d71314dc1ce439f9ddc91e1534c17f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:05:43.219885 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-9236f85b-ea62-433c-8e61-51d7f7d43356 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:43.220589 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-9236f85b-ea62-433c-8e61-51d7f7d43356 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:43.222405 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1167/2368] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:05:43 2022] DELETE /identity/v3/projects/3d71314dc1ce439f9ddc91e1534c17f9 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:05:43.227371 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf09c2a-bf0c-48f9-98a0-cf38f19de6f9 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:43.227950 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf09c2a-bf0c-48f9-98a0-cf38f19de6f9 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:43.227950 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf09c2a-bf0c-48f9-98a0-cf38f19de6f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:43.250010 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-baf09c2a-bf0c-48f9-98a0-cf38f19de6f9 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:05:43.252297 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-baf09c2a-bf0c-48f9-98a0-cf38f19de6f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:43.348594 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb9a91a-5921-4dd5-b17e-90e8f9787e70 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:43.348894 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb9a91a-5921-4dd5-b17e-90e8f9787e70 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:43.349162 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb9a91a-5921-4dd5-b17e-90e8f9787e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:43.353053 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1202/2369] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:05:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:05:43.372971 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-dcb9a91a-5921-4dd5-b17e-90e8f9787e70 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:05:43.374321 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-dcb9a91a-5921-4dd5-b17e-90e8f9787e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:43.389567 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1168/2370] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:05:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:05:43.392069 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf09c2a-bf0c-48f9-98a0-cf38f19de6f9 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:43.404132 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf09c2a-bf0c-48f9-98a0-cf38f19de6f9 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:43.409711 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea4cb30-83d1-4939-b8ff-f56cc607f3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:43.410464 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea4cb30-83d1-4939-b8ff-f56cc607f3cf admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:43.410848 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea4cb30-83d1-4939-b8ff-f56cc607f3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:43.411422 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea4cb30-83d1-4939-b8ff-f56cc607f3cf admin admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:43.412144 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea4cb30-83d1-4939-b8ff-f56cc607f3cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:05:43.412550 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea4cb30-83d1-4939-b8ff-f56cc607f3cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:43.414315 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea4cb30-83d1-4939-b8ff-f56cc607f3cf admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:43.443241 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1203/2371] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Aug 18 11:05:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:05:43.448274 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb9a91a-5921-4dd5-b17e-90e8f9787e70 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:43.466932 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb9a91a-5921-4dd5-b17e-90e8f9787e70 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:43.474935 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fe9a74-61fc-4c9b-819a-be9407fe519d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:43.475437 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fe9a74-61fc-4c9b-819a-be9407fe519d admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:43.475842 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fe9a74-61fc-4c9b-819a-be9407fe519d admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:43.476213 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fe9a74-61fc-4c9b-819a-be9407fe519d admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:43.477246 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fe9a74-61fc-4c9b-819a-be9407fe519d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:43.480066 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fe9a74-61fc-4c9b-819a-be9407fe519d admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:43.522073 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1169/2372] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:05:43 2022] POST /identity/v3/projects => generated 385 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:05:43.525819 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea4cb30-83d1-4939-b8ff-f56cc607f3cf admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:43.538752 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea4cb30-83d1-4939-b8ff-f56cc607f3cf admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:43.604190 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fe9a74-61fc-4c9b-819a-be9407fe519d admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:43.609174 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-d7fe9a74-61fc-4c9b-819a-be9407fe519d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:43.637894 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:05:43.665744 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c86ea7-10df-408c-8985-9a1e3c340864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:43.666697 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c86ea7-10df-408c-8985-9a1e3c340864 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:43.666982 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c86ea7-10df-408c-8985-9a1e3c340864 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:43.667257 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c86ea7-10df-408c-8985-9a1e3c340864 admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:43.667937 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c86ea7-10df-408c-8985-9a1e3c340864 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:43.671461 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c86ea7-10df-408c-8985-9a1e3c340864 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:43.713572 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1204/2373] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:05:43 2022] POST /identity/v3/users => generated 293 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:05:43.714878 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c86ea7-10df-408c-8985-9a1e3c340864 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:43.727585 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c86ea7-10df-408c-8985-9a1e3c340864 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:43.733035 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a899e681-5cbc-4d56-98ae-6beb59b9032f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:43.734367 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a899e681-5cbc-4d56-98ae-6beb59b9032f admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:43.734805 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a899e681-5cbc-4d56-98ae-6beb59b9032f admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:43.735260 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a899e681-5cbc-4d56-98ae-6beb59b9032f admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:43.736707 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a899e681-5cbc-4d56-98ae-6beb59b9032f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:43.738804 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a899e681-5cbc-4d56-98ae-6beb59b9032f admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:43.755710 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1205/2374] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:05:43 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:05:43.757027 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a899e681-5cbc-4d56-98ae-6beb59b9032f admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:43.758070 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fe9a74-61fc-4c9b-819a-be9407fe519d admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:43.766484 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38099b2-66ab-43ce-8d64-2f486ccbd89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:43.768560 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38099b2-66ab-43ce-8d64-2f486ccbd89d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:43.769008 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38099b2-66ab-43ce-8d64-2f486ccbd89d admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:43.769355 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38099b2-66ab-43ce-8d64-2f486ccbd89d admin admin] PATH_INFO: `/v3/users/d27babe9c2cb4ec693f121717e970f2e` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:43.771225 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38099b2-66ab-43ce-8d64-2f486ccbd89d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d27babe9c2cb4ec693f121717e970f2e)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:43.772397 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a899e681-5cbc-4d56-98ae-6beb59b9032f admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:43.776037 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38099b2-66ab-43ce-8d64-2f486ccbd89d admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:43.778235 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd92aa6-95a0-4454-87b0-3be215c35cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:43.779186 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd92aa6-95a0-4454-87b0-3be215c35cdd admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:43.779653 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd92aa6-95a0-4454-87b0-3be215c35cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:43.780224 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd92aa6-95a0-4454-87b0-3be215c35cdd admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:43.781084 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd92aa6-95a0-4454-87b0-3be215c35cdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:43.782918 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd92aa6-95a0-4454-87b0-3be215c35cdd admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:43.801600 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1206/2375] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:05:43 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:05:43.802872 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd92aa6-95a0-4454-87b0-3be215c35cdd admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:43.815452 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd92aa6-95a0-4454-87b0-3be215c35cdd admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:43.826054 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c147b836-f246-4ef1-be89-5ceaa6971daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:43.827386 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c147b836-f246-4ef1-be89-5ceaa6971daa admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:43.827908 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c147b836-f246-4ef1-be89-5ceaa6971daa admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:43.828216 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c147b836-f246-4ef1-be89-5ceaa6971daa admin admin] PATH_INFO: `/v3/projects/78fa79cde33441a3be07bd01c806bc6f/users/d57a09d84bbf4649badbe155f9b67298/roles/719e5c62188d4f8a838987d6e72ca8f7` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:43.855267 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-e38099b2-66ab-43ce-8d64-2f486ccbd89d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd27babe9c2cb4ec693f121717e970f2e'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:43.855483 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c147b836-f246-4ef1-be89-5ceaa6971daa admin admin] RBAC: Authorizing `identity:create_grant(project_id=78fa79cde33441a3be07bd01c806bc6f, user_id=d57a09d84bbf4649badbe155f9b67298, role_id=719e5c62188d4f8a838987d6e72ca8f7)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:43.858607 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c147b836-f246-4ef1-be89-5ceaa6971daa admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:43.865090 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=82,keystone:DELETE=15,keystone:INSERT=3 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:05:43.871474 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-e38099b2-66ab-43ce-8d64-2f486ccbd89d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd27babe9c2cb4ec693f121717e970f2e'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:43.873036 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-e38099b2-66ab-43ce-8d64-2f486ccbd89d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd27babe9c2cb4ec693f121717e970f2e'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:43.873861 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-e38099b2-66ab-43ce-8d64-2f486ccbd89d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd27babe9c2cb4ec693f121717e970f2e'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:43.888180 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1207/2376] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:05:43 2022] PUT /identity/v3/projects/78fa79cde33441a3be07bd01c806bc6f/users/d57a09d84bbf4649badbe155f9b67298/roles/719e5c62188d4f8a838987d6e72ca8f7 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:05:43.888385 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-e38099b2-66ab-43ce-8d64-2f486ccbd89d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd27babe9c2cb4ec693f121717e970f2e'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:43.899060 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221d8b2e-dab0-4985-b103-80d42dc49605 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:43.899487 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221d8b2e-dab0-4985-b103-80d42dc49605 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:43.899871 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221d8b2e-dab0-4985-b103-80d42dc49605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:43.916426 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1170/2377] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:05:43 2022] DELETE /identity/v3/users/d27babe9c2cb4ec693f121717e970f2e => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:05:43.920941 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a571b3-01d6-4411-a7dc-d43347695a75 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:43.921405 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a571b3-01d6-4411-a7dc-d43347695a75 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:43.921758 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a571b3-01d6-4411-a7dc-d43347695a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:43.937686 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-221d8b2e-dab0-4985-b103-80d42dc49605 None None] MFA Rules not processed for user `d57a09d84bbf4649badbe155f9b67298`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:05:43.940219 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-221d8b2e-dab0-4985-b103-80d42dc49605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:43.956461 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-f8a571b3-01d6-4411-a7dc-d43347695a75 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:05:43.958174 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-f8a571b3-01d6-4411-a7dc-d43347695a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:44.052884 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1171/2378] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:05:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:05:44.072613 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a571b3-01d6-4411-a7dc-d43347695a75 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:44.073571 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1208/2379] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:05:43 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:05:44.078995 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221d8b2e-dab0-4985-b103-80d42dc49605 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:44.081838 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-221d8b2e-dab0-4985-b103-80d42dc49605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:44.082853 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-f8a571b3-01d6-4411-a7dc-d43347695a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:44.097233 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221d8b2e-dab0-4985-b103-80d42dc49605 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:44.102708 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef938dec-1fb0-4827-8fc6-47e28a3ff8db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:44.103649 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef938dec-1fb0-4827-8fc6-47e28a3ff8db admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:44.104193 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef938dec-1fb0-4827-8fc6-47e28a3ff8db admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:44.104777 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef938dec-1fb0-4827-8fc6-47e28a3ff8db admin admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:44.105778 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef938dec-1fb0-4827-8fc6-47e28a3ff8db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:44.108273 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef938dec-1fb0-4827-8fc6-47e28a3ff8db admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:44.148989 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1209/2380] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:05:44 2022] POST /identity/v3/projects => generated 385 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:05:44.150640 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef938dec-1fb0-4827-8fc6-47e28a3ff8db admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:44.214551 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a571b3-01d6-4411-a7dc-d43347695a75 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:44.268838 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef938dec-1fb0-4827-8fc6-47e28a3ff8db admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:44.275336 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30131f8-e3a9-44da-bd03-d271c867ffd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:44.276195 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30131f8-e3a9-44da-bd03-d271c867ffd0 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:44.276532 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30131f8-e3a9-44da-bd03-d271c867ffd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:44.277071 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30131f8-e3a9-44da-bd03-d271c867ffd0 admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:44.277981 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30131f8-e3a9-44da-bd03-d271c867ffd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:44.280402 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30131f8-e3a9-44da-bd03-d271c867ffd0 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:44.293613 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:05:44.313347 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1210/2381] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:05:44 2022] POST /identity/v3/users => generated 293 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:05:44.318198 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30131f8-e3a9-44da-bd03-d271c867ffd0 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:44.331808 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30131f8-e3a9-44da-bd03-d271c867ffd0 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:44.338711 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456153fb-d70c-4159-ab80-d55cc637aedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:44.339558 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456153fb-d70c-4159-ab80-d55cc637aedf admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:44.339946 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456153fb-d70c-4159-ab80-d55cc637aedf admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:44.340374 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456153fb-d70c-4159-ab80-d55cc637aedf admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:44.341410 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456153fb-d70c-4159-ab80-d55cc637aedf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:44.343441 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456153fb-d70c-4159-ab80-d55cc637aedf admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:44.362631 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1211/2382] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:05:44 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 11:05:44.367272 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456153fb-d70c-4159-ab80-d55cc637aedf admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:44.380857 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456153fb-d70c-4159-ab80-d55cc637aedf admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:44.387496 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d70ca8-7056-412d-806e-de5268537184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:44.389434 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d70ca8-7056-412d-806e-de5268537184 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:44.389434 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d70ca8-7056-412d-806e-de5268537184 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:44.389434 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d70ca8-7056-412d-806e-de5268537184 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:44.389941 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d70ca8-7056-412d-806e-de5268537184 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:44.391988 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d70ca8-7056-412d-806e-de5268537184 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:44.409222 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1212/2383] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:05:44 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:05:44.414350 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d70ca8-7056-412d-806e-de5268537184 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:44.429967 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d70ca8-7056-412d-806e-de5268537184 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:44.436570 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0940bc-cb6a-4cc4-80e8-b83739a6c24e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:44.437157 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0940bc-cb6a-4cc4-80e8-b83739a6c24e service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:44.437548 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0940bc-cb6a-4cc4-80e8-b83739a6c24e service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:44.437839 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0940bc-cb6a-4cc4-80e8-b83739a6c24e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:44.438426 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cda4b2b-37a6-4462-a077-9ffbdd8d84ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:44.440185 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda4b2b-37a6-4462-a077-9ffbdd8d84ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:44.441044 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda4b2b-37a6-4462-a077-9ffbdd8d84ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:44.441409 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda4b2b-37a6-4462-a077-9ffbdd8d84ff admin admin] PATH_INFO: `/v3/projects/3cf09eaa7570441c83fada4cbb81afa4/users/91cbaf69fe8f4c82b8cddc1dcc21f93d/roles/719e5c62188d4f8a838987d6e72ca8f7` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:44.461695 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cda4b2b-37a6-4462-a077-9ffbdd8d84ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cf09eaa7570441c83fada4cbb81afa4, user_id=91cbaf69fe8f4c82b8cddc1dcc21f93d, role_id=719e5c62188d4f8a838987d6e72ca8f7)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:44.467007 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cda4b2b-37a6-4462-a077-9ffbdd8d84ff admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:44.476021 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0940bc-cb6a-4cc4-80e8-b83739a6c24e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:44.477578 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0940bc-cb6a-4cc4-80e8-b83739a6c24e service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:44.487528 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1213/2384] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:05:44 2022] PUT /identity/v3/projects/3cf09eaa7570441c83fada4cbb81afa4/users/91cbaf69fe8f4c82b8cddc1dcc21f93d/roles/719e5c62188d4f8a838987d6e72ca8f7 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:05:44.497812 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad015a-8b83-48fa-9488-ab63523d6719 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:44.498188 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad015a-8b83-48fa-9488-ab63523d6719 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:44.498686 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad015a-8b83-48fa-9488-ab63523d6719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:44.503818 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1172/2385] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:05:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:05:44.539817 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-f1ad015a-8b83-48fa-9488-ab63523d6719 None None] MFA Rules not processed for user `91cbaf69fe8f4c82b8cddc1dcc21f93d`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:05:44.541633 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-f1ad015a-8b83-48fa-9488-ab63523d6719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:44.660304 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1214/2386] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:05:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:05:44.664676 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0940bc-cb6a-4cc4-80e8-b83739a6c24e service neutron] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:44.681464 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0940bc-cb6a-4cc4-80e8-b83739a6c24e service neutron] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:44.762470 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:05:44.824632 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5779ad8c-fe15-406d-b936-fd24fcf46b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:44.825265 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5779ad8c-fe15-406d-b936-fd24fcf46b09 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:44.825640 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5779ad8c-fe15-406d-b936-fd24fcf46b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:44.825931 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5779ad8c-fe15-406d-b936-fd24fcf46b09 admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:44.826923 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5779ad8c-fe15-406d-b936-fd24fcf46b09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:44.831362 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5779ad8c-fe15-406d-b936-fd24fcf46b09 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:44.877675 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ad015a-8b83-48fa-9488-ab63523d6719 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:44.878435 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1173/2387] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:05:44 2022] POST /identity/v3/projects => generated 385 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 11:05:44.890342 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ad015a-8b83-48fa-9488-ab63523d6719 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:45.041046 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5779ad8c-fe15-406d-b936-fd24fcf46b09 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:45.043488 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-5779ad8c-fe15-406d-b936-fd24fcf46b09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:45.146492 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70296896-0f2e-4b9c-9e22-e6969bda15c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:45.147627 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70296896-0f2e-4b9c-9e22-e6969bda15c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:45.148115 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70296896-0f2e-4b9c-9e22-e6969bda15c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:45.148579 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70296896-0f2e-4b9c-9e22-e6969bda15c8 admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:45.149403 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70296896-0f2e-4b9c-9e22-e6969bda15c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:45.151617 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70296896-0f2e-4b9c-9e22-e6969bda15c8 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:45.173257 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5779ad8c-fe15-406d-b936-fd24fcf46b09 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:45.184533 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495354ca-94b3-498a-92c8-3724fd4b0cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:45.186004 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495354ca-94b3-498a-92c8-3724fd4b0cc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:45.186685 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495354ca-94b3-498a-92c8-3724fd4b0cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:45.187364 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495354ca-94b3-498a-92c8-3724fd4b0cc5 admin admin] PATH_INFO: `/v3/projects/c9f744c4d13146e58014ca04e4d12ad5` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:45.190706 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495354ca-94b3-498a-92c8-3724fd4b0cc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9f744c4d13146e58014ca04e4d12ad5)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:45.194584 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495354ca-94b3-498a-92c8-3724fd4b0cc5 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:45.210441 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1215/2388] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:05:44 2022] POST /identity/v3/users => generated 299 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:05:45.215504 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70296896-0f2e-4b9c-9e22-e6969bda15c8 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:45.232569 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70296896-0f2e-4b9c-9e22-e6969bda15c8 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:45.239583 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb01785-31bc-4793-9830-c4e2227e6bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:45.240700 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb01785-31bc-4793-9830-c4e2227e6bd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:45.241176 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb01785-31bc-4793-9830-c4e2227e6bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:45.241810 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb01785-31bc-4793-9830-c4e2227e6bd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:45.242802 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb01785-31bc-4793-9830-c4e2227e6bd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:45.246104 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb01785-31bc-4793-9830-c4e2227e6bd0 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:45.262624 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1216/2389] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:05:45 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 11:05:45.271388 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb01785-31bc-4793-9830-c4e2227e6bd0 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:45.287474 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb01785-31bc-4793-9830-c4e2227e6bd0 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:45.294910 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-495354ca-94b3-498a-92c8-3724fd4b0cc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9f744c4d13146e58014ca04e4d12ad5', 'request_id': 'req-495354ca-94b3-498a-92c8-3724fd4b0cc5'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:45.307631 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-495354ca-94b3-498a-92c8-3724fd4b0cc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9f744c4d13146e58014ca04e4d12ad5', 'request_id': 'req-495354ca-94b3-498a-92c8-3724fd4b0cc5'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:45.308513 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:05:45.322453 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-495354ca-94b3-498a-92c8-3724fd4b0cc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9f744c4d13146e58014ca04e4d12ad5', 'request_id': 'req-495354ca-94b3-498a-92c8-3724fd4b0cc5'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:45.345999 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-495354ca-94b3-498a-92c8-3724fd4b0cc5 admin admin] The token cache is being invalidate because project c9f744c4d13146e58014ca04e4d12ad5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:05:45.347016 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-495354ca-94b3-498a-92c8-3724fd4b0cc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:45.348144 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-495354ca-94b3-498a-92c8-3724fd4b0cc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:45.352481 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1174/2390] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:05:45 2022] DELETE /identity/v3/projects/c9f744c4d13146e58014ca04e4d12ad5 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:05:45.373702 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f998c6da-a32d-402b-bcc7-d2b9e2c7518a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:45.374394 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f998c6da-a32d-402b-bcc7-d2b9e2c7518a admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:45.374673 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f998c6da-a32d-402b-bcc7-d2b9e2c7518a admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:45.374945 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f998c6da-a32d-402b-bcc7-d2b9e2c7518a admin admin] PATH_INFO: `/v3/projects/69343222dc4c4ad3ad6fbc2f2483dd3e/users/4452c578d42d49b3993b6f20d1930e81/roles/127fdc7ef05b4e0b98a940b334e5fcab` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:45.399652 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f998c6da-a32d-402b-bcc7-d2b9e2c7518a admin admin] RBAC: Authorizing `identity:create_grant(project_id=69343222dc4c4ad3ad6fbc2f2483dd3e, user_id=4452c578d42d49b3993b6f20d1930e81, role_id=127fdc7ef05b4e0b98a940b334e5fcab)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:45.402867 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f998c6da-a32d-402b-bcc7-d2b9e2c7518a admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:45.435610 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1217/2391] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:05:45 2022] PUT /identity/v3/projects/69343222dc4c4ad3ad6fbc2f2483dd3e/users/4452c578d42d49b3993b6f20d1930e81/roles/127fdc7ef05b4e0b98a940b334e5fcab => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:05:45.440526 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495354ca-94b3-498a-92c8-3724fd4b0cc5 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:45.442181 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-495354ca-94b3-498a-92c8-3724fd4b0cc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:45.456786 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495354ca-94b3-498a-92c8-3724fd4b0cc5 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:45.519891 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:05:45.558844 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5bc86f-0d8c-4512-8445-1040242cbce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:45.561083 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5bc86f-0d8c-4512-8445-1040242cbce0 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:45.561480 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5bc86f-0d8c-4512-8445-1040242cbce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:45.562351 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5bc86f-0d8c-4512-8445-1040242cbce0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:45.566360 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5bc86f-0d8c-4512-8445-1040242cbce0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:45.568627 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5bc86f-0d8c-4512-8445-1040242cbce0 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:45.590489 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1175/2392] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:05:45 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:05:45.596037 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f998c6da-a32d-402b-bcc7-d2b9e2c7518a admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:45.613300 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f998c6da-a32d-402b-bcc7-d2b9e2c7518a admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:45.620170 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ae5ef8-f242-4b9c-b655-423642348397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:45.621400 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ae5ef8-f242-4b9c-b655-423642348397 admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:45.622884 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ae5ef8-f242-4b9c-b655-423642348397 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:45.623600 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ae5ef8-f242-4b9c-b655-423642348397 admin admin] PATH_INFO: `/v3/projects/69343222dc4c4ad3ad6fbc2f2483dd3e/users/4452c578d42d49b3993b6f20d1930e81/roles/127fdc7ef05b4e0b98a940b334e5fcab` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:45.627471 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ae5ef8-f242-4b9c-b655-423642348397 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69343222dc4c4ad3ad6fbc2f2483dd3e, user_id=4452c578d42d49b3993b6f20d1930e81, role_id=127fdc7ef05b4e0b98a940b334e5fcab)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:45.631623 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ae5ef8-f242-4b9c-b655-423642348397 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:45.647951 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1218/2393] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:05:45 2022] PUT /identity/v3/projects/69343222dc4c4ad3ad6fbc2f2483dd3e/users/4452c578d42d49b3993b6f20d1930e81/roles/127fdc7ef05b4e0b98a940b334e5fcab => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:05:45.660350 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4a8f84-3a75-4efa-a76c-7829ead3bf66 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:45.660609 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4a8f84-3a75-4efa-a76c-7829ead3bf66 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:45.660843 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4a8f84-3a75-4efa-a76c-7829ead3bf66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:45.694698 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-fc4a8f84-3a75-4efa-a76c-7829ead3bf66 None None] MFA Rules not processed for user `4452c578d42d49b3993b6f20d1930e81`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:05:45.695911 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-fc4a8f84-3a75-4efa-a76c-7829ead3bf66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:45.778246 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1176/2394] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:05:45 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:05:45.789244 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ae5ef8-f242-4b9c-b655-423642348397 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:45.791479 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-52ae5ef8-f242-4b9c-b655-423642348397 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:45.870785 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ae5ef8-f242-4b9c-b655-423642348397 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:45.875515 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeb0e63-afa3-4019-8737-778c77b80ebe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b8a09704b9b4ab2bffb813796ec6e77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:45.876359 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb0e63-afa3-4019-8737-778c77b80ebe service cinder] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:45.877764 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb0e63-afa3-4019-8737-778c77b80ebe service cinder] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:45.878420 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb0e63-afa3-4019-8737-778c77b80ebe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:45.881440 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-bdeb0e63-afa3-4019-8737-778c77b80ebe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:45.972137 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeb0e63-afa3-4019-8737-778c77b80ebe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:45.972137 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeb0e63-afa3-4019-8737-778c77b80ebe service cinder] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:45.985449 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1219/2395] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:05:45 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 11:05:47.690784 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4a8f84-3a75-4efa-a76c-7829ead3bf66 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:47.700199 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4a8f84-3a75-4efa-a76c-7829ead3bf66 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:47.703853 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3588db42-6943-4cfd-80e3-d30c413b4c3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b8a09704b9b4ab2bffb813796ec6e77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:47.704456 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588db42-6943-4cfd-80e3-d30c413b4c3e service cinder] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:47.705330 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588db42-6943-4cfd-80e3-d30c413b4c3e service cinder] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:47.705975 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588db42-6943-4cfd-80e3-d30c413b4c3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:47.707568 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-3588db42-6943-4cfd-80e3-d30c413b4c3e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:47.768262 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3588db42-6943-4cfd-80e3-d30c413b4c3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:47.769726 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3588db42-6943-4cfd-80e3-d30c413b4c3e service cinder] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:47.778747 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1177/2396] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:05:47 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:05:48.325624 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeb0e63-afa3-4019-8737-778c77b80ebe service cinder] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:48.335118 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeb0e63-afa3-4019-8737-778c77b80ebe service cinder] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:48.338803 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a6e8a8-3944-4f18-b1bc-fae672402aa4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b8a09704b9b4ab2bffb813796ec6e77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:48.339408 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a6e8a8-3944-4f18-b1bc-fae672402aa4 service cinder] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:48.339690 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a6e8a8-3944-4f18-b1bc-fae672402aa4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:48.339968 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a6e8a8-3944-4f18-b1bc-fae672402aa4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:48.350692 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a6e8a8-3944-4f18-b1bc-fae672402aa4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:48.352125 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a6e8a8-3944-4f18-b1bc-fae672402aa4 service cinder] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:48.365986 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1220/2397] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:05:48 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:05:48.464302 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a961dbb-7df7-4bc5-8d5c-14012bd32ec2 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:48.464685 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a961dbb-7df7-4bc5-8d5c-14012bd32ec2 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:48.467243 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a961dbb-7df7-4bc5-8d5c-14012bd32ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:48.490995 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-4a961dbb-7df7-4bc5-8d5c-14012bd32ec2 None None] MFA Rules not processed for user `bcacf809f13043ab90716607160a70db`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:05:48.492681 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-4a961dbb-7df7-4bc5-8d5c-14012bd32ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:48.567643 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1178/2398] 10.222.0.15 () {58 vars in 967 bytes} [Thu Aug 18 11:05:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:05:48.586323 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a6e8a8-3944-4f18-b1bc-fae672402aa4 service cinder] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:48.587742 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-10a6e8a8-3944-4f18-b1bc-fae672402aa4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:48.634285 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:05:48.693951 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a6e8a8-3944-4f18-b1bc-fae672402aa4 service cinder] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:48.699721 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f5a3ba-56e5-472b-a6a8-e8d12533afbf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f97e906b1922419d8511ab1c8b9c86e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:48.700197 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f5a3ba-56e5-472b-a6a8-e8d12533afbf service swift] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:48.700470 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f5a3ba-56e5-472b-a6a8-e8d12533afbf service swift] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:48.700745 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f5a3ba-56e5-472b-a6a8-e8d12533afbf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:48.716261 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f5a3ba-56e5-472b-a6a8-e8d12533afbf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:48.717915 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f5a3ba-56e5-472b-a6a8-e8d12533afbf service swift] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:48.727406 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1221/2399] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Aug 18 11:05:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 11:05:50.586034 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a961dbb-7df7-4bc5-8d5c-14012bd32ec2 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:50.587713 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-4a961dbb-7df7-4bc5-8d5c-14012bd32ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:50.601507 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:05:50.687501 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a961dbb-7df7-4bc5-8d5c-14012bd32ec2 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:50.694115 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1723087c-95df-471f-b36b-ea545fd83cb7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f918bcdd83d4d48be3fff5a48c54929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:50.694840 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1723087c-95df-471f-b36b-ea545fd83cb7 service placement] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:50.697368 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1723087c-95df-471f-b36b-ea545fd83cb7 service placement] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:50.697368 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1723087c-95df-471f-b36b-ea545fd83cb7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:50.698798 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-1723087c-95df-471f-b36b-ea545fd83cb7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:50.712019 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1723087c-95df-471f-b36b-ea545fd83cb7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:50.713807 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1723087c-95df-471f-b36b-ea545fd83cb7 service placement] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:50.734201 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1179/2400] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:05:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:05:50.803977 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f5a3ba-56e5-472b-a6a8-e8d12533afbf service swift] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:50.805701 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-99f5a3ba-56e5-472b-a6a8-e8d12533afbf service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:50.897894 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f5a3ba-56e5-472b-a6a8-e8d12533afbf service swift] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:50.903692 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76644ec-f75e-4b45-9864-5b0621d2731b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:50.904328 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76644ec-f75e-4b45-9864-5b0621d2731b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:50.904607 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76644ec-f75e-4b45-9864-5b0621d2731b admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:50.904881 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76644ec-f75e-4b45-9864-5b0621d2731b admin admin] PATH_INFO: `/v3/users/2ea5b4501d934e1bbfd6d46577d09e5d` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:50.906059 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76644ec-f75e-4b45-9864-5b0621d2731b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ea5b4501d934e1bbfd6d46577d09e5d)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:50.908160 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76644ec-f75e-4b45-9864-5b0621d2731b admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:50.990063 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-f76644ec-f75e-4b45-9864-5b0621d2731b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ea5b4501d934e1bbfd6d46577d09e5d'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:50.990751 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-f76644ec-f75e-4b45-9864-5b0621d2731b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ea5b4501d934e1bbfd6d46577d09e5d'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:50.999201 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-f76644ec-f75e-4b45-9864-5b0621d2731b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ea5b4501d934e1bbfd6d46577d09e5d'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:51.021724 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-f76644ec-f75e-4b45-9864-5b0621d2731b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ea5b4501d934e1bbfd6d46577d09e5d'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:51.040257 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-f76644ec-f75e-4b45-9864-5b0621d2731b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ea5b4501d934e1bbfd6d46577d09e5d'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:51.053855 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1222/2401] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:05:50 2022] DELETE /identity/v3/users/2ea5b4501d934e1bbfd6d46577d09e5d => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:05:51.297981 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1723087c-95df-471f-b36b-ea545fd83cb7 service placement] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:51.312380 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1723087c-95df-471f-b36b-ea545fd83cb7 service placement] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:51.385119 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbfa225-1885-4524-85f5-877001d654a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:51.385781 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbfa225-1885-4524-85f5-877001d654a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:51.386066 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbfa225-1885-4524-85f5-877001d654a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:51.386342 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbfa225-1885-4524-85f5-877001d654a0 admin admin] PATH_INFO: `/v3/projects/d591dc6849c641888dbd28827a629d31` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:51.387461 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbfa225-1885-4524-85f5-877001d654a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d591dc6849c641888dbd28827a629d31)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:51.389408 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbfa225-1885-4524-85f5-877001d654a0 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:51.438644 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-1bbfa225-1885-4524-85f5-877001d654a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd591dc6849c641888dbd28827a629d31', 'request_id': 'req-1bbfa225-1885-4524-85f5-877001d654a0'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:51.446324 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-1bbfa225-1885-4524-85f5-877001d654a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd591dc6849c641888dbd28827a629d31', 'request_id': 'req-1bbfa225-1885-4524-85f5-877001d654a0'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:51.453110 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-1bbfa225-1885-4524-85f5-877001d654a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd591dc6849c641888dbd28827a629d31', 'request_id': 'req-1bbfa225-1885-4524-85f5-877001d654a0'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:51.464682 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-1bbfa225-1885-4524-85f5-877001d654a0 admin admin] The token cache is being invalidate because project d591dc6849c641888dbd28827a629d31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:05:51.464969 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-1bbfa225-1885-4524-85f5-877001d654a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:51.465701 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-1bbfa225-1885-4524-85f5-877001d654a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:51.467204 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1180/2402] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:05:51 2022] DELETE /identity/v3/projects/d591dc6849c641888dbd28827a629d31 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:05:52.450635 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76644ec-f75e-4b45-9864-5b0621d2731b admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:52.452128 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-f76644ec-f75e-4b45-9864-5b0621d2731b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:52.471294 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76644ec-f75e-4b45-9864-5b0621d2731b admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:52.515830 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:05:52.544292 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e9b9b0-0632-40d4-bbab-0529e78e086e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:52.544924 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e9b9b0-0632-40d4-bbab-0529e78e086e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:52.545203 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e9b9b0-0632-40d4-bbab-0529e78e086e admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:52.545473 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e9b9b0-0632-40d4-bbab-0529e78e086e admin admin] PATH_INFO: `/v3/users/d57a09d84bbf4649badbe155f9b67298` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:52.546623 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e9b9b0-0632-40d4-bbab-0529e78e086e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d57a09d84bbf4649badbe155f9b67298)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:52.548939 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e9b9b0-0632-40d4-bbab-0529e78e086e admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:52.600190 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-b3e9b9b0-0632-40d4-bbab-0529e78e086e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd57a09d84bbf4649badbe155f9b67298'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:52.600827 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-b3e9b9b0-0632-40d4-bbab-0529e78e086e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd57a09d84bbf4649badbe155f9b67298'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:52.608590 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-b3e9b9b0-0632-40d4-bbab-0529e78e086e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd57a09d84bbf4649badbe155f9b67298'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:52.623096 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-b3e9b9b0-0632-40d4-bbab-0529e78e086e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd57a09d84bbf4649badbe155f9b67298'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:52.632273 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-b3e9b9b0-0632-40d4-bbab-0529e78e086e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd57a09d84bbf4649badbe155f9b67298'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:52.640646 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1223/2403] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:05:52 2022] DELETE /identity/v3/users/d57a09d84bbf4649badbe155f9b67298 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:05:52.646422 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc1003b-eca7-44f6-a222-956be9d977a8 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:52.647114 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc1003b-eca7-44f6-a222-956be9d977a8 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:52.647114 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc1003b-eca7-44f6-a222-956be9d977a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:52.669810 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-4dc1003b-eca7-44f6-a222-956be9d977a8 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:05:52.671049 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-4dc1003b-eca7-44f6-a222-956be9d977a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:52.703388 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:05:52.747531 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1181/2404] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:05:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:05:52.758417 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e9b9b0-0632-40d4-bbab-0529e78e086e admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:52.759857 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-b3e9b9b0-0632-40d4-bbab-0529e78e086e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:52.828988 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e9b9b0-0632-40d4-bbab-0529e78e086e admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:52.834021 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0274d7f1-131e-471e-96a0-7259b5b47d7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:52.834645 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274d7f1-131e-471e-96a0-7259b5b47d7d service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:52.834914 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274d7f1-131e-471e-96a0-7259b5b47d7d service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:52.835203 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274d7f1-131e-471e-96a0-7259b5b47d7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:52.844949 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0274d7f1-131e-471e-96a0-7259b5b47d7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:52.846658 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0274d7f1-131e-471e-96a0-7259b5b47d7d service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:52.857331 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1224/2405] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:05:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:05:53.142975 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc1003b-eca7-44f6-a222-956be9d977a8 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:53.144495 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-4dc1003b-eca7-44f6-a222-956be9d977a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:53.158360 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc1003b-eca7-44f6-a222-956be9d977a8 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:53.162940 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732e3509-1b90-4efa-a0a6-8bde4a600e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:53.163525 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732e3509-1b90-4efa-a0a6-8bde4a600e6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:53.164432 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732e3509-1b90-4efa-a0a6-8bde4a600e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:53.164721 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732e3509-1b90-4efa-a0a6-8bde4a600e6d admin admin] PATH_INFO: `/v3/projects/78fa79cde33441a3be07bd01c806bc6f` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:53.166191 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732e3509-1b90-4efa-a0a6-8bde4a600e6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=78fa79cde33441a3be07bd01c806bc6f)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:53.168147 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732e3509-1b90-4efa-a0a6-8bde4a600e6d admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:53.219556 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-732e3509-1b90-4efa-a0a6-8bde4a600e6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78fa79cde33441a3be07bd01c806bc6f', 'request_id': 'req-732e3509-1b90-4efa-a0a6-8bde4a600e6d'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:53.227316 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-732e3509-1b90-4efa-a0a6-8bde4a600e6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78fa79cde33441a3be07bd01c806bc6f', 'request_id': 'req-732e3509-1b90-4efa-a0a6-8bde4a600e6d'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:53.234063 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-732e3509-1b90-4efa-a0a6-8bde4a600e6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78fa79cde33441a3be07bd01c806bc6f', 'request_id': 'req-732e3509-1b90-4efa-a0a6-8bde4a600e6d'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:53.245110 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-732e3509-1b90-4efa-a0a6-8bde4a600e6d admin admin] The token cache is being invalidate because project 78fa79cde33441a3be07bd01c806bc6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:05:53.245403 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-732e3509-1b90-4efa-a0a6-8bde4a600e6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:53.246091 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-732e3509-1b90-4efa-a0a6-8bde4a600e6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:53.247589 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1182/2406] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:05:53 2022] DELETE /identity/v3/projects/78fa79cde33441a3be07bd01c806bc6f => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:05:53.252288 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0274d7f1-131e-471e-96a0-7259b5b47d7d service neutron] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:53.261889 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0274d7f1-131e-471e-96a0-7259b5b47d7d service neutron] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:53.312357 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:05:53.320600 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacc42bb-6ec9-4839-ab4d-4769210d5a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:53.321238 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc42bb-6ec9-4839-ab4d-4769210d5a6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:53.321626 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc42bb-6ec9-4839-ab4d-4769210d5a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:53.321815 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc42bb-6ec9-4839-ab4d-4769210d5a6f admin admin] PATH_INFO: `/v3/users/91cbaf69fe8f4c82b8cddc1dcc21f93d` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:53.322961 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacc42bb-6ec9-4839-ab4d-4769210d5a6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=91cbaf69fe8f4c82b8cddc1dcc21f93d)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:53.324883 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacc42bb-6ec9-4839-ab4d-4769210d5a6f admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:53.371779 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-aacc42bb-6ec9-4839-ab4d-4769210d5a6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91cbaf69fe8f4c82b8cddc1dcc21f93d'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:53.372448 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-aacc42bb-6ec9-4839-ab4d-4769210d5a6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91cbaf69fe8f4c82b8cddc1dcc21f93d'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:53.382985 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-aacc42bb-6ec9-4839-ab4d-4769210d5a6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91cbaf69fe8f4c82b8cddc1dcc21f93d'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:53.397377 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-aacc42bb-6ec9-4839-ab4d-4769210d5a6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91cbaf69fe8f4c82b8cddc1dcc21f93d'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:53.406123 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-aacc42bb-6ec9-4839-ab4d-4769210d5a6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91cbaf69fe8f4c82b8cddc1dcc21f93d'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:53.412743 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1225/2407] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:05:53 2022] DELETE /identity/v3/users/91cbaf69fe8f4c82b8cddc1dcc21f93d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:05:53.800642 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732e3509-1b90-4efa-a0a6-8bde4a600e6d admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:53.802512 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-732e3509-1b90-4efa-a0a6-8bde4a600e6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:53.820875 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732e3509-1b90-4efa-a0a6-8bde4a600e6d admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:53.880638 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d599680-6e46-40b9-9f12-67e5afc3d871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:53.881267 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d599680-6e46-40b9-9f12-67e5afc3d871 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:53.881571 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d599680-6e46-40b9-9f12-67e5afc3d871 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:53.881881 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d599680-6e46-40b9-9f12-67e5afc3d871 admin admin] PATH_INFO: `/v3/projects/3cf09eaa7570441c83fada4cbb81afa4` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:53.883006 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d599680-6e46-40b9-9f12-67e5afc3d871 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cf09eaa7570441c83fada4cbb81afa4)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:53.884926 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d599680-6e46-40b9-9f12-67e5afc3d871 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:53.934236 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-0d599680-6e46-40b9-9f12-67e5afc3d871 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cf09eaa7570441c83fada4cbb81afa4', 'request_id': 'req-0d599680-6e46-40b9-9f12-67e5afc3d871'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:53.937720 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:05:53.941856 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-0d599680-6e46-40b9-9f12-67e5afc3d871 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cf09eaa7570441c83fada4cbb81afa4', 'request_id': 'req-0d599680-6e46-40b9-9f12-67e5afc3d871'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:53.950290 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-0d599680-6e46-40b9-9f12-67e5afc3d871 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cf09eaa7570441c83fada4cbb81afa4', 'request_id': 'req-0d599680-6e46-40b9-9f12-67e5afc3d871'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:53.961123 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-0d599680-6e46-40b9-9f12-67e5afc3d871 admin admin] The token cache is being invalidate because project 3cf09eaa7570441c83fada4cbb81afa4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:05:53.961416 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-0d599680-6e46-40b9-9f12-67e5afc3d871 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:53.962090 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-0d599680-6e46-40b9-9f12-67e5afc3d871 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:53.963572 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1183/2408] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:05:53 2022] DELETE /identity/v3/projects/3cf09eaa7570441c83fada4cbb81afa4 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:05:53.967715 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacc42bb-6ec9-4839-ab4d-4769210d5a6f admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:53.969110 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-aacc42bb-6ec9-4839-ab4d-4769210d5a6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:53.986065 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacc42bb-6ec9-4839-ab4d-4769210d5a6f admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:54.042456 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a12d6d6-becf-4c8f-b9ec-92e246aa765e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:54.043089 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a12d6d6-becf-4c8f-b9ec-92e246aa765e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:54.043371 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a12d6d6-becf-4c8f-b9ec-92e246aa765e admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:54.043647 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a12d6d6-becf-4c8f-b9ec-92e246aa765e admin admin] PATH_INFO: `/v3/users/4452c578d42d49b3993b6f20d1930e81` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:54.044773 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a12d6d6-becf-4c8f-b9ec-92e246aa765e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4452c578d42d49b3993b6f20d1930e81)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:54.046723 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a12d6d6-becf-4c8f-b9ec-92e246aa765e admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:54.092507 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-5a12d6d6-becf-4c8f-b9ec-92e246aa765e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4452c578d42d49b3993b6f20d1930e81'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:54.093160 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-5a12d6d6-becf-4c8f-b9ec-92e246aa765e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4452c578d42d49b3993b6f20d1930e81'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:54.100819 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-5a12d6d6-becf-4c8f-b9ec-92e246aa765e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4452c578d42d49b3993b6f20d1930e81'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:54.113194 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-5a12d6d6-becf-4c8f-b9ec-92e246aa765e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4452c578d42d49b3993b6f20d1930e81'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:54.118395 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:05:54.121950 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-5a12d6d6-becf-4c8f-b9ec-92e246aa765e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4452c578d42d49b3993b6f20d1930e81'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:54.130697 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1226/2409] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:05:53 2022] DELETE /identity/v3/users/4452c578d42d49b3993b6f20d1930e81 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:05:54.431828 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d599680-6e46-40b9-9f12-67e5afc3d871 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:54.433363 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-0d599680-6e46-40b9-9f12-67e5afc3d871 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:54.447429 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d599680-6e46-40b9-9f12-67e5afc3d871 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:54.509327 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5d92e1-729b-4835-8035-346b2913373b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:54.509981 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5d92e1-729b-4835-8035-346b2913373b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:54.510261 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5d92e1-729b-4835-8035-346b2913373b admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:54.510976 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5d92e1-729b-4835-8035-346b2913373b admin admin] PATH_INFO: `/v3/projects/69343222dc4c4ad3ad6fbc2f2483dd3e` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:54.511720 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5d92e1-729b-4835-8035-346b2913373b admin admin] RBAC: Authorizing `identity:delete_project(project_id=69343222dc4c4ad3ad6fbc2f2483dd3e)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:54.513639 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5d92e1-729b-4835-8035-346b2913373b admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:54.559503 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-dc5d92e1-729b-4835-8035-346b2913373b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69343222dc4c4ad3ad6fbc2f2483dd3e', 'request_id': 'req-dc5d92e1-729b-4835-8035-346b2913373b'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:54.566907 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-dc5d92e1-729b-4835-8035-346b2913373b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69343222dc4c4ad3ad6fbc2f2483dd3e', 'request_id': 'req-dc5d92e1-729b-4835-8035-346b2913373b'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:54.573183 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-dc5d92e1-729b-4835-8035-346b2913373b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69343222dc4c4ad3ad6fbc2f2483dd3e', 'request_id': 'req-dc5d92e1-729b-4835-8035-346b2913373b'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:54.584103 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-dc5d92e1-729b-4835-8035-346b2913373b admin admin] The token cache is being invalidate because project 69343222dc4c4ad3ad6fbc2f2483dd3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:05:54.584391 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-dc5d92e1-729b-4835-8035-346b2913373b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:54.585034 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-dc5d92e1-729b-4835-8035-346b2913373b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:54.586578 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1184/2410] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:05:54 2022] DELETE /identity/v3/projects/69343222dc4c4ad3ad6fbc2f2483dd3e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:05:54.591986 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13046ef-1a51-4b5f-bfd6-4615c87306db None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:54.592240 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13046ef-1a51-4b5f-bfd6-4615c87306db None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:54.592517 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13046ef-1a51-4b5f-bfd6-4615c87306db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:54.613691 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-b13046ef-1a51-4b5f-bfd6-4615c87306db None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:05:54.614953 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-b13046ef-1a51-4b5f-bfd6-4615c87306db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:54.687363 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1227/2411] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:05:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:05:54.696127 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f75eb98-fecf-4a6d-8ddc-c180085149db None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:54.696418 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f75eb98-fecf-4a6d-8ddc-c180085149db None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:54.696920 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f75eb98-fecf-4a6d-8ddc-c180085149db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:54.721065 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-1f75eb98-fecf-4a6d-8ddc-c180085149db None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:05:54.722293 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-1f75eb98-fecf-4a6d-8ddc-c180085149db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:54.730568 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1185/2412] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:05:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:05:54.735070 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13046ef-1a51-4b5f-bfd6-4615c87306db None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:54.745918 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13046ef-1a51-4b5f-bfd6-4615c87306db None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:54.752549 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5914b025-9a61-4ad4-88eb-406a190868ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:54.753304 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5914b025-9a61-4ad4-88eb-406a190868ca admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:54.753644 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5914b025-9a61-4ad4-88eb-406a190868ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:54.753990 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5914b025-9a61-4ad4-88eb-406a190868ca admin admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:54.754817 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5914b025-9a61-4ad4-88eb-406a190868ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:05:54.755100 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5914b025-9a61-4ad4-88eb-406a190868ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:54.759742 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5914b025-9a61-4ad4-88eb-406a190868ca admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:54.773701 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1228/2413] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Aug 18 11:05:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:05:54.775326 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f75eb98-fecf-4a6d-8ddc-c180085149db None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:54.787418 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f75eb98-fecf-4a6d-8ddc-c180085149db None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:54.793070 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bdc629-c4dc-4694-b02b-dcf0e5cf96ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:54.793954 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bdc629-c4dc-4694-b02b-dcf0e5cf96ff admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:54.794245 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bdc629-c4dc-4694-b02b-dcf0e5cf96ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:54.794754 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bdc629-c4dc-4694-b02b-dcf0e5cf96ff admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:54.795458 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bdc629-c4dc-4694-b02b-dcf0e5cf96ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:54.799140 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bdc629-c4dc-4694-b02b-dcf0e5cf96ff admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:54.831486 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1186/2414] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:05:54 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:05:54.835295 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5914b025-9a61-4ad4-88eb-406a190868ca admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:54.845275 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5914b025-9a61-4ad4-88eb-406a190868ca admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:54.907081 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34a074d-d262-4d71-9f10-c494dbd5537b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:54.907762 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a074d-d262-4d71-9f10-c494dbd5537b admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:54.908241 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a074d-d262-4d71-9f10-c494dbd5537b admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:54.908730 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a074d-d262-4d71-9f10-c494dbd5537b admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:54.909383 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34a074d-d262-4d71-9f10-c494dbd5537b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:54.911652 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34a074d-d262-4d71-9f10-c494dbd5537b admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:54.936361 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1229/2415] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:05:54 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:05:54.941456 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bdc629-c4dc-4694-b02b-dcf0e5cf96ff admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:54.952403 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bdc629-c4dc-4694-b02b-dcf0e5cf96ff admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:54.957205 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79a9bb8-c842-487f-8a7e-fac57d70eb1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:54.957858 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a9bb8-c842-487f-8a7e-fac57d70eb1c admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:54.958137 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a9bb8-c842-487f-8a7e-fac57d70eb1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:54.958410 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a9bb8-c842-487f-8a7e-fac57d70eb1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:54.959055 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79a9bb8-c842-487f-8a7e-fac57d70eb1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:54.960656 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79a9bb8-c842-487f-8a7e-fac57d70eb1c admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:54.972050 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1187/2416] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:05:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 11:05:54.976070 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34a074d-d262-4d71-9f10-c494dbd5537b admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:54.987450 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34a074d-d262-4d71-9f10-c494dbd5537b admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:54.992140 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c77678f-3f0b-4f14-9b8a-0289a9df5036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:54.992848 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c77678f-3f0b-4f14-9b8a-0289a9df5036 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:54.993138 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c77678f-3f0b-4f14-9b8a-0289a9df5036 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:54.993410 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c77678f-3f0b-4f14-9b8a-0289a9df5036 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:54.994083 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c77678f-3f0b-4f14-9b8a-0289a9df5036 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:54.995777 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c77678f-3f0b-4f14-9b8a-0289a9df5036 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:55.008042 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1230/2417] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:05:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:05:55.012050 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79a9bb8-c842-487f-8a7e-fac57d70eb1c admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:55.023136 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79a9bb8-c842-487f-8a7e-fac57d70eb1c admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:55.027874 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a19218b-d571-48a5-8430-baa9948660ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:55.028529 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a19218b-d571-48a5-8430-baa9948660ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:55.028814 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a19218b-d571-48a5-8430-baa9948660ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:55.029090 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a19218b-d571-48a5-8430-baa9948660ea admin admin] PATH_INFO: `/v3/projects/7768053870ff4646a1b82f7c659b3086/users/9b789427a4dd4d08a6076b4251379199/roles/719e5c62188d4f8a838987d6e72ca8f7` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:55.037555 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c77678f-3f0b-4f14-9b8a-0289a9df5036 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:55.039801 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-0c77678f-3f0b-4f14-9b8a-0289a9df5036 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:55.045721 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a19218b-d571-48a5-8430-baa9948660ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=7768053870ff4646a1b82f7c659b3086, user_id=9b789427a4dd4d08a6076b4251379199, role_id=719e5c62188d4f8a838987d6e72ca8f7)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:55.049011 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a19218b-d571-48a5-8430-baa9948660ea admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:55.062781 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1188/2418] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:05:55 2022] PUT /identity/v3/projects/7768053870ff4646a1b82f7c659b3086/users/9b789427a4dd4d08a6076b4251379199/roles/719e5c62188d4f8a838987d6e72ca8f7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:05:55.074483 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d495bd58-89e5-4c69-8041-75c87e376b71 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:55.074844 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d495bd58-89e5-4c69-8041-75c87e376b71 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:55.075122 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d495bd58-89e5-4c69-8041-75c87e376b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:55.094804 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:05:55.101037 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c77678f-3f0b-4f14-9b8a-0289a9df5036 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:55.107575 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-d495bd58-89e5-4c69-8041-75c87e376b71 None None] MFA Rules not processed for user `9b789427a4dd4d08a6076b4251379199`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:05:55.109657 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-d495bd58-89e5-4c69-8041-75c87e376b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:55.115716 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:05:55.156033 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f8fb55-4a6c-436a-a827-039374773434 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:55.156638 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f8fb55-4a6c-436a-a827-039374773434 service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:55.156915 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f8fb55-4a6c-436a-a827-039374773434 service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:55.157185 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f8fb55-4a6c-436a-a827-039374773434 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:55.159525 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-49f8fb55-4a6c-436a-a827-039374773434 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:55.187406 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1189/2419] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:05:55 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:05:55.198827 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d495bd58-89e5-4c69-8041-75c87e376b71 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:55.200207 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-d495bd58-89e5-4c69-8041-75c87e376b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:55.242884 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f8fb55-4a6c-436a-a827-039374773434 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:55.244320 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f8fb55-4a6c-436a-a827-039374773434 service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:55.255014 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1231/2420] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:05:55 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 11:05:55.266658 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d495bd58-89e5-4c69-8041-75c87e376b71 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:55.271115 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c61504-cd3e-49f6-ae70-b5f278cf2133 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b8a09704b9b4ab2bffb813796ec6e77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:55.271966 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c61504-cd3e-49f6-ae70-b5f278cf2133 service cinder] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:55.272275 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c61504-cd3e-49f6-ae70-b5f278cf2133 service cinder] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:55.272554 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c61504-cd3e-49f6-ae70-b5f278cf2133 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:55.281656 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c61504-cd3e-49f6-ae70-b5f278cf2133 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:55.283787 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c61504-cd3e-49f6-ae70-b5f278cf2133 service cinder] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:55.293661 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1190/2421] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:05:55 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 11:05:57.507732 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57be547-2525-4d85-b40e-215aa5cc26fe None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:57.508321 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57be547-2525-4d85-b40e-215aa5cc26fe None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:57.508321 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57be547-2525-4d85-b40e-215aa5cc26fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:57.528965 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-f57be547-2525-4d85-b40e-215aa5cc26fe None None] MFA Rules not processed for user `bcacf809f13043ab90716607160a70db`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:05:57.530830 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-f57be547-2525-4d85-b40e-215aa5cc26fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:57.593311 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1232/2422] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Aug 18 11:05:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:05:57.612947 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c61504-cd3e-49f6-ae70-b5f278cf2133 service cinder] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:57.615555 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-21c61504-cd3e-49f6-ae70-b5f278cf2133 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:57.706740 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c61504-cd3e-49f6-ae70-b5f278cf2133 service cinder] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:57.711883 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c7678a-1ee2-4733-a900-b42891417e33 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f97e906b1922419d8511ab1c8b9c86e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:57.712493 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7678a-1ee2-4733-a900-b42891417e33 service swift] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:57.712770 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7678a-1ee2-4733-a900-b42891417e33 service swift] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:57.713040 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7678a-1ee2-4733-a900-b42891417e33 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:57.723027 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c7678a-1ee2-4733-a900-b42891417e33 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:57.724884 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c7678a-1ee2-4733-a900-b42891417e33 service swift] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:57.734286 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1191/2423] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Aug 18 11:05:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 11:05:57.902466 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57be547-2525-4d85-b40e-215aa5cc26fe None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:58.010597 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57be547-2525-4d85-b40e-215aa5cc26fe None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:58.021981 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee522cb9-34a1-4551-a873-47e1d6b58f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:58.022618 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee522cb9-34a1-4551-a873-47e1d6b58f53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:58.023009 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee522cb9-34a1-4551-a873-47e1d6b58f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:58.023289 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee522cb9-34a1-4551-a873-47e1d6b58f53 admin admin] PATH_INFO: `/v3/users/9b789427a4dd4d08a6076b4251379199` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:58.026077 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee522cb9-34a1-4551-a873-47e1d6b58f53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b789427a4dd4d08a6076b4251379199)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:58.029130 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee522cb9-34a1-4551-a873-47e1d6b58f53 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:58.048305 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:05:58.102967 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-ee522cb9-34a1-4551-a873-47e1d6b58f53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b789427a4dd4d08a6076b4251379199'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:58.103928 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-ee522cb9-34a1-4551-a873-47e1d6b58f53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b789427a4dd4d08a6076b4251379199'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:58.122610 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-ee522cb9-34a1-4551-a873-47e1d6b58f53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b789427a4dd4d08a6076b4251379199'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:58.147530 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-ee522cb9-34a1-4551-a873-47e1d6b58f53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b789427a4dd4d08a6076b4251379199'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:58.158688 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-ee522cb9-34a1-4551-a873-47e1d6b58f53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b789427a4dd4d08a6076b4251379199'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:58.175684 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1233/2424] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:05:57 2022] DELETE /identity/v3/users/9b789427a4dd4d08a6076b4251379199 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:05:58.180164 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addc7b08-4943-4d86-8115-9bca7eea4de3 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:58.180462 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addc7b08-4943-4d86-8115-9bca7eea4de3 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:58.180751 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addc7b08-4943-4d86-8115-9bca7eea4de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:58.207490 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-addc7b08-4943-4d86-8115-9bca7eea4de3 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:05:58.209872 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-addc7b08-4943-4d86-8115-9bca7eea4de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:58.248333 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:05:58.336581 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1192/2425] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:05:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:05:58.353828 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee522cb9-34a1-4551-a873-47e1d6b58f53 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:58.356728 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-ee522cb9-34a1-4551-a873-47e1d6b58f53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:58.459157 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee522cb9-34a1-4551-a873-47e1d6b58f53 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:58.463441 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393c5421-7c2e-4210-8c50-1c4c0708b8df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:58.464119 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c5421-7c2e-4210-8c50-1c4c0708b8df service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:58.464446 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c5421-7c2e-4210-8c50-1c4c0708b8df service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:58.464758 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c5421-7c2e-4210-8c50-1c4c0708b8df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:58.477561 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393c5421-7c2e-4210-8c50-1c4c0708b8df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:58.479437 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393c5421-7c2e-4210-8c50-1c4c0708b8df service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:58.493713 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1234/2426] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:05:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:05:58.875948 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addc7b08-4943-4d86-8115-9bca7eea4de3 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:05:58.878589 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-addc7b08-4943-4d86-8115-9bca7eea4de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:05:58.912668 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addc7b08-4943-4d86-8115-9bca7eea4de3 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:05:58.928675 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ec516c-c3be-4f5f-a286-465454e393ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:05:58.929360 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec516c-c3be-4f5f-a286-465454e393ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:05:58.929689 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec516c-c3be-4f5f-a286-465454e393ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:05:58.930130 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec516c-c3be-4f5f-a286-465454e393ec admin admin] PATH_INFO: `/v3/projects/7768053870ff4646a1b82f7c659b3086` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:05:58.931420 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ec516c-c3be-4f5f-a286-465454e393ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=7768053870ff4646a1b82f7c659b3086)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:05:58.933774 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ec516c-c3be-4f5f-a286-465454e393ec admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:05:58.995535 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-b2ec516c-c3be-4f5f-a286-465454e393ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7768053870ff4646a1b82f7c659b3086', 'request_id': 'req-b2ec516c-c3be-4f5f-a286-465454e393ec'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:59.004962 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-b2ec516c-c3be-4f5f-a286-465454e393ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7768053870ff4646a1b82f7c659b3086', 'request_id': 'req-b2ec516c-c3be-4f5f-a286-465454e393ec'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:59.013163 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-b2ec516c-c3be-4f5f-a286-465454e393ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7768053870ff4646a1b82f7c659b3086', 'request_id': 'req-b2ec516c-c3be-4f5f-a286-465454e393ec'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:59.033477 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-b2ec516c-c3be-4f5f-a286-465454e393ec admin admin] The token cache is being invalidate because project 7768053870ff4646a1b82f7c659b3086 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:05:59.033918 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-b2ec516c-c3be-4f5f-a286-465454e393ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:59.037393 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-b2ec516c-c3be-4f5f-a286-465454e393ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:05:59.039635 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1193/2427] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:05:58 2022] DELETE /identity/v3/projects/7768053870ff4646a1b82f7c659b3086 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:06:08.488541 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=47,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:06:09.028201 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=40,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:06:11.200377 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a0f21d-8841-4f8d-9365-ec3d909b4e8e None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:06:11.200936 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a0f21d-8841-4f8d-9365-ec3d909b4e8e None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:06:11.200936 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a0f21d-8841-4f8d-9365-ec3d909b4e8e None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:06:11.202492 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1235/2428] 10.222.0.15 () {54 vars in 921 bytes} [Thu Aug 18 11:06:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:06:11.209792 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5300515b-2b14-4e17-9397-8ed2f842b8c4 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:06:11.210240 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5300515b-2b14-4e17-9397-8ed2f842b8c4 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:06:11.210351 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5300515b-2b14-4e17-9397-8ed2f842b8c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:06:11.232075 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-5300515b-2b14-4e17-9397-8ed2f842b8c4 None None] MFA Rules not processed for user `a005d8f0c46d44c7b6f2201a54717b12`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:06:11.233298 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-5300515b-2b14-4e17-9397-8ed2f842b8c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:06:11.310894 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1194/2429] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Aug 18 11:06:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:06:11.324568 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a0f21d-8841-4f8d-9365-ec3d909b4e8e None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:06:11.327174 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-52a0f21d-8841-4f8d-9365-ec3d909b4e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:06:11.411122 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a0f21d-8841-4f8d-9365-ec3d909b4e8e None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:06:11.414642 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f41826-5bf0-4c0c-a85e-e5fc850b96df service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77211d2dcef242c4a7fe2198556d5efc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:06:11.415236 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f41826-5bf0-4c0c-a85e-e5fc850b96df service glance] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:06:11.415513 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f41826-5bf0-4c0c-a85e-e5fc850b96df service glance] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:06:11.415789 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f41826-5bf0-4c0c-a85e-e5fc850b96df service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:06:11.426672 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f41826-5bf0-4c0c-a85e-e5fc850b96df service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:06:11.428069 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f41826-5bf0-4c0c-a85e-e5fc850b96df service glance] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:06:11.439391 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1236/2430] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:06:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:06:11.508533 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18672624-f95d-4a8b-b89d-44194eb1b566 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:06:11.508863 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18672624-f95d-4a8b-b89d-44194eb1b566 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:06:11.509212 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18672624-f95d-4a8b-b89d-44194eb1b566 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:06:11.510634 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1195/2431] 10.222.0.15 () {54 vars in 921 bytes} [Thu Aug 18 11:06:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:06:11.515445 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e431006c-bf83-4d39-89ae-bf275e18d480 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:06:11.515752 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e431006c-bf83-4d39-89ae-bf275e18d480 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:06:11.516027 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e431006c-bf83-4d39-89ae-bf275e18d480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:06:11.536844 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-e431006c-bf83-4d39-89ae-bf275e18d480 None None] MFA Rules not processed for user `86c2cd74178f443d9c2398ff8e00cccc`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:06:11.538078 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-e431006c-bf83-4d39-89ae-bf275e18d480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:06:11.592583 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1237/2432] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Aug 18 11:06:11 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:06:11.604995 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18672624-f95d-4a8b-b89d-44194eb1b566 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:06:11.606733 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-18672624-f95d-4a8b-b89d-44194eb1b566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:06:11.620590 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18672624-f95d-4a8b-b89d-44194eb1b566 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:06:11.624223 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e80eb0-907c-4792-86bb-29e400e70490 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:06:11.624677 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e80eb0-907c-4792-86bb-29e400e70490 service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:06:11.624955 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e80eb0-907c-4792-86bb-29e400e70490 service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:06:11.625225 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e80eb0-907c-4792-86bb-29e400e70490 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:06:11.632647 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e80eb0-907c-4792-86bb-29e400e70490 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:06:11.634104 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e80eb0-907c-4792-86bb-29e400e70490 service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:06:11.641842 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1196/2433] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:06:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:06:11.725194 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f539f92-c57b-4fe0-b56c-2155dce1354d None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:06:11.725550 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f539f92-c57b-4fe0-b56c-2155dce1354d None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:06:11.725855 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f539f92-c57b-4fe0-b56c-2155dce1354d None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:06:11.727424 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1238/2434] 10.222.0.15 () {54 vars in 921 bytes} [Thu Aug 18 11:06:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:06:11.732653 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7638438-aacb-4f4d-83b2-18f9bc385e94 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:06:11.732932 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7638438-aacb-4f4d-83b2-18f9bc385e94 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:06:11.733209 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7638438-aacb-4f4d-83b2-18f9bc385e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:06:11.753426 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-a7638438-aacb-4f4d-83b2-18f9bc385e94 None None] MFA Rules not processed for user `a005d8f0c46d44c7b6f2201a54717b12`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:06:11.754654 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-a7638438-aacb-4f4d-83b2-18f9bc385e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:06:11.763835 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1197/2435] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Aug 18 11:06:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:06:11.774425 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f539f92-c57b-4fe0-b56c-2155dce1354d None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:06:11.776268 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-0f539f92-c57b-4fe0-b56c-2155dce1354d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:06:11.790702 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f539f92-c57b-4fe0-b56c-2155dce1354d None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:06:11.794665 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acad33d9-58fe-4cb1-8f78-97c1bdbb87ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:06:11.795260 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad33d9-58fe-4cb1-8f78-97c1bdbb87ce service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:06:11.795576 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad33d9-58fe-4cb1-8f78-97c1bdbb87ce service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:06:11.795849 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad33d9-58fe-4cb1-8f78-97c1bdbb87ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:06:11.808648 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acad33d9-58fe-4cb1-8f78-97c1bdbb87ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:06:11.810113 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acad33d9-58fe-4cb1-8f78-97c1bdbb87ce service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:06:11.821627 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1239/2436] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:06:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:06:14.444974 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d49a632-1ae3-4feb-b0d4-483f2509659f None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:06:14.445458 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d49a632-1ae3-4feb-b0d4-483f2509659f None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:06:14.445587 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d49a632-1ae3-4feb-b0d4-483f2509659f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:06:14.464825 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-6d49a632-1ae3-4feb-b0d4-483f2509659f None None] MFA Rules not processed for user `bcacf809f13043ab90716607160a70db`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:06:14.466151 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-6d49a632-1ae3-4feb-b0d4-483f2509659f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:06:14.524037 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1198/2437] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Aug 18 11:06:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:06:14.546379 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acad33d9-58fe-4cb1-8f78-97c1bdbb87ce service neutron] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:06:14.549034 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-acad33d9-58fe-4cb1-8f78-97c1bdbb87ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:06:14.622695 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acad33d9-58fe-4cb1-8f78-97c1bdbb87ce service neutron] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:06:14.629557 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaba7e5-f618-4fdf-ac0d-3af07b916f40 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f97e906b1922419d8511ab1c8b9c86e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:06:14.630186 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaba7e5-f618-4fdf-ac0d-3af07b916f40 service swift] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:06:14.630465 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaba7e5-f618-4fdf-ac0d-3af07b916f40 service swift] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:06:14.630737 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaba7e5-f618-4fdf-ac0d-3af07b916f40 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:06:14.639407 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaba7e5-f618-4fdf-ac0d-3af07b916f40 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:06:14.641000 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaba7e5-f618-4fdf-ac0d-3af07b916f40 service swift] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:06:14.649367 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1240/2438] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Aug 18 11:06:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 11:06:24.517218 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=65 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:06:24.646131 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=87 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:06:38.620561 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f49fb7e-9578-4c95-ab13-046d20e674ad None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:06:38.621103 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f49fb7e-9578-4c95-ab13-046d20e674ad None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:06:38.621103 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f49fb7e-9578-4c95-ab13-046d20e674ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:06:38.649283 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-7f49fb7e-9578-4c95-ab13-046d20e674ad None None] MFA Rules not processed for user `bcacf809f13043ab90716607160a70db`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:06:38.650582 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-7f49fb7e-9578-4c95-ab13-046d20e674ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:06:38.658131 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1199/2439] 10.222.0.15 () {58 vars in 967 bytes} [Thu Aug 18 11:06:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:06:38.671021 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaba7e5-f618-4fdf-ac0d-3af07b916f40 service swift] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:06:38.682482 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaba7e5-f618-4fdf-ac0d-3af07b916f40 service swift] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:06:38.689986 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b988390-4f56-4233-80f0-761617c18795 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f97e906b1922419d8511ab1c8b9c86e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:06:38.690603 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b988390-4f56-4233-80f0-761617c18795 service swift] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:06:38.690891 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b988390-4f56-4233-80f0-761617c18795 service swift] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:06:38.691170 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b988390-4f56-4233-80f0-761617c18795 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:06:38.700129 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b988390-4f56-4233-80f0-761617c18795 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:06:38.701881 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b988390-4f56-4233-80f0-761617c18795 service swift] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:06:38.711933 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1241/2440] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Aug 18 11:06:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 11:06:41.505620 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaed3ee-442e-4071-bc13-b29d813e2eb7 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:06:41.506117 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaed3ee-442e-4071-bc13-b29d813e2eb7 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:06:41.506251 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaed3ee-442e-4071-bc13-b29d813e2eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:06:41.524999 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-afaed3ee-442e-4071-bc13-b29d813e2eb7 None None] MFA Rules not processed for user `57e117589fc14e4d9d8d8494bddf9c12`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:06:41.526239 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-afaed3ee-442e-4071-bc13-b29d813e2eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:06:41.584428 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1200/2441] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:06:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:06:48.708121 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=6 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:06:51.576848 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=28 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:06:55.975775 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa7d703-a493-4bc4-9edc-48535b7d9f71 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:06:55.976312 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa7d703-a493-4bc4-9edc-48535b7d9f71 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:06:55.976312 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa7d703-a493-4bc4-9edc-48535b7d9f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:06:55.995819 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-1aa7d703-a493-4bc4-9edc-48535b7d9f71 None None] MFA Rules not processed for user `074cfcc7943349a490b29cd4ae3364cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:06:55.997041 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-1aa7d703-a493-4bc4-9edc-48535b7d9f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:06:56.053179 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1242/2442] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:06:55 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:07:06.045475 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=25 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:07:25.257926 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68078430-3a84-4e83-b426-885d5108d4e4 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:07:25.258505 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68078430-3a84-4e83-b426-885d5108d4e4 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:07:25.258505 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68078430-3a84-4e83-b426-885d5108d4e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:07:25.278414 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-68078430-3a84-4e83-b426-885d5108d4e4 None None] MFA Rules not processed for user `7dc5501d59fb4593b405f0e9bd2e49ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:07:25.279629 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-68078430-3a84-4e83-b426-885d5108d4e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:07:25.342066 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1201/2443] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:07:25 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:07:35.333276 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=25 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:07:38.282539 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa7d703-a493-4bc4-9edc-48535b7d9f71 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:07:38.283945 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-1aa7d703-a493-4bc4-9edc-48535b7d9f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:07:38.343635 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa7d703-a493-4bc4-9edc-48535b7d9f71 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:07:38.347185 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a2d136-fc2c-42f8-8287-c3de2fa1fc2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b8a09704b9b4ab2bffb813796ec6e77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:07:38.347792 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a2d136-fc2c-42f8-8287-c3de2fa1fc2e service cinder] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:07:38.348068 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a2d136-fc2c-42f8-8287-c3de2fa1fc2e service cinder] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:07:38.348461 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a2d136-fc2c-42f8-8287-c3de2fa1fc2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:07:38.350212 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-e3a2d136-fc2c-42f8-8287-c3de2fa1fc2e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:07:38.367760 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a2d136-fc2c-42f8-8287-c3de2fa1fc2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:07:38.369203 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a2d136-fc2c-42f8-8287-c3de2fa1fc2e service cinder] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:07:38.384663 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1243/2444] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:07:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:07:38.629582 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68078430-3a84-4e83-b426-885d5108d4e4 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:07:38.640603 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68078430-3a84-4e83-b426-885d5108d4e4 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:07:38.644428 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722c6f5-54ca-4781-9ae8-6e5b2a7bf7ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:07:38.645037 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722c6f5-54ca-4781-9ae8-6e5b2a7bf7ab service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:07:38.645324 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722c6f5-54ca-4781-9ae8-6e5b2a7bf7ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:07:38.645632 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722c6f5-54ca-4781-9ae8-6e5b2a7bf7ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:07:38.647394 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-6722c6f5-54ca-4781-9ae8-6e5b2a7bf7ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:07:38.661425 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6722c6f5-54ca-4781-9ae8-6e5b2a7bf7ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:07:38.662903 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6722c6f5-54ca-4781-9ae8-6e5b2a7bf7ab service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:07:38.674464 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1202/2445] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:07:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:07:48.379541 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=26 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:07:48.592223 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a1daf3-0ccf-4f3a-93bb-901ed3972bdf None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:07:48.592582 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a1daf3-0ccf-4f3a-93bb-901ed3972bdf None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:07:48.593027 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a1daf3-0ccf-4f3a-93bb-901ed3972bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:07:48.612656 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-45a1daf3-0ccf-4f3a-93bb-901ed3972bdf None None] MFA Rules not processed for user `57e117589fc14e4d9d8d8494bddf9c12`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:07:48.613899 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-45a1daf3-0ccf-4f3a-93bb-901ed3972bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:07:48.621016 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1244/2446] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:07:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:07:48.669162 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=6 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:07:51.186569 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722c6f5-54ca-4781-9ae8-6e5b2a7bf7ab service neutron] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:07:51.188101 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-6722c6f5-54ca-4781-9ae8-6e5b2a7bf7ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:07:51.202915 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722c6f5-54ca-4781-9ae8-6e5b2a7bf7ab service neutron] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:07:51.209025 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b836d60-ab75-48d4-815a-7a9e02f43ce6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a005d8f0c46d44c7b6f2201a54717b12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:07:51.209664 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b836d60-ab75-48d4-815a-7a9e02f43ce6 service nova] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:07:51.209944 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b836d60-ab75-48d4-815a-7a9e02f43ce6 service nova] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:07:51.210218 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b836d60-ab75-48d4-815a-7a9e02f43ce6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:07:51.211993 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-2b836d60-ab75-48d4-815a-7a9e02f43ce6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:07:51.223992 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b836d60-ab75-48d4-815a-7a9e02f43ce6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:07:51.225827 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b836d60-ab75-48d4-815a-7a9e02f43ce6 service nova] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:07:51.235255 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1203/2447] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:07:51 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:07:57.332604 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a1daf3-0ccf-4f3a-93bb-901ed3972bdf None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:07:57.342177 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a1daf3-0ccf-4f3a-93bb-901ed3972bdf None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:07:57.346296 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c63e6ec-76a1-4157-a1e0-d51acda5004d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:07:57.346886 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c63e6ec-76a1-4157-a1e0-d51acda5004d service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:07:57.347164 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c63e6ec-76a1-4157-a1e0-d51acda5004d service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:07:57.347436 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c63e6ec-76a1-4157-a1e0-d51acda5004d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:07:57.349293 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-4c63e6ec-76a1-4157-a1e0-d51acda5004d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:07:57.360885 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c63e6ec-76a1-4157-a1e0-d51acda5004d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:07:57.362347 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c63e6ec-76a1-4157-a1e0-d51acda5004d service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:07:57.371817 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1245/2448] 10.222.0.15 () {60 vars in 1396 bytes} [Thu Aug 18 11:07:57 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3262 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:07:59.855182 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b836d60-ab75-48d4-815a-7a9e02f43ce6 service nova] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:07:59.864822 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b836d60-ab75-48d4-815a-7a9e02f43ce6 service nova] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:07:59.868514 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd3a96d-d008-41b6-8ec6-b126a83d372d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:07:59.869180 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd3a96d-d008-41b6-8ec6-b126a83d372d service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:07:59.869648 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd3a96d-d008-41b6-8ec6-b126a83d372d service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:07:59.869818 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd3a96d-d008-41b6-8ec6-b126a83d372d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:07:59.871569 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-abd3a96d-d008-41b6-8ec6-b126a83d372d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:07:59.942343 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd3a96d-d008-41b6-8ec6-b126a83d372d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:07:59.943833 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd3a96d-d008-41b6-8ec6-b126a83d372d service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:07:59.955236 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1204/2449] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:07:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:08:03.642924 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c63e6ec-76a1-4157-a1e0-d51acda5004d service neutron] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:08:03.644586 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-4c63e6ec-76a1-4157-a1e0-d51acda5004d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:08:03.660070 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c63e6ec-76a1-4157-a1e0-d51acda5004d service neutron] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:08:03.666893 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6b28af-e8ff-4145-92a2-c2c22772805f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:08:03.667585 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b28af-e8ff-4145-92a2-c2c22772805f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:08:03.667890 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b28af-e8ff-4145-92a2-c2c22772805f admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:08:03.668448 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b28af-e8ff-4145-92a2-c2c22772805f admin admin] PATH_INFO: `/v3/users/074cfcc7943349a490b29cd4ae3364cb` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:08:03.673430 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6b28af-e8ff-4145-92a2-c2c22772805f admin admin] RBAC: Authorizing `identity:delete_user(user_id=074cfcc7943349a490b29cd4ae3364cb)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:08:03.675381 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6b28af-e8ff-4145-92a2-c2c22772805f admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:08:03.727039 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-7a6b28af-e8ff-4145-92a2-c2c22772805f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '074cfcc7943349a490b29cd4ae3364cb'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:08:03.727700 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-7a6b28af-e8ff-4145-92a2-c2c22772805f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '074cfcc7943349a490b29cd4ae3364cb'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:08:03.735426 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-7a6b28af-e8ff-4145-92a2-c2c22772805f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '074cfcc7943349a490b29cd4ae3364cb'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:08:03.747457 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-7a6b28af-e8ff-4145-92a2-c2c22772805f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '074cfcc7943349a490b29cd4ae3364cb'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:08:03.756570 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-7a6b28af-e8ff-4145-92a2-c2c22772805f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '074cfcc7943349a490b29cd4ae3364cb'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:08:03.763894 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1246/2450] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:08:03 2022] DELETE /identity/v3/users/074cfcc7943349a490b29cd4ae3364cb => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:08:04.176309 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd3a96d-d008-41b6-8ec6-b126a83d372d service neutron] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:08:04.187985 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd3a96d-d008-41b6-8ec6-b126a83d372d service neutron] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:08:04.253308 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b287f1e-46f8-4b53-8edc-1101808ea168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:08:04.253933 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b287f1e-46f8-4b53-8edc-1101808ea168 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:08:04.254341 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b287f1e-46f8-4b53-8edc-1101808ea168 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:08:04.254583 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b287f1e-46f8-4b53-8edc-1101808ea168 admin admin] PATH_INFO: `/v3/projects/ae09c11177204226a2aa5bb600ee575b` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:08:04.255784 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b287f1e-46f8-4b53-8edc-1101808ea168 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae09c11177204226a2aa5bb600ee575b)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:08:04.257719 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b287f1e-46f8-4b53-8edc-1101808ea168 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:08:04.307984 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-8b287f1e-46f8-4b53-8edc-1101808ea168 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae09c11177204226a2aa5bb600ee575b', 'request_id': 'req-8b287f1e-46f8-4b53-8edc-1101808ea168'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:08:04.315885 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-8b287f1e-46f8-4b53-8edc-1101808ea168 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae09c11177204226a2aa5bb600ee575b', 'request_id': 'req-8b287f1e-46f8-4b53-8edc-1101808ea168'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:08:04.322804 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-8b287f1e-46f8-4b53-8edc-1101808ea168 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae09c11177204226a2aa5bb600ee575b', 'request_id': 'req-8b287f1e-46f8-4b53-8edc-1101808ea168'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:08:04.334651 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-8b287f1e-46f8-4b53-8edc-1101808ea168 admin admin] The token cache is being invalidate because project ae09c11177204226a2aa5bb600ee575b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:08:04.334939 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-8b287f1e-46f8-4b53-8edc-1101808ea168 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:08:04.335689 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-8b287f1e-46f8-4b53-8edc-1101808ea168 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:08:04.337270 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1205/2451] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:08:04 2022] DELETE /identity/v3/projects/ae09c11177204226a2aa5bb600ee575b => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:08:04.342477 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf100c-afa7-4558-a2b7-30b6dbdb0808 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:08:04.342855 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf100c-afa7-4558-a2b7-30b6dbdb0808 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:08:04.343845 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf100c-afa7-4558-a2b7-30b6dbdb0808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:08:04.363805 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-eecf100c-afa7-4558-a2b7-30b6dbdb0808 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:08:04.365027 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-eecf100c-afa7-4558-a2b7-30b6dbdb0808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:08:04.429054 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1247/2452] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:08:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:08:04.436680 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178a3330-f62b-4f8a-9193-43f7949e01eb None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:08:04.437769 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178a3330-f62b-4f8a-9193-43f7949e01eb None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:08:04.438190 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178a3330-f62b-4f8a-9193-43f7949e01eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:08:04.459893 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-178a3330-f62b-4f8a-9193-43f7949e01eb None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:08:04.461154 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-178a3330-f62b-4f8a-9193-43f7949e01eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:08:04.469750 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1206/2453] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:08:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:08:04.474539 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecf100c-afa7-4558-a2b7-30b6dbdb0808 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:08:04.486156 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecf100c-afa7-4558-a2b7-30b6dbdb0808 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:08:04.490939 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69d91bb-62c7-47cf-a566-88774d2eabfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:08:04.491578 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d91bb-62c7-47cf-a566-88774d2eabfe admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:08:04.491861 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d91bb-62c7-47cf-a566-88774d2eabfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:08:04.492139 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d91bb-62c7-47cf-a566-88774d2eabfe admin admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:08:04.492817 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69d91bb-62c7-47cf-a566-88774d2eabfe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:08:04.493123 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69d91bb-62c7-47cf-a566-88774d2eabfe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:08:04.494767 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69d91bb-62c7-47cf-a566-88774d2eabfe admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:08:04.507787 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1248/2454] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Aug 18 11:08:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:08:04.512380 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178a3330-f62b-4f8a-9193-43f7949e01eb None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:08:04.518338 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:08:04.523097 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178a3330-f62b-4f8a-9193-43f7949e01eb None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:08:04.530272 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db746094-3d56-474e-8edf-5d6b3a248c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:08:04.531949 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db746094-3d56-474e-8edf-5d6b3a248c5e admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:08:04.532229 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db746094-3d56-474e-8edf-5d6b3a248c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:08:04.532556 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db746094-3d56-474e-8edf-5d6b3a248c5e admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:08:04.533219 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db746094-3d56-474e-8edf-5d6b3a248c5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:08:04.535784 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db746094-3d56-474e-8edf-5d6b3a248c5e admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:08:04.570107 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1207/2455] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:08:04 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:08:04.571300 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69d91bb-62c7-47cf-a566-88774d2eabfe admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:08:04.582419 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69d91bb-62c7-47cf-a566-88774d2eabfe admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:08:04.623524 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:08:04.645500 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bf5024-5379-4655-b09b-13da35d6090a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:08:04.646895 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf5024-5379-4655-b09b-13da35d6090a admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:08:04.647179 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf5024-5379-4655-b09b-13da35d6090a admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:08:04.647512 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf5024-5379-4655-b09b-13da35d6090a admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:08:04.648445 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bf5024-5379-4655-b09b-13da35d6090a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:08:04.650494 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bf5024-5379-4655-b09b-13da35d6090a admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:08:04.673653 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1249/2456] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:08:04 2022] POST /identity/v3/users => generated 289 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:08:04.680459 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db746094-3d56-474e-8edf-5d6b3a248c5e admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:08:04.694516 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db746094-3d56-474e-8edf-5d6b3a248c5e admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:08:04.700175 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62cf186-f2d3-45af-be3c-600e5bbd61be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:08:04.700786 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62cf186-f2d3-45af-be3c-600e5bbd61be admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:08:04.701061 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62cf186-f2d3-45af-be3c-600e5bbd61be admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:08:04.701328 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62cf186-f2d3-45af-be3c-600e5bbd61be admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:08:04.702024 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62cf186-f2d3-45af-be3c-600e5bbd61be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:08:04.703935 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62cf186-f2d3-45af-be3c-600e5bbd61be admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:08:04.714510 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1208/2457] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:08:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:08:04.719131 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bf5024-5379-4655-b09b-13da35d6090a admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:08:04.730565 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bf5024-5379-4655-b09b-13da35d6090a admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:08:04.736797 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87a34c9-cd75-427e-a9ff-6dbe4fe9deb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:08:04.737565 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a34c9-cd75-427e-a9ff-6dbe4fe9deb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:08:04.737826 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a34c9-cd75-427e-a9ff-6dbe4fe9deb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:08:04.738105 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a34c9-cd75-427e-a9ff-6dbe4fe9deb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:08:04.738944 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87a34c9-cd75-427e-a9ff-6dbe4fe9deb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:08:04.741191 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87a34c9-cd75-427e-a9ff-6dbe4fe9deb7 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:08:04.753014 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1250/2458] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:08:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:08:04.757432 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62cf186-f2d3-45af-be3c-600e5bbd61be admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:08:04.767490 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62cf186-f2d3-45af-be3c-600e5bbd61be admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:08:04.772847 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecf1398-7ce1-47a1-94e3-6f3e9e3694cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:08:04.773542 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf1398-7ce1-47a1-94e3-6f3e9e3694cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:08:04.773839 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf1398-7ce1-47a1-94e3-6f3e9e3694cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:08:04.774116 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf1398-7ce1-47a1-94e3-6f3e9e3694cb admin admin] PATH_INFO: `/v3/projects/c2dd094c20324a7e8bfe6f3ea11dce38/users/932e75ccffec4118b9de434cc59564f7/roles/719e5c62188d4f8a838987d6e72ca8f7` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:08:04.791772 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecf1398-7ce1-47a1-94e3-6f3e9e3694cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2dd094c20324a7e8bfe6f3ea11dce38, user_id=932e75ccffec4118b9de434cc59564f7, role_id=719e5c62188d4f8a838987d6e72ca8f7)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:08:04.794776 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecf1398-7ce1-47a1-94e3-6f3e9e3694cb admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:08:04.810485 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1209/2459] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:08:04 2022] PUT /identity/v3/projects/c2dd094c20324a7e8bfe6f3ea11dce38/users/932e75ccffec4118b9de434cc59564f7/roles/719e5c62188d4f8a838987d6e72ca8f7 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:08:04.816445 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c6f57-2601-4476-9bdc-b116b78b68cd None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:08:04.816765 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c6f57-2601-4476-9bdc-b116b78b68cd None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:08:04.817116 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c6f57-2601-4476-9bdc-b116b78b68cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:08:04.837098 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-c23c6f57-2601-4476-9bdc-b116b78b68cd None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:08:04.838371 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-c23c6f57-2601-4476-9bdc-b116b78b68cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:08:04.907273 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1251/2460] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:08:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:08:04.918403 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecf1398-7ce1-47a1-94e3-6f3e9e3694cb admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:08:04.920177 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-5ecf1398-7ce1-47a1-94e3-6f3e9e3694cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:08:04.986891 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecf1398-7ce1-47a1-94e3-6f3e9e3694cb admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:08:04.991824 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7044c5-29dc-48f4-bae3-402d498c2c8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:08:04.992457 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7044c5-29dc-48f4-bae3-402d498c2c8c service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:08:04.992740 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7044c5-29dc-48f4-bae3-402d498c2c8c service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:08:04.992850 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23c6f57-2601-4476-9bdc-b116b78b68cd None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:08:04.993019 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7044c5-29dc-48f4-bae3-402d498c2c8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:08:05.003837 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7044c5-29dc-48f4-bae3-402d498c2c8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:08:05.005280 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7044c5-29dc-48f4-bae3-402d498c2c8c service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:08:05.016620 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1210/2461] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:08:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:08:05.018050 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23c6f57-2601-4476-9bdc-b116b78b68cd None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:08:05.022111 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad6f42d-9317-48c4-be8d-a6b875159eb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:08:05.022732 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad6f42d-9317-48c4-be8d-a6b875159eb3 service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:08:05.023021 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad6f42d-9317-48c4-be8d-a6b875159eb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:08:05.023296 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad6f42d-9317-48c4-be8d-a6b875159eb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:08:05.025567 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-6ad6f42d-9317-48c4-be8d-a6b875159eb3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:08:05.037703 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad6f42d-9317-48c4-be8d-a6b875159eb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:08:05.039807 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad6f42d-9317-48c4-be8d-a6b875159eb3 service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:08:05.054961 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1252/2462] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:08:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:08:09.741982 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898c947-1986-4382-afca-d599c42a967c None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:08:09.742840 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898c947-1986-4382-afca-d599c42a967c None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:08:09.743120 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898c947-1986-4382-afca-d599c42a967c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:08:09.772508 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-f898c947-1986-4382-afca-d599c42a967c None None] MFA Rules not processed for user `932e75ccffec4118b9de434cc59564f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:08:09.773700 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-f898c947-1986-4382-afca-d599c42a967c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:08:09.857154 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1211/2463] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:08:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:08:09.872274 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad6f42d-9317-48c4-be8d-a6b875159eb3 service neutron] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:08:09.875395 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-6ad6f42d-9317-48c4-be8d-a6b875159eb3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:08:09.955446 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad6f42d-9317-48c4-be8d-a6b875159eb3 service neutron] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:08:09.960947 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3317a9-aacf-495c-80e9-681e9d47d9c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a005d8f0c46d44c7b6f2201a54717b12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:08:09.961769 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3317a9-aacf-495c-80e9-681e9d47d9c4 service nova] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:08:09.961876 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3317a9-aacf-495c-80e9-681e9d47d9c4 service nova] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:08:09.962115 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3317a9-aacf-495c-80e9-681e9d47d9c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:08:09.972001 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3317a9-aacf-495c-80e9-681e9d47d9c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:08:09.973762 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3317a9-aacf-495c-80e9-681e9d47d9c4 service nova] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:08:09.985072 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1253/2464] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:08:09 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:08:11.448788 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b006322-bb43-47e1-9601-3a09e5a873ff None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:08:11.449667 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b006322-bb43-47e1-9601-3a09e5a873ff None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:08:11.450011 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b006322-bb43-47e1-9601-3a09e5a873ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:08:11.472035 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-8b006322-bb43-47e1-9601-3a09e5a873ff None None] MFA Rules not processed for user `932e75ccffec4118b9de434cc59564f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:08:11.473270 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-8b006322-bb43-47e1-9601-3a09e5a873ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:08:11.480528 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1212/2465] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:08:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:08:11.836052 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3317a9-aacf-495c-80e9-681e9d47d9c4 service nova] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:08:11.846067 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3317a9-aacf-495c-80e9-681e9d47d9c4 service nova] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:08:11.849747 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668224f8-716d-4954-bce5-fe66a8b46e75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:08:11.850845 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668224f8-716d-4954-bce5-fe66a8b46e75 service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:08:11.850845 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668224f8-716d-4954-bce5-fe66a8b46e75 service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:08:11.850845 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668224f8-716d-4954-bce5-fe66a8b46e75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:08:11.852502 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-668224f8-716d-4954-bce5-fe66a8b46e75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:08:11.862460 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668224f8-716d-4954-bce5-fe66a8b46e75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:08:11.863910 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668224f8-716d-4954-bce5-fe66a8b46e75 service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:08:11.873185 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1254/2466] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:08:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:08:12.242161 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b006322-bb43-47e1-9601-3a09e5a873ff None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:08:12.243708 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-8b006322-bb43-47e1-9601-3a09e5a873ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:08:12.292688 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:08:12.334468 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b006322-bb43-47e1-9601-3a09e5a873ff None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:08:12.339593 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5220f29-41c9-4d11-a57d-84857edd6872 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f918bcdd83d4d48be3fff5a48c54929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:08:12.340209 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5220f29-41c9-4d11-a57d-84857edd6872 service placement] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:08:12.340491 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5220f29-41c9-4d11-a57d-84857edd6872 service placement] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:08:12.340765 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5220f29-41c9-4d11-a57d-84857edd6872 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:08:12.342534 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-e5220f29-41c9-4d11-a57d-84857edd6872 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:08:12.354537 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5220f29-41c9-4d11-a57d-84857edd6872 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:08:12.356130 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5220f29-41c9-4d11-a57d-84857edd6872 service placement] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:08:12.366786 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1213/2467] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:08:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:08:12.871375 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668224f8-716d-4954-bce5-fe66a8b46e75 service neutron] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:08:12.872970 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-668224f8-716d-4954-bce5-fe66a8b46e75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:08:12.892071 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668224f8-716d-4954-bce5-fe66a8b46e75 service neutron] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:08:12.899848 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b4bd95-3666-49f4-b2dd-f83449b45610 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a005d8f0c46d44c7b6f2201a54717b12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:08:12.901271 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b4bd95-3666-49f4-b2dd-f83449b45610 service nova] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:08:12.901774 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b4bd95-3666-49f4-b2dd-f83449b45610 service nova] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:08:12.902298 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b4bd95-3666-49f4-b2dd-f83449b45610 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:08:12.905903 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-48b4bd95-3666-49f4-b2dd-f83449b45610 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:08:12.928014 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:08:13.007472 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b4bd95-3666-49f4-b2dd-f83449b45610 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:08:13.009069 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b4bd95-3666-49f4-b2dd-f83449b45610 service nova] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:08:13.022041 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1255/2468] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:08:12 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:08:15.722232 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5220f29-41c9-4d11-a57d-84857edd6872 service placement] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:08:15.736048 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5220f29-41c9-4d11-a57d-84857edd6872 service placement] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:08:15.744040 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10635d5-c9f9-4816-9e63-0b62f1ac8527 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a005d8f0c46d44c7b6f2201a54717b12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:08:15.744731 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10635d5-c9f9-4816-9e63-0b62f1ac8527 service nova] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:08:15.745178 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10635d5-c9f9-4816-9e63-0b62f1ac8527 service nova] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:08:15.745461 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10635d5-c9f9-4816-9e63-0b62f1ac8527 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:08:15.747344 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-c10635d5-c9f9-4816-9e63-0b62f1ac8527 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:08:15.761373 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10635d5-c9f9-4816-9e63-0b62f1ac8527 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:08:15.763935 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10635d5-c9f9-4816-9e63-0b62f1ac8527 service nova] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:08:15.786361 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1214/2469] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:08:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:08:19.073750 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2768af3-49d6-4708-a0e7-856f4e5b3fb2 None None] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:08:19.074281 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2768af3-49d6-4708-a0e7-856f4e5b3fb2 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:08:19.074281 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2768af3-49d6-4708-a0e7-856f4e5b3fb2 None None] PATH_INFO: `/` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:08:19.075735 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1256/2470] 10.222.0.15 () {54 vars in 921 bytes} [Thu Aug 18 11:08:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:08:19.082658 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a5ae13-8f84-4b2e-b459-b9e0df3da99c None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:08:19.083088 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a5ae13-8f84-4b2e-b459-b9e0df3da99c None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:08:19.083195 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a5ae13-8f84-4b2e-b459-b9e0df3da99c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:08:19.104170 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-67a5ae13-8f84-4b2e-b459-b9e0df3da99c None None] MFA Rules not processed for user `86c2cd74178f443d9c2398ff8e00cccc`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:08:19.105454 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-67a5ae13-8f84-4b2e-b459-b9e0df3da99c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:08:19.113342 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1215/2471] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Aug 18 11:08:19 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:08:19.126396 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2768af3-49d6-4708-a0e7-856f4e5b3fb2 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:08:19.128103 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-a2768af3-49d6-4708-a0e7-856f4e5b3fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:08:19.142721 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2768af3-49d6-4708-a0e7-856f4e5b3fb2 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:08:19.146408 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926aa7fa-c205-4f4d-9c5f-b807b6d0a58c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:08:19.147015 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926aa7fa-c205-4f4d-9c5f-b807b6d0a58c service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:08:19.147546 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926aa7fa-c205-4f4d-9c5f-b807b6d0a58c service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:08:19.147830 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926aa7fa-c205-4f4d-9c5f-b807b6d0a58c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:08:19.156494 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926aa7fa-c205-4f4d-9c5f-b807b6d0a58c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:08:19.157537 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926aa7fa-c205-4f4d-9c5f-b807b6d0a58c service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:08:19.166246 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1257/2472] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:08:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:08:19.251893 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e671d095-0e6d-429c-a8c9-bd2fd2267949 None None] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:08:19.252181 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e671d095-0e6d-429c-a8c9-bd2fd2267949 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:08:19.252457 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e671d095-0e6d-429c-a8c9-bd2fd2267949 None None] PATH_INFO: `/` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:08:19.254029 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1216/2473] 10.222.0.15 () {54 vars in 921 bytes} [Thu Aug 18 11:08:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:08:19.259351 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0d651-fad9-40b1-ab58-d51fab3e6877 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:08:19.259638 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0d651-fad9-40b1-ab58-d51fab3e6877 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:08:19.259940 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0d651-fad9-40b1-ab58-d51fab3e6877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:08:19.280005 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-e7c0d651-fad9-40b1-ab58-d51fab3e6877 None None] MFA Rules not processed for user `a005d8f0c46d44c7b6f2201a54717b12`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:08:19.281924 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-e7c0d651-fad9-40b1-ab58-d51fab3e6877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:08:19.291202 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1258/2474] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Aug 18 11:08:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:08:19.302581 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e671d095-0e6d-429c-a8c9-bd2fd2267949 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:08:19.317954 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e671d095-0e6d-429c-a8c9-bd2fd2267949 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:08:19.322116 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f1d7e4-70f9-476d-bd46-357037064585 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:08:19.322739 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1d7e4-70f9-476d-bd46-357037064585 service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:08:19.323021 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1d7e4-70f9-476d-bd46-357037064585 service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:08:19.323299 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1d7e4-70f9-476d-bd46-357037064585 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:08:19.335193 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f1d7e4-70f9-476d-bd46-357037064585 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:08:19.336708 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f1d7e4-70f9-476d-bd46-357037064585 service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:08:19.348689 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1217/2475] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:08:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:08:24.872447 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c0d651-fad9-40b1-ab58-d51fab3e6877 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:08:24.884049 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c0d651-fad9-40b1-ab58-d51fab3e6877 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:08:24.890229 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fc2650-4d71-495d-87e9-82e5c718aefa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a005d8f0c46d44c7b6f2201a54717b12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:08:24.890837 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc2650-4d71-495d-87e9-82e5c718aefa service nova] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:08:24.891113 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc2650-4d71-495d-87e9-82e5c718aefa service nova] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:08:24.891389 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc2650-4d71-495d-87e9-82e5c718aefa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:08:24.893138 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-85fc2650-4d71-495d-87e9-82e5c718aefa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:08:24.906435 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fc2650-4d71-495d-87e9-82e5c718aefa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:08:24.908064 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fc2650-4d71-495d-87e9-82e5c718aefa service nova] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:08:24.919127 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1259/2476] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:08:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:08:29.343667 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=32 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:08:34.914337 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=35 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:08:34.980467 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb7175-f171-46b0-a926-60b3fba52cbe None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:08:34.980965 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb7175-f171-46b0-a926-60b3fba52cbe None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:08:34.981060 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb7175-f171-46b0-a926-60b3fba52cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:08:35.000908 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-50cb7175-f171-46b0-a926-60b3fba52cbe None None] MFA Rules not processed for user `bcacf809f13043ab90716607160a70db`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:08:35.002162 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-50cb7175-f171-46b0-a926-60b3fba52cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:08:35.063558 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1218/2477] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Aug 18 11:08:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:08:35.116412 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fc2650-4d71-495d-87e9-82e5c718aefa service nova] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:08:35.117842 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-85fc2650-4d71-495d-87e9-82e5c718aefa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:08:35.196472 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fc2650-4d71-495d-87e9-82e5c718aefa service nova] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:08:35.201412 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bad4a52-b536-4001-a1bc-38d15c466eb5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f97e906b1922419d8511ab1c8b9c86e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:08:35.202755 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad4a52-b536-4001-a1bc-38d15c466eb5 service swift] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:08:35.202994 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad4a52-b536-4001-a1bc-38d15c466eb5 service swift] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:08:35.203270 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad4a52-b536-4001-a1bc-38d15c466eb5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:08:35.211786 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bad4a52-b536-4001-a1bc-38d15c466eb5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:08:35.213356 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bad4a52-b536-4001-a1bc-38d15c466eb5 service swift] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:08:35.222072 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1260/2478] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Aug 18 11:08:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 11:08:45.055916 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=25 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:08:45.218347 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=32 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:08:50.988696 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6af266a-528f-49bb-a37d-0e261ac9239c None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:08:50.989245 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6af266a-528f-49bb-a37d-0e261ac9239c None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:08:50.989380 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6af266a-528f-49bb-a37d-0e261ac9239c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:08:51.017212 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-a6af266a-528f-49bb-a37d-0e261ac9239c None None] MFA Rules not processed for user `bcacf809f13043ab90716607160a70db`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:08:51.018442 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-a6af266a-528f-49bb-a37d-0e261ac9239c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:08:51.026047 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1219/2479] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Aug 18 11:08:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:08:51.040863 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bad4a52-b536-4001-a1bc-38d15c466eb5 service swift] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:08:51.054868 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bad4a52-b536-4001-a1bc-38d15c466eb5 service swift] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:08:51.059771 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed9d97e-a122-43be-a037-365b39726ab4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f97e906b1922419d8511ab1c8b9c86e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:08:51.060403 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9d97e-a122-43be-a037-365b39726ab4 service swift] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:08:51.060708 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9d97e-a122-43be-a037-365b39726ab4 service swift] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:08:51.060984 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9d97e-a122-43be-a037-365b39726ab4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:08:51.072578 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed9d97e-a122-43be-a037-365b39726ab4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:08:51.074257 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed9d97e-a122-43be-a037-365b39726ab4 service swift] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:08:51.083821 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1261/2480] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Aug 18 11:08:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 11:09:01.006846 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=3 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:01.080342 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=6 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:07.363930 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede6836a-dd06-4e76-8ee9-ed46ad0e26c3 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:07.364378 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede6836a-dd06-4e76-8ee9-ed46ad0e26c3 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:07.364532 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede6836a-dd06-4e76-8ee9-ed46ad0e26c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:07.385132 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-ede6836a-dd06-4e76-8ee9-ed46ad0e26c3 None None] MFA Rules not processed for user `bcacf809f13043ab90716607160a70db`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:09:07.386988 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-ede6836a-dd06-4e76-8ee9-ed46ad0e26c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:07.396562 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1220/2481] 10.222.0.15 () {58 vars in 967 bytes} [Thu Aug 18 11:09:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:09:07.413056 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed9d97e-a122-43be-a037-365b39726ab4 service swift] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:07.424279 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed9d97e-a122-43be-a037-365b39726ab4 service swift] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:07.429580 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8d9b40-8ffc-4c8d-8086-098e3ef14acc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f97e906b1922419d8511ab1c8b9c86e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:07.430412 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d9b40-8ffc-4c8d-8086-098e3ef14acc service swift] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:07.430694 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d9b40-8ffc-4c8d-8086-098e3ef14acc service swift] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:07.430972 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d9b40-8ffc-4c8d-8086-098e3ef14acc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:07.440378 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8d9b40-8ffc-4c8d-8086-098e3ef14acc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:07.442002 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8d9b40-8ffc-4c8d-8086-098e3ef14acc service swift] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:07.450878 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1262/2482] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Aug 18 11:09:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 11:09:11.025433 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede6836a-dd06-4e76-8ee9-ed46ad0e26c3 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:11.035458 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede6836a-dd06-4e76-8ee9-ed46ad0e26c3 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:11.039331 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552dc465-54e4-42df-92dd-a95b24423ca9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:11.039873 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552dc465-54e4-42df-92dd-a95b24423ca9 service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:11.040144 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552dc465-54e4-42df-92dd-a95b24423ca9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:11.040415 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552dc465-54e4-42df-92dd-a95b24423ca9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:11.042283 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-552dc465-54e4-42df-92dd-a95b24423ca9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:11.056260 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552dc465-54e4-42df-92dd-a95b24423ca9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:11.057716 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552dc465-54e4-42df-92dd-a95b24423ca9 service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:11.068527 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1221/2483] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:09:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:09:14.415928 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8d9b40-8ffc-4c8d-8086-098e3ef14acc service swift] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:14.417554 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-ed8d9b40-8ffc-4c8d-8086-098e3ef14acc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:14.432142 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8d9b40-8ffc-4c8d-8086-098e3ef14acc service swift] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:14.437944 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da426011-5f83-43d8-893b-a8cc7efcd9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:14.438601 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da426011-5f83-43d8-893b-a8cc7efcd9ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:14.438872 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da426011-5f83-43d8-893b-a8cc7efcd9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:14.439148 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da426011-5f83-43d8-893b-a8cc7efcd9ec admin admin] PATH_INFO: `/v3/users/57e117589fc14e4d9d8d8494bddf9c12` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:14.440430 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da426011-5f83-43d8-893b-a8cc7efcd9ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=57e117589fc14e4d9d8d8494bddf9c12)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:14.442369 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da426011-5f83-43d8-893b-a8cc7efcd9ec admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:14.494269 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-da426011-5f83-43d8-893b-a8cc7efcd9ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57e117589fc14e4d9d8d8494bddf9c12'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:14.494915 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-da426011-5f83-43d8-893b-a8cc7efcd9ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57e117589fc14e4d9d8d8494bddf9c12'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:14.501989 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-da426011-5f83-43d8-893b-a8cc7efcd9ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57e117589fc14e4d9d8d8494bddf9c12'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:14.514080 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-da426011-5f83-43d8-893b-a8cc7efcd9ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57e117589fc14e4d9d8d8494bddf9c12'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:14.521452 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-da426011-5f83-43d8-893b-a8cc7efcd9ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57e117589fc14e4d9d8d8494bddf9c12'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:14.527623 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1263/2484] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:09:14 2022] DELETE /identity/v3/users/57e117589fc14e4d9d8d8494bddf9c12 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:09:14.704914 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552dc465-54e4-42df-92dd-a95b24423ca9 service neutron] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:14.716338 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552dc465-54e4-42df-92dd-a95b24423ca9 service neutron] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:14.788713 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194c85de-507a-4308-ad58-b3fdd4e8ec41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:14.790060 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c85de-507a-4308-ad58-b3fdd4e8ec41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:14.790323 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c85de-507a-4308-ad58-b3fdd4e8ec41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:14.790824 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c85de-507a-4308-ad58-b3fdd4e8ec41 admin admin] PATH_INFO: `/v3/projects/397eac573c2d473e881b07c87255700c` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:14.792131 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194c85de-507a-4308-ad58-b3fdd4e8ec41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=397eac573c2d473e881b07c87255700c)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:14.794084 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194c85de-507a-4308-ad58-b3fdd4e8ec41 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:14.849020 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-194c85de-507a-4308-ad58-b3fdd4e8ec41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '397eac573c2d473e881b07c87255700c', 'request_id': 'req-194c85de-507a-4308-ad58-b3fdd4e8ec41'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:14.857665 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-194c85de-507a-4308-ad58-b3fdd4e8ec41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '397eac573c2d473e881b07c87255700c', 'request_id': 'req-194c85de-507a-4308-ad58-b3fdd4e8ec41'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:14.864556 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-194c85de-507a-4308-ad58-b3fdd4e8ec41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '397eac573c2d473e881b07c87255700c', 'request_id': 'req-194c85de-507a-4308-ad58-b3fdd4e8ec41'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:14.879203 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-194c85de-507a-4308-ad58-b3fdd4e8ec41 admin admin] The token cache is being invalidate because project 397eac573c2d473e881b07c87255700c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:09:14.879950 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-194c85de-507a-4308-ad58-b3fdd4e8ec41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:14.880533 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-194c85de-507a-4308-ad58-b3fdd4e8ec41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:14.882469 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1222/2485] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:09:14 2022] DELETE /identity/v3/projects/397eac573c2d473e881b07c87255700c => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:09:14.888207 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2cb8e9-326b-48b0-992a-c7e872744ddb None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:14.889203 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2cb8e9-326b-48b0-992a-c7e872744ddb None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:14.889484 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2cb8e9-326b-48b0-992a-c7e872744ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:14.911822 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-fa2cb8e9-326b-48b0-992a-c7e872744ddb None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:09:14.913048 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-fa2cb8e9-326b-48b0-992a-c7e872744ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:14.979099 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1264/2486] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:09:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:09:14.986859 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66add9d9-064d-4269-a329-da37bb2eb138 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:14.987169 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66add9d9-064d-4269-a329-da37bb2eb138 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:14.987442 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66add9d9-064d-4269-a329-da37bb2eb138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:15.008366 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-66add9d9-064d-4269-a329-da37bb2eb138 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:09:15.009814 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-66add9d9-064d-4269-a329-da37bb2eb138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:15.019398 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1223/2487] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:09:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:09:15.023779 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2cb8e9-326b-48b0-992a-c7e872744ddb None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:15.036319 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2cb8e9-326b-48b0-992a-c7e872744ddb None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:15.040912 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0643e754-03ca-4dd4-b206-67cfe10180d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:15.041563 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0643e754-03ca-4dd4-b206-67cfe10180d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:15.041922 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0643e754-03ca-4dd4-b206-67cfe10180d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:15.042134 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0643e754-03ca-4dd4-b206-67cfe10180d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:15.042784 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0643e754-03ca-4dd4-b206-67cfe10180d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:09:15.043090 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0643e754-03ca-4dd4-b206-67cfe10180d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:15.045796 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0643e754-03ca-4dd4-b206-67cfe10180d9 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:15.060859 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1265/2488] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Aug 18 11:09:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:15.065669 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66add9d9-064d-4269-a329-da37bb2eb138 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:15.081848 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66add9d9-064d-4269-a329-da37bb2eb138 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:15.087516 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1cdac5-92db-47cb-8d5c-4e87bc3ed8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:15.088402 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1cdac5-92db-47cb-8d5c-4e87bc3ed8a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:15.088913 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1cdac5-92db-47cb-8d5c-4e87bc3ed8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:15.089201 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1cdac5-92db-47cb-8d5c-4e87bc3ed8a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:15.091336 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1cdac5-92db-47cb-8d5c-4e87bc3ed8a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:15.093016 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1cdac5-92db-47cb-8d5c-4e87bc3ed8a0 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:15.130868 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1224/2489] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:09:15 2022] POST /identity/v3/projects => generated 365 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 11:09:15.139593 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0643e754-03ca-4dd4-b206-67cfe10180d9 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:15.152902 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0643e754-03ca-4dd4-b206-67cfe10180d9 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:15.209625 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:15.227797 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020dd2f9-f406-498b-984d-c3a3fe99a8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:15.228409 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020dd2f9-f406-498b-984d-c3a3fe99a8e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:15.228695 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020dd2f9-f406-498b-984d-c3a3fe99a8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:15.228968 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020dd2f9-f406-498b-984d-c3a3fe99a8e0 admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:15.229662 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020dd2f9-f406-498b-984d-c3a3fe99a8e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:15.231628 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020dd2f9-f406-498b-984d-c3a3fe99a8e0 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:15.254658 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1266/2490] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:09:15 2022] POST /identity/v3/users => generated 283 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:09:15.258756 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1cdac5-92db-47cb-8d5c-4e87bc3ed8a0 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:15.269665 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1cdac5-92db-47cb-8d5c-4e87bc3ed8a0 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:15.274785 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f88bd4-76ed-4a77-a6f0-2cf8d95f018c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:15.275396 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f88bd4-76ed-4a77-a6f0-2cf8d95f018c admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:15.275698 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f88bd4-76ed-4a77-a6f0-2cf8d95f018c admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:15.275972 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f88bd4-76ed-4a77-a6f0-2cf8d95f018c admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:15.276621 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f88bd4-76ed-4a77-a6f0-2cf8d95f018c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:15.278353 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f88bd4-76ed-4a77-a6f0-2cf8d95f018c admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:15.288643 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1225/2491] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:09:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:09:15.292684 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020dd2f9-f406-498b-984d-c3a3fe99a8e0 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:15.303637 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020dd2f9-f406-498b-984d-c3a3fe99a8e0 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:15.308938 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5d3b00-fe89-47db-9350-f9ea4687e2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:15.309679 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d3b00-fe89-47db-9350-f9ea4687e2a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:15.309965 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d3b00-fe89-47db-9350-f9ea4687e2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:15.310879 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d3b00-fe89-47db-9350-f9ea4687e2a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:15.311639 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5d3b00-fe89-47db-9350-f9ea4687e2a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:15.313274 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5d3b00-fe89-47db-9350-f9ea4687e2a6 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:15.325356 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1267/2492] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:09:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:09:15.330472 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f88bd4-76ed-4a77-a6f0-2cf8d95f018c admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:15.340593 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f88bd4-76ed-4a77-a6f0-2cf8d95f018c admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:15.345946 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4166b7-21de-42ad-aaa4-1ff260b1f7f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:15.346613 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4166b7-21de-42ad-aaa4-1ff260b1f7f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:15.346894 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4166b7-21de-42ad-aaa4-1ff260b1f7f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:15.347210 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4166b7-21de-42ad-aaa4-1ff260b1f7f8 admin admin] PATH_INFO: `/v3/projects/8b2a64b909ec42a68957f15146333ea2/users/0f3aab0b34de4bf08efe8ef78e1779f6/roles/719e5c62188d4f8a838987d6e72ca8f7` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:15.364580 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4166b7-21de-42ad-aaa4-1ff260b1f7f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b2a64b909ec42a68957f15146333ea2, user_id=0f3aab0b34de4bf08efe8ef78e1779f6, role_id=719e5c62188d4f8a838987d6e72ca8f7)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:15.365998 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4166b7-21de-42ad-aaa4-1ff260b1f7f8 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:15.380035 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1226/2493] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:09:15 2022] PUT /identity/v3/projects/8b2a64b909ec42a68957f15146333ea2/users/0f3aab0b34de4bf08efe8ef78e1779f6/roles/719e5c62188d4f8a838987d6e72ca8f7 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:09:15.391579 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db78cfe6-7488-4b15-b8dc-7e099ddde73e None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:15.391807 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db78cfe6-7488-4b15-b8dc-7e099ddde73e None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:15.392086 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db78cfe6-7488-4b15-b8dc-7e099ddde73e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:15.421442 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-db78cfe6-7488-4b15-b8dc-7e099ddde73e None None] MFA Rules not processed for user `0f3aab0b34de4bf08efe8ef78e1779f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:09:15.422769 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-db78cfe6-7488-4b15-b8dc-7e099ddde73e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:15.514385 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1268/2494] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:09:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:09:15.525323 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4166b7-21de-42ad-aaa4-1ff260b1f7f8 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:15.527103 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-cf4166b7-21de-42ad-aaa4-1ff260b1f7f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:15.537616 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:15.588895 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4166b7-21de-42ad-aaa4-1ff260b1f7f8 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:15.592861 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3a6d1f-211d-41e5-84b2-f8b9fcd6bbea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b8a09704b9b4ab2bffb813796ec6e77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:15.593508 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a6d1f-211d-41e5-84b2-f8b9fcd6bbea service cinder] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:15.593835 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a6d1f-211d-41e5-84b2-f8b9fcd6bbea service cinder] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:15.594112 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a6d1f-211d-41e5-84b2-f8b9fcd6bbea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:15.603780 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3a6d1f-211d-41e5-84b2-f8b9fcd6bbea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:15.605259 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3a6d1f-211d-41e5-84b2-f8b9fcd6bbea service cinder] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:15.614839 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1227/2495] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:09:15 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:09:24.170105 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db78cfe6-7488-4b15-b8dc-7e099ddde73e None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:24.250676 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db78cfe6-7488-4b15-b8dc-7e099ddde73e None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:24.255215 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2972b82-1d1d-456f-a461-2f571e6924d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:24.255843 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2972b82-1d1d-456f-a461-2f571e6924d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:24.256125 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2972b82-1d1d-456f-a461-2f571e6924d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:24.256401 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2972b82-1d1d-456f-a461-2f571e6924d5 admin admin] PATH_INFO: `/v3/users/0f3aab0b34de4bf08efe8ef78e1779f6` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:24.257540 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2972b82-1d1d-456f-a461-2f571e6924d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f3aab0b34de4bf08efe8ef78e1779f6)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:24.259468 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2972b82-1d1d-456f-a461-2f571e6924d5 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:24.309044 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-e2972b82-1d1d-456f-a461-2f571e6924d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f3aab0b34de4bf08efe8ef78e1779f6'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:24.309655 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-e2972b82-1d1d-456f-a461-2f571e6924d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f3aab0b34de4bf08efe8ef78e1779f6'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:24.316541 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-e2972b82-1d1d-456f-a461-2f571e6924d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f3aab0b34de4bf08efe8ef78e1779f6'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:24.317705 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:24.330935 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-e2972b82-1d1d-456f-a461-2f571e6924d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f3aab0b34de4bf08efe8ef78e1779f6'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:24.338223 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-e2972b82-1d1d-456f-a461-2f571e6924d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f3aab0b34de4bf08efe8ef78e1779f6'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:24.345362 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1269/2496] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:09:24 2022] DELETE /identity/v3/users/0f3aab0b34de4bf08efe8ef78e1779f6 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:09:24.350051 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb496d6-5b42-41ca-b454-188134c65cdb None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:24.350491 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb496d6-5b42-41ca-b454-188134c65cdb None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:24.350604 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb496d6-5b42-41ca-b454-188134c65cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:24.371882 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-9fb496d6-5b42-41ca-b454-188134c65cdb None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:09:24.373196 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-9fb496d6-5b42-41ca-b454-188134c65cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:24.439385 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1228/2497] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:09:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:09:24.449368 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2972b82-1d1d-456f-a461-2f571e6924d5 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:24.451643 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-e2972b82-1d1d-456f-a461-2f571e6924d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:24.511317 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2972b82-1d1d-456f-a461-2f571e6924d5 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:24.515115 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5993dc17-5469-4cca-a177-dfe83b0bfdf3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:24.515870 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5993dc17-5469-4cca-a177-dfe83b0bfdf3 service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:24.516151 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5993dc17-5469-4cca-a177-dfe83b0bfdf3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:24.516410 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5993dc17-5469-4cca-a177-dfe83b0bfdf3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:24.525472 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5993dc17-5469-4cca-a177-dfe83b0bfdf3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:24.526914 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5993dc17-5469-4cca-a177-dfe83b0bfdf3 service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:24.538028 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1270/2498] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:09:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:09:24.826745 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb496d6-5b42-41ca-b454-188134c65cdb None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:24.828196 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-9fb496d6-5b42-41ca-b454-188134c65cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:24.840542 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb496d6-5b42-41ca-b454-188134c65cdb None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:24.846373 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b831c50-a02b-490d-a167-a56eeaea70cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:24.847042 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b831c50-a02b-490d-a167-a56eeaea70cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:24.847319 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b831c50-a02b-490d-a167-a56eeaea70cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:24.847591 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b831c50-a02b-490d-a167-a56eeaea70cb admin admin] PATH_INFO: `/v3/projects/8b2a64b909ec42a68957f15146333ea2` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:24.848726 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b831c50-a02b-490d-a167-a56eeaea70cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b2a64b909ec42a68957f15146333ea2)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:24.850677 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b831c50-a02b-490d-a167-a56eeaea70cb admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:24.898799 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-3b831c50-a02b-490d-a167-a56eeaea70cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b2a64b909ec42a68957f15146333ea2', 'request_id': 'req-3b831c50-a02b-490d-a167-a56eeaea70cb'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:24.909776 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-3b831c50-a02b-490d-a167-a56eeaea70cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b2a64b909ec42a68957f15146333ea2', 'request_id': 'req-3b831c50-a02b-490d-a167-a56eeaea70cb'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:24.916460 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-3b831c50-a02b-490d-a167-a56eeaea70cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b2a64b909ec42a68957f15146333ea2', 'request_id': 'req-3b831c50-a02b-490d-a167-a56eeaea70cb'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:24.927448 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-3b831c50-a02b-490d-a167-a56eeaea70cb admin admin] The token cache is being invalidate because project 8b2a64b909ec42a68957f15146333ea2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:09:24.927741 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-3b831c50-a02b-490d-a167-a56eeaea70cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:24.928390 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-3b831c50-a02b-490d-a167-a56eeaea70cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:24.929918 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1229/2499] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:09:24 2022] DELETE /identity/v3/projects/8b2a64b909ec42a68957f15146333ea2 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:09:24.934816 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dae0b6-7159-4b7f-b6d5-187e162a6d27 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:24.935768 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dae0b6-7159-4b7f-b6d5-187e162a6d27 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:24.936570 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dae0b6-7159-4b7f-b6d5-187e162a6d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:24.956747 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-15dae0b6-7159-4b7f-b6d5-187e162a6d27 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:09:24.957994 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-15dae0b6-7159-4b7f-b6d5-187e162a6d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:25.017639 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1271/2500] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:09:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:09:25.027011 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb5b13-517e-47a0-888e-f3343f183fab None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:25.027297 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb5b13-517e-47a0-888e-f3343f183fab None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:25.027580 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb5b13-517e-47a0-888e-f3343f183fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:25.047910 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-fbeb5b13-517e-47a0-888e-f3343f183fab None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:09:25.049148 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-fbeb5b13-517e-47a0-888e-f3343f183fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:25.057100 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1230/2501] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:09:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:09:25.062320 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dae0b6-7159-4b7f-b6d5-187e162a6d27 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:25.071984 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dae0b6-7159-4b7f-b6d5-187e162a6d27 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:25.077484 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c064523-bdf7-486e-a582-7d7865050358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:25.078109 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c064523-bdf7-486e-a582-7d7865050358 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:25.078385 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c064523-bdf7-486e-a582-7d7865050358 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:25.078653 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c064523-bdf7-486e-a582-7d7865050358 admin admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:25.079319 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c064523-bdf7-486e-a582-7d7865050358 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:09:25.079643 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c064523-bdf7-486e-a582-7d7865050358 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:25.081235 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c064523-bdf7-486e-a582-7d7865050358 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:25.092755 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1272/2502] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Aug 18 11:09:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:25.097154 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeb5b13-517e-47a0-888e-f3343f183fab None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:25.106549 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeb5b13-517e-47a0-888e-f3343f183fab None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:25.111827 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be35f726-ad28-42c5-8361-efb0638ff033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:25.112437 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be35f726-ad28-42c5-8361-efb0638ff033 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:25.112714 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be35f726-ad28-42c5-8361-efb0638ff033 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:25.113021 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be35f726-ad28-42c5-8361-efb0638ff033 admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:25.113696 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be35f726-ad28-42c5-8361-efb0638ff033 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:25.115620 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be35f726-ad28-42c5-8361-efb0638ff033 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:25.145244 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1231/2503] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:09:25 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:09:25.149486 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c064523-bdf7-486e-a582-7d7865050358 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:25.159779 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c064523-bdf7-486e-a582-7d7865050358 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:25.217828 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68110128-d714-4df6-a442-7617bf572272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:25.218479 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68110128-d714-4df6-a442-7617bf572272 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:25.218770 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68110128-d714-4df6-a442-7617bf572272 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:25.219051 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68110128-d714-4df6-a442-7617bf572272 admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:25.219683 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68110128-d714-4df6-a442-7617bf572272 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:25.221702 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68110128-d714-4df6-a442-7617bf572272 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:25.232165 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:25.250180 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1273/2504] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:09:25 2022] POST /identity/v3/users => generated 291 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:09:25.251400 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be35f726-ad28-42c5-8361-efb0638ff033 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:25.258310 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:25.262284 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be35f726-ad28-42c5-8361-efb0638ff033 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:25.269218 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeed74c2-92e6-4927-8e1c-fcf5b1b91c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:25.269886 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed74c2-92e6-4927-8e1c-fcf5b1b91c80 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:25.270410 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed74c2-92e6-4927-8e1c-fcf5b1b91c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:25.270841 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed74c2-92e6-4927-8e1c-fcf5b1b91c80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:25.271673 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeed74c2-92e6-4927-8e1c-fcf5b1b91c80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:25.273303 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeed74c2-92e6-4927-8e1c-fcf5b1b91c80 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:25.285553 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1232/2505] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:09:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:09:25.288924 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68110128-d714-4df6-a442-7617bf572272 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:25.300036 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68110128-d714-4df6-a442-7617bf572272 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:25.304818 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c49780-4b30-4b44-aa77-c164e1f4b034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:25.305415 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c49780-4b30-4b44-aa77-c164e1f4b034 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:25.305722 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c49780-4b30-4b44-aa77-c164e1f4b034 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:25.305995 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c49780-4b30-4b44-aa77-c164e1f4b034 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:25.306637 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c49780-4b30-4b44-aa77-c164e1f4b034 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:25.308220 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c49780-4b30-4b44-aa77-c164e1f4b034 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:25.320315 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1274/2506] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:09:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:09:25.324419 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeed74c2-92e6-4927-8e1c-fcf5b1b91c80 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:25.335705 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeed74c2-92e6-4927-8e1c-fcf5b1b91c80 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:25.340488 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4702eee9-9e8f-4a41-ad3a-50d0f6453696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:25.341182 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702eee9-9e8f-4a41-ad3a-50d0f6453696 admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:25.341492 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702eee9-9e8f-4a41-ad3a-50d0f6453696 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:25.342016 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702eee9-9e8f-4a41-ad3a-50d0f6453696 admin admin] PATH_INFO: `/v3/projects/7272cefdf0e041749c6f137e9569d2cd/users/73ba0c8a7b6b4ea5acecaa45d6df22f1/roles/719e5c62188d4f8a838987d6e72ca8f7` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:25.358712 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4702eee9-9e8f-4a41-ad3a-50d0f6453696 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7272cefdf0e041749c6f137e9569d2cd, user_id=73ba0c8a7b6b4ea5acecaa45d6df22f1, role_id=719e5c62188d4f8a838987d6e72ca8f7)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:25.362119 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4702eee9-9e8f-4a41-ad3a-50d0f6453696 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:25.379367 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1233/2507] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:09:25 2022] PUT /identity/v3/projects/7272cefdf0e041749c6f137e9569d2cd/users/73ba0c8a7b6b4ea5acecaa45d6df22f1/roles/719e5c62188d4f8a838987d6e72ca8f7 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:09:25.388396 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd7ff26-6b91-40d3-9053-282ff8fd03e8 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:25.388644 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd7ff26-6b91-40d3-9053-282ff8fd03e8 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:25.389001 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd7ff26-6b91-40d3-9053-282ff8fd03e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:25.416686 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-fdd7ff26-6b91-40d3-9053-282ff8fd03e8 None None] MFA Rules not processed for user `73ba0c8a7b6b4ea5acecaa45d6df22f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:09:25.417835 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-fdd7ff26-6b91-40d3-9053-282ff8fd03e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:25.484024 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1275/2508] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:09:25 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:09:25.488517 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4702eee9-9e8f-4a41-ad3a-50d0f6453696 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:25.552824 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4702eee9-9e8f-4a41-ad3a-50d0f6453696 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:25.557464 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87daca08-284f-4207-a2b9-ea5e048b68e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:25.558096 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87daca08-284f-4207-a2b9-ea5e048b68e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:25.558381 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87daca08-284f-4207-a2b9-ea5e048b68e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:25.558655 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87daca08-284f-4207-a2b9-ea5e048b68e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:25.559302 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87daca08-284f-4207-a2b9-ea5e048b68e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:25.564062 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87daca08-284f-4207-a2b9-ea5e048b68e7 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:25.591181 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1234/2509] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:09:25 2022] POST /identity/v3/projects => generated 381 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:09:25.595566 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd7ff26-6b91-40d3-9053-282ff8fd03e8 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:25.606506 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd7ff26-6b91-40d3-9053-282ff8fd03e8 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:25.663347 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbc29a4-bcf9-4825-adca-51b293e16491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:25.663952 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc29a4-bcf9-4825-adca-51b293e16491 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:25.664234 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc29a4-bcf9-4825-adca-51b293e16491 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:25.664510 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc29a4-bcf9-4825-adca-51b293e16491 admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:25.665150 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbc29a4-bcf9-4825-adca-51b293e16491 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:25.667212 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbc29a4-bcf9-4825-adca-51b293e16491 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:25.690231 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1276/2510] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:09:25 2022] POST /identity/v3/users => generated 297 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:09:25.694233 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87daca08-284f-4207-a2b9-ea5e048b68e7 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:25.704663 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87daca08-284f-4207-a2b9-ea5e048b68e7 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:25.709247 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e694baeb-3945-42c5-b6aa-d3c57f1cbe58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:25.709872 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e694baeb-3945-42c5-b6aa-d3c57f1cbe58 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:25.710152 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e694baeb-3945-42c5-b6aa-d3c57f1cbe58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:25.710423 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e694baeb-3945-42c5-b6aa-d3c57f1cbe58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:25.711058 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e694baeb-3945-42c5-b6aa-d3c57f1cbe58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:25.712709 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e694baeb-3945-42c5-b6aa-d3c57f1cbe58 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:25.723894 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1235/2511] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:09:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:09:25.728261 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbc29a4-bcf9-4825-adca-51b293e16491 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:25.738940 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbc29a4-bcf9-4825-adca-51b293e16491 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:25.743604 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18afbf31-1bd4-4e94-8caf-164bae0299e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:25.744240 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18afbf31-1bd4-4e94-8caf-164bae0299e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:25.744518 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18afbf31-1bd4-4e94-8caf-164bae0299e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:25.744791 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18afbf31-1bd4-4e94-8caf-164bae0299e0 admin admin] PATH_INFO: `/v3/projects/4d48335dbda54244bd63c22dfc94544a/users/2d9e66ecac9241f096eb2d4313da14a0/roles/127fdc7ef05b4e0b98a940b334e5fcab` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:25.759328 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18afbf31-1bd4-4e94-8caf-164bae0299e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d48335dbda54244bd63c22dfc94544a, user_id=2d9e66ecac9241f096eb2d4313da14a0, role_id=127fdc7ef05b4e0b98a940b334e5fcab)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:25.762004 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18afbf31-1bd4-4e94-8caf-164bae0299e0 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:25.774922 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1277/2512] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:09:25 2022] PUT /identity/v3/projects/4d48335dbda54244bd63c22dfc94544a/users/2d9e66ecac9241f096eb2d4313da14a0/roles/127fdc7ef05b4e0b98a940b334e5fcab => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:09:25.779525 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e694baeb-3945-42c5-b6aa-d3c57f1cbe58 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:25.790174 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e694baeb-3945-42c5-b6aa-d3c57f1cbe58 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:25.855053 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f090757-7e5e-4cd0-b78a-0a0a9fb28a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:25.855662 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f090757-7e5e-4cd0-b78a-0a0a9fb28a78 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:25.855945 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f090757-7e5e-4cd0-b78a-0a0a9fb28a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:25.856244 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f090757-7e5e-4cd0-b78a-0a0a9fb28a78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:25.857602 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f090757-7e5e-4cd0-b78a-0a0a9fb28a78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:25.859381 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f090757-7e5e-4cd0-b78a-0a0a9fb28a78 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:25.869797 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1236/2513] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:09:25 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:09:25.874981 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18afbf31-1bd4-4e94-8caf-164bae0299e0 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:25.885979 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18afbf31-1bd4-4e94-8caf-164bae0299e0 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:25.891046 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3ef2eb-aebd-4b93-8b21-b5de7f7dfd91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:25.891712 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ef2eb-aebd-4b93-8b21-b5de7f7dfd91 admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:25.892021 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ef2eb-aebd-4b93-8b21-b5de7f7dfd91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:25.892244 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ef2eb-aebd-4b93-8b21-b5de7f7dfd91 admin admin] PATH_INFO: `/v3/projects/4d48335dbda54244bd63c22dfc94544a/users/2d9e66ecac9241f096eb2d4313da14a0/roles/127fdc7ef05b4e0b98a940b334e5fcab` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:25.894209 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3ef2eb-aebd-4b93-8b21-b5de7f7dfd91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d48335dbda54244bd63c22dfc94544a, user_id=2d9e66ecac9241f096eb2d4313da14a0, role_id=127fdc7ef05b4e0b98a940b334e5fcab)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:25.896903 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3ef2eb-aebd-4b93-8b21-b5de7f7dfd91 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:25.911489 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1278/2514] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:09:25 2022] PUT /identity/v3/projects/4d48335dbda54244bd63c22dfc94544a/users/2d9e66ecac9241f096eb2d4313da14a0/roles/127fdc7ef05b4e0b98a940b334e5fcab => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:09:25.922688 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c375601a-a790-4e6c-abe4-0e76c5e3bcee None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:25.922906 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c375601a-a790-4e6c-abe4-0e76c5e3bcee None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:25.923183 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c375601a-a790-4e6c-abe4-0e76c5e3bcee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:25.950899 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-c375601a-a790-4e6c-abe4-0e76c5e3bcee None None] MFA Rules not processed for user `2d9e66ecac9241f096eb2d4313da14a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:09:25.952216 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-c375601a-a790-4e6c-abe4-0e76c5e3bcee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:25.981620 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:26.022963 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1237/2515] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:09:25 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:09:26.035960 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3ef2eb-aebd-4b93-8b21-b5de7f7dfd91 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:26.037810 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-cc3ef2eb-aebd-4b93-8b21-b5de7f7dfd91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:26.068225 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:26.099502 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3ef2eb-aebd-4b93-8b21-b5de7f7dfd91 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:26.103279 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9943ed59-573e-4052-9522-6ecc268fd501 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b8a09704b9b4ab2bffb813796ec6e77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:26.103874 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9943ed59-573e-4052-9522-6ecc268fd501 service cinder] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:26.104155 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9943ed59-573e-4052-9522-6ecc268fd501 service cinder] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:26.104424 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9943ed59-573e-4052-9522-6ecc268fd501 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:26.113874 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9943ed59-573e-4052-9522-6ecc268fd501 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:26.115300 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9943ed59-573e-4052-9522-6ecc268fd501 service cinder] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:26.125087 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1279/2516] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:09:26 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:09:26.219660 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c375601a-a790-4e6c-abe4-0e76c5e3bcee None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:26.231247 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c375601a-a790-4e6c-abe4-0e76c5e3bcee None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:26.235106 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ef7285-65ee-4893-afb2-6b60b75f4125 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b8a09704b9b4ab2bffb813796ec6e77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:26.235755 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ef7285-65ee-4893-afb2-6b60b75f4125 service cinder] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:26.236086 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ef7285-65ee-4893-afb2-6b60b75f4125 service cinder] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:26.236367 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ef7285-65ee-4893-afb2-6b60b75f4125 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:26.295187 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ef7285-65ee-4893-afb2-6b60b75f4125 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:26.296739 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ef7285-65ee-4893-afb2-6b60b75f4125 service cinder] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:26.305615 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1238/2517] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:09:26 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:09:35.199655 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9943ed59-573e-4052-9522-6ecc268fd501 service cinder] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:35.268168 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9943ed59-573e-4052-9522-6ecc268fd501 service cinder] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:35.272765 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7638df9d-df97-4ed2-a1fa-6632a8e7b20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:35.273382 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7638df9d-df97-4ed2-a1fa-6632a8e7b20e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:35.273682 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7638df9d-df97-4ed2-a1fa-6632a8e7b20e admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:35.273944 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7638df9d-df97-4ed2-a1fa-6632a8e7b20e admin admin] PATH_INFO: `/v3/users/73ba0c8a7b6b4ea5acecaa45d6df22f1` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:35.275092 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7638df9d-df97-4ed2-a1fa-6632a8e7b20e admin admin] RBAC: Authorizing `identity:delete_user(user_id=73ba0c8a7b6b4ea5acecaa45d6df22f1)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:35.276987 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7638df9d-df97-4ed2-a1fa-6632a8e7b20e admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:35.322700 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-7638df9d-df97-4ed2-a1fa-6632a8e7b20e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73ba0c8a7b6b4ea5acecaa45d6df22f1'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:35.323279 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-7638df9d-df97-4ed2-a1fa-6632a8e7b20e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73ba0c8a7b6b4ea5acecaa45d6df22f1'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:35.331188 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-7638df9d-df97-4ed2-a1fa-6632a8e7b20e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73ba0c8a7b6b4ea5acecaa45d6df22f1'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:35.343882 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-7638df9d-df97-4ed2-a1fa-6632a8e7b20e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73ba0c8a7b6b4ea5acecaa45d6df22f1'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:35.365254 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-7638df9d-df97-4ed2-a1fa-6632a8e7b20e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73ba0c8a7b6b4ea5acecaa45d6df22f1'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:35.372352 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1280/2518] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:09:35 2022] DELETE /identity/v3/users/73ba0c8a7b6b4ea5acecaa45d6df22f1 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:09:35.377200 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d57dd4-39c1-46ae-addb-b4120fba01a0 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:35.377832 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d57dd4-39c1-46ae-addb-b4120fba01a0 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:35.377832 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d57dd4-39c1-46ae-addb-b4120fba01a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:35.398440 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-66d57dd4-39c1-46ae-addb-b4120fba01a0 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:09:35.399733 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-66d57dd4-39c1-46ae-addb-b4120fba01a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:35.459727 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1239/2519] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:09:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:09:35.469396 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7638df9d-df97-4ed2-a1fa-6632a8e7b20e admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:35.470834 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-7638df9d-df97-4ed2-a1fa-6632a8e7b20e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:35.525084 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:35.532998 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7638df9d-df97-4ed2-a1fa-6632a8e7b20e admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:35.537235 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0561f996-3c7e-460a-a0ea-5206691b96c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:35.537887 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0561f996-3c7e-460a-a0ea-5206691b96c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:35.538161 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0561f996-3c7e-460a-a0ea-5206691b96c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:35.538433 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0561f996-3c7e-460a-a0ea-5206691b96c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:35.549490 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0561f996-3c7e-460a-a0ea-5206691b96c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:35.550969 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0561f996-3c7e-460a-a0ea-5206691b96c3 service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:35.561582 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1281/2520] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:09:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 11:09:35.846837 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d57dd4-39c1-46ae-addb-b4120fba01a0 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:35.848883 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-66d57dd4-39c1-46ae-addb-b4120fba01a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:35.861860 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d57dd4-39c1-46ae-addb-b4120fba01a0 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:35.866614 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa56647a-366e-4742-962e-398c39ee8337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:35.867257 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa56647a-366e-4742-962e-398c39ee8337 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:35.867535 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa56647a-366e-4742-962e-398c39ee8337 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:35.867806 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa56647a-366e-4742-962e-398c39ee8337 admin admin] PATH_INFO: `/v3/projects/7272cefdf0e041749c6f137e9569d2cd` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:35.869549 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa56647a-366e-4742-962e-398c39ee8337 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7272cefdf0e041749c6f137e9569d2cd)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:35.871178 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa56647a-366e-4742-962e-398c39ee8337 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:35.931578 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-aa56647a-366e-4742-962e-398c39ee8337 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7272cefdf0e041749c6f137e9569d2cd', 'request_id': 'req-aa56647a-366e-4742-962e-398c39ee8337'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:35.939807 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-aa56647a-366e-4742-962e-398c39ee8337 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7272cefdf0e041749c6f137e9569d2cd', 'request_id': 'req-aa56647a-366e-4742-962e-398c39ee8337'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:35.941981 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:35.947214 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-aa56647a-366e-4742-962e-398c39ee8337 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7272cefdf0e041749c6f137e9569d2cd', 'request_id': 'req-aa56647a-366e-4742-962e-398c39ee8337'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:35.962645 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-aa56647a-366e-4742-962e-398c39ee8337 admin admin] The token cache is being invalidate because project 7272cefdf0e041749c6f137e9569d2cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:09:35.962935 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-aa56647a-366e-4742-962e-398c39ee8337 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:35.963588 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-aa56647a-366e-4742-962e-398c39ee8337 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:35.965076 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1240/2521] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:09:35 2022] DELETE /identity/v3/projects/7272cefdf0e041749c6f137e9569d2cd => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:09:35.970312 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0561f996-3c7e-460a-a0ea-5206691b96c3 service neutron] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:35.980203 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0561f996-3c7e-460a-a0ea-5206691b96c3 service neutron] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:36.042438 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd7910b-c123-472f-9d1a-f0cb4a41c83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:36.043074 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd7910b-c123-472f-9d1a-f0cb4a41c83a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:36.043357 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd7910b-c123-472f-9d1a-f0cb4a41c83a admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:36.043632 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd7910b-c123-472f-9d1a-f0cb4a41c83a admin admin] PATH_INFO: `/v3/users/2d9e66ecac9241f096eb2d4313da14a0` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:36.045226 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd7910b-c123-472f-9d1a-f0cb4a41c83a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d9e66ecac9241f096eb2d4313da14a0)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:36.047276 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd7910b-c123-472f-9d1a-f0cb4a41c83a admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:36.095666 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-ecd7910b-c123-472f-9d1a-f0cb4a41c83a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d9e66ecac9241f096eb2d4313da14a0'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:36.096322 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-ecd7910b-c123-472f-9d1a-f0cb4a41c83a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d9e66ecac9241f096eb2d4313da14a0'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:36.103626 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-ecd7910b-c123-472f-9d1a-f0cb4a41c83a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d9e66ecac9241f096eb2d4313da14a0'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:36.115786 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-ecd7910b-c123-472f-9d1a-f0cb4a41c83a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d9e66ecac9241f096eb2d4313da14a0'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:36.124458 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-ecd7910b-c123-472f-9d1a-f0cb4a41c83a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d9e66ecac9241f096eb2d4313da14a0'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:36.131048 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1282/2522] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:09:35 2022] DELETE /identity/v3/users/2d9e66ecac9241f096eb2d4313da14a0 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:09:36.416963 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa56647a-366e-4742-962e-398c39ee8337 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:36.417813 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-aa56647a-366e-4742-962e-398c39ee8337 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:36.431622 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa56647a-366e-4742-962e-398c39ee8337 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:36.492438 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db04255-0c40-481c-86fb-4eaad44f3d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:36.493081 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db04255-0c40-481c-86fb-4eaad44f3d66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:36.493382 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db04255-0c40-481c-86fb-4eaad44f3d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:36.493710 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db04255-0c40-481c-86fb-4eaad44f3d66 admin admin] PATH_INFO: `/v3/projects/4d48335dbda54244bd63c22dfc94544a` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:36.494806 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db04255-0c40-481c-86fb-4eaad44f3d66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d48335dbda54244bd63c22dfc94544a)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:36.496729 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db04255-0c40-481c-86fb-4eaad44f3d66 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:36.544916 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-3db04255-0c40-481c-86fb-4eaad44f3d66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d48335dbda54244bd63c22dfc94544a', 'request_id': 'req-3db04255-0c40-481c-86fb-4eaad44f3d66'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:36.552900 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-3db04255-0c40-481c-86fb-4eaad44f3d66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d48335dbda54244bd63c22dfc94544a', 'request_id': 'req-3db04255-0c40-481c-86fb-4eaad44f3d66'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:36.559728 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-3db04255-0c40-481c-86fb-4eaad44f3d66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d48335dbda54244bd63c22dfc94544a', 'request_id': 'req-3db04255-0c40-481c-86fb-4eaad44f3d66'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:36.571244 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-3db04255-0c40-481c-86fb-4eaad44f3d66 admin admin] The token cache is being invalidate because project 4d48335dbda54244bd63c22dfc94544a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:09:36.571536 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-3db04255-0c40-481c-86fb-4eaad44f3d66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:36.572171 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-3db04255-0c40-481c-86fb-4eaad44f3d66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:36.573680 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1241/2523] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:09:36 2022] DELETE /identity/v3/projects/4d48335dbda54244bd63c22dfc94544a => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:09:36.578928 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84755d88-e64e-4a87-9c71-2e23745d51bd None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:36.579395 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84755d88-e64e-4a87-9c71-2e23745d51bd None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:36.579529 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84755d88-e64e-4a87-9c71-2e23745d51bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:36.598914 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-84755d88-e64e-4a87-9c71-2e23745d51bd None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:09:36.600160 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-84755d88-e64e-4a87-9c71-2e23745d51bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:36.662737 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1283/2524] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:09:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:09:36.671296 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a8f878-d0eb-4793-8cb5-647dc7c95885 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:36.671576 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a8f878-d0eb-4793-8cb5-647dc7c95885 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:36.671850 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a8f878-d0eb-4793-8cb5-647dc7c95885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:36.693727 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-46a8f878-d0eb-4793-8cb5-647dc7c95885 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:09:36.695006 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-46a8f878-d0eb-4793-8cb5-647dc7c95885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:36.707744 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1242/2525] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:09:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:09:36.712119 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84755d88-e64e-4a87-9c71-2e23745d51bd None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:36.722450 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84755d88-e64e-4a87-9c71-2e23745d51bd None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:36.729741 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2c5c82-6007-418a-a3d4-2121bf6110e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:36.730444 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c5c82-6007-418a-a3d4-2121bf6110e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:36.730751 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c5c82-6007-418a-a3d4-2121bf6110e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:36.731033 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c5c82-6007-418a-a3d4-2121bf6110e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:36.732203 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2c5c82-6007-418a-a3d4-2121bf6110e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:09:36.732561 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2c5c82-6007-418a-a3d4-2121bf6110e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:36.734260 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2c5c82-6007-418a-a3d4-2121bf6110e5 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:36.736745 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:36.748714 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1284/2526] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Aug 18 11:09:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:36.753170 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a8f878-d0eb-4793-8cb5-647dc7c95885 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:36.762665 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a8f878-d0eb-4793-8cb5-647dc7c95885 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:36.767459 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aae2250-a2f9-4ce1-9819-ff580619ae14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:36.768049 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae2250-a2f9-4ce1-9819-ff580619ae14 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:36.768327 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae2250-a2f9-4ce1-9819-ff580619ae14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:36.768594 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae2250-a2f9-4ce1-9819-ff580619ae14 admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:36.769213 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aae2250-a2f9-4ce1-9819-ff580619ae14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:36.771250 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aae2250-a2f9-4ce1-9819-ff580619ae14 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:36.798987 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1243/2527] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:09:36 2022] POST /identity/v3/projects => generated 387 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:09:36.803237 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2c5c82-6007-418a-a3d4-2121bf6110e5 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:36.814140 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2c5c82-6007-418a-a3d4-2121bf6110e5 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:36.870816 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b8dc24-76b2-4ea7-9a83-6f97e743d98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:36.871424 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b8dc24-76b2-4ea7-9a83-6f97e743d98e admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:36.871703 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b8dc24-76b2-4ea7-9a83-6f97e743d98e admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:36.871980 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b8dc24-76b2-4ea7-9a83-6f97e743d98e admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:36.873228 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b8dc24-76b2-4ea7-9a83-6f97e743d98e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:36.875167 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b8dc24-76b2-4ea7-9a83-6f97e743d98e admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:36.896337 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1285/2528] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:09:36 2022] POST /identity/v3/users => generated 294 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:09:36.900708 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aae2250-a2f9-4ce1-9819-ff580619ae14 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:36.912033 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aae2250-a2f9-4ce1-9819-ff580619ae14 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:36.916758 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcd20b4-0d54-451d-a0d4-a48dc6ab6f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:36.917299 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd20b4-0d54-451d-a0d4-a48dc6ab6f5c admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:36.917616 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd20b4-0d54-451d-a0d4-a48dc6ab6f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:36.917889 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd20b4-0d54-451d-a0d4-a48dc6ab6f5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:36.918532 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcd20b4-0d54-451d-a0d4-a48dc6ab6f5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:36.920937 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcd20b4-0d54-451d-a0d4-a48dc6ab6f5c admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:36.931071 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1244/2529] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:09:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:09:36.935787 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b8dc24-76b2-4ea7-9a83-6f97e743d98e admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:36.946141 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b8dc24-76b2-4ea7-9a83-6f97e743d98e admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:36.951068 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69749a2a-dd20-4b5a-b1e0-ffb924751424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:36.951665 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69749a2a-dd20-4b5a-b1e0-ffb924751424 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:36.951967 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69749a2a-dd20-4b5a-b1e0-ffb924751424 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:36.952269 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69749a2a-dd20-4b5a-b1e0-ffb924751424 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:36.952982 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69749a2a-dd20-4b5a-b1e0-ffb924751424 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:36.954673 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69749a2a-dd20-4b5a-b1e0-ffb924751424 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:36.965891 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1286/2530] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:09:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:09:36.970612 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcd20b4-0d54-451d-a0d4-a48dc6ab6f5c admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:36.981064 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcd20b4-0d54-451d-a0d4-a48dc6ab6f5c admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:36.986380 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36a68d4-83ae-404e-bf07-3048decbae52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:36.987022 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a68d4-83ae-404e-bf07-3048decbae52 admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:36.987309 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a68d4-83ae-404e-bf07-3048decbae52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:36.987576 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a68d4-83ae-404e-bf07-3048decbae52 admin admin] PATH_INFO: `/v3/projects/cf9deae6302840d39ecdfd56b8ac0203/users/1086252b593d4603821e430f25cacb39/roles/719e5c62188d4f8a838987d6e72ca8f7` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:37.002290 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36a68d4-83ae-404e-bf07-3048decbae52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf9deae6302840d39ecdfd56b8ac0203, user_id=1086252b593d4603821e430f25cacb39, role_id=719e5c62188d4f8a838987d6e72ca8f7)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:37.004947 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36a68d4-83ae-404e-bf07-3048decbae52 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:37.019833 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1245/2531] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:09:36 2022] PUT /identity/v3/projects/cf9deae6302840d39ecdfd56b8ac0203/users/1086252b593d4603821e430f25cacb39/roles/719e5c62188d4f8a838987d6e72ca8f7 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:09:37.032176 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3cfdc0-9753-41fc-a09c-f6f689a000d0 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:37.032465 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3cfdc0-9753-41fc-a09c-f6f689a000d0 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:37.032743 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3cfdc0-9753-41fc-a09c-f6f689a000d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:37.065175 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-5f3cfdc0-9753-41fc-a09c-f6f689a000d0 None None] MFA Rules not processed for user `1086252b593d4603821e430f25cacb39`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:09:37.066562 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-5f3cfdc0-9753-41fc-a09c-f6f689a000d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:37.150499 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1287/2532] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:09:37 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:09:37.150915 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36a68d4-83ae-404e-bf07-3048decbae52 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:37.168682 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:37.233667 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36a68d4-83ae-404e-bf07-3048decbae52 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:37.238626 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a02ce3f-ff3f-478b-b718-9c92add711d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:37.239244 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a02ce3f-ff3f-478b-b718-9c92add711d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:37.239528 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a02ce3f-ff3f-478b-b718-9c92add711d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:37.239803 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a02ce3f-ff3f-478b-b718-9c92add711d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:37.240579 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a02ce3f-ff3f-478b-b718-9c92add711d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:37.242547 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a02ce3f-ff3f-478b-b718-9c92add711d8 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:37.274038 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1246/2533] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:09:37 2022] POST /identity/v3/projects => generated 385 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:09:37.276090 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3cfdc0-9753-41fc-a09c-f6f689a000d0 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:37.289677 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3cfdc0-9753-41fc-a09c-f6f689a000d0 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:37.350627 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361a86bf-8f2b-4885-9787-0463a119fb81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:37.351239 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a86bf-8f2b-4885-9787-0463a119fb81 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:37.351523 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a86bf-8f2b-4885-9787-0463a119fb81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:37.351904 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a86bf-8f2b-4885-9787-0463a119fb81 admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:37.352492 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361a86bf-8f2b-4885-9787-0463a119fb81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:37.354555 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361a86bf-8f2b-4885-9787-0463a119fb81 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:37.365559 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:37.378830 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1288/2534] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:09:37 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:09:37.382835 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a02ce3f-ff3f-478b-b718-9c92add711d8 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:37.394711 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a02ce3f-ff3f-478b-b718-9c92add711d8 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:37.401809 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2b19bb-59fd-4f4c-a966-9f43de94c9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:37.402461 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2b19bb-59fd-4f4c-a966-9f43de94c9ff admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:37.402702 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2b19bb-59fd-4f4c-a966-9f43de94c9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:37.402966 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2b19bb-59fd-4f4c-a966-9f43de94c9ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:37.404280 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2b19bb-59fd-4f4c-a966-9f43de94c9ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:37.406010 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2b19bb-59fd-4f4c-a966-9f43de94c9ff admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:37.417286 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1247/2535] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:09:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:09:37.422626 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361a86bf-8f2b-4885-9787-0463a119fb81 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:37.433442 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361a86bf-8f2b-4885-9787-0463a119fb81 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:37.439089 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9a51e8-4bdb-428b-b19c-230539cb2bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:37.439904 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9a51e8-4bdb-428b-b19c-230539cb2bce admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:37.440402 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9a51e8-4bdb-428b-b19c-230539cb2bce admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:37.440754 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9a51e8-4bdb-428b-b19c-230539cb2bce admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:37.441482 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9a51e8-4bdb-428b-b19c-230539cb2bce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:37.443176 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9a51e8-4bdb-428b-b19c-230539cb2bce admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:37.454435 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1289/2536] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:09:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:09:37.458722 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2b19bb-59fd-4f4c-a966-9f43de94c9ff admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:37.470093 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2b19bb-59fd-4f4c-a966-9f43de94c9ff admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:37.474860 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f83e80b-4cdc-495b-98f6-0bfe22819dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:37.475510 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f83e80b-4cdc-495b-98f6-0bfe22819dbf admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:37.475791 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f83e80b-4cdc-495b-98f6-0bfe22819dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:37.476071 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f83e80b-4cdc-495b-98f6-0bfe22819dbf admin admin] PATH_INFO: `/v3/projects/7a272efe288241a4a0193a507e6c648e/users/575072e4aaca4300ba0bb45b35797061/roles/719e5c62188d4f8a838987d6e72ca8f7` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:37.491973 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f83e80b-4cdc-495b-98f6-0bfe22819dbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a272efe288241a4a0193a507e6c648e, user_id=575072e4aaca4300ba0bb45b35797061, role_id=719e5c62188d4f8a838987d6e72ca8f7)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:37.494681 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f83e80b-4cdc-495b-98f6-0bfe22819dbf admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:37.508258 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1248/2537] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:09:37 2022] PUT /identity/v3/projects/7a272efe288241a4a0193a507e6c648e/users/575072e4aaca4300ba0bb45b35797061/roles/719e5c62188d4f8a838987d6e72ca8f7 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:09:37.520151 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ee16b-3b98-49c3-a3d1-1c79d738e611 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:37.520458 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ee16b-3b98-49c3-a3d1-1c79d738e611 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:37.520759 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ee16b-3b98-49c3-a3d1-1c79d738e611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:37.551338 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-d88ee16b-3b98-49c3-a3d1-1c79d738e611 None None] MFA Rules not processed for user `575072e4aaca4300ba0bb45b35797061`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:09:37.552586 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-d88ee16b-3b98-49c3-a3d1-1c79d738e611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:37.618216 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1290/2538] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:09:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:09:37.623120 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f83e80b-4cdc-495b-98f6-0bfe22819dbf admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:37.687048 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f83e80b-4cdc-495b-98f6-0bfe22819dbf admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:37.691692 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16df37d3-dc69-4c94-b94a-84b102ab05fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:37.692295 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df37d3-dc69-4c94-b94a-84b102ab05fc admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:37.692579 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df37d3-dc69-4c94-b94a-84b102ab05fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:37.692858 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df37d3-dc69-4c94-b94a-84b102ab05fc admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:37.693544 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16df37d3-dc69-4c94-b94a-84b102ab05fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:37.695494 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16df37d3-dc69-4c94-b94a-84b102ab05fc admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:37.723254 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1249/2539] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:09:37 2022] POST /identity/v3/projects => generated 385 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:09:37.727325 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88ee16b-3b98-49c3-a3d1-1c79d738e611 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:37.738445 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88ee16b-3b98-49c3-a3d1-1c79d738e611 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:37.797975 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b44871-c82a-4b68-8c62-ec55b7f8a906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:37.798592 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b44871-c82a-4b68-8c62-ec55b7f8a906 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:37.798874 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b44871-c82a-4b68-8c62-ec55b7f8a906 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:37.799148 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b44871-c82a-4b68-8c62-ec55b7f8a906 admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:37.799788 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b44871-c82a-4b68-8c62-ec55b7f8a906 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:37.801768 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b44871-c82a-4b68-8c62-ec55b7f8a906 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:37.823924 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1291/2540] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:09:37 2022] POST /identity/v3/users => generated 299 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:09:37.828478 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16df37d3-dc69-4c94-b94a-84b102ab05fc admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:37.839018 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16df37d3-dc69-4c94-b94a-84b102ab05fc admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:37.844668 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1507796-fb18-4e0f-8afd-a2d387396ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:37.845263 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1507796-fb18-4e0f-8afd-a2d387396ba4 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:37.845568 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1507796-fb18-4e0f-8afd-a2d387396ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:37.845844 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1507796-fb18-4e0f-8afd-a2d387396ba4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:37.846488 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1507796-fb18-4e0f-8afd-a2d387396ba4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:37.848096 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1507796-fb18-4e0f-8afd-a2d387396ba4 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:37.859162 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1250/2541] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:09:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:09:37.863332 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b44871-c82a-4b68-8c62-ec55b7f8a906 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:37.873569 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b44871-c82a-4b68-8c62-ec55b7f8a906 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:37.878342 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db71a2af-b556-416f-9ce0-3961864ebaf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:37.879045 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db71a2af-b556-416f-9ce0-3961864ebaf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:37.879326 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db71a2af-b556-416f-9ce0-3961864ebaf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:37.879603 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db71a2af-b556-416f-9ce0-3961864ebaf8 admin admin] PATH_INFO: `/v3/projects/10dfd79a35f945bca2176cfb95042c79/users/b72cb46ea39e4c75999366798f757c98/roles/127fdc7ef05b4e0b98a940b334e5fcab` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:37.895775 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db71a2af-b556-416f-9ce0-3961864ebaf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10dfd79a35f945bca2176cfb95042c79, user_id=b72cb46ea39e4c75999366798f757c98, role_id=127fdc7ef05b4e0b98a940b334e5fcab)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:37.898517 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db71a2af-b556-416f-9ce0-3961864ebaf8 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:37.914329 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1292/2542] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:09:37 2022] PUT /identity/v3/projects/10dfd79a35f945bca2176cfb95042c79/users/b72cb46ea39e4c75999366798f757c98/roles/127fdc7ef05b4e0b98a940b334e5fcab => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:09:37.918422 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1507796-fb18-4e0f-8afd-a2d387396ba4 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:37.929431 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1507796-fb18-4e0f-8afd-a2d387396ba4 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:37.961960 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:37.988349 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c944618f-193a-4d74-bd64-56f015ecf5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:37.988960 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c944618f-193a-4d74-bd64-56f015ecf5c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:37.989250 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c944618f-193a-4d74-bd64-56f015ecf5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:37.989562 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c944618f-193a-4d74-bd64-56f015ecf5c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:37.990228 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c944618f-193a-4d74-bd64-56f015ecf5c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:37.991898 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c944618f-193a-4d74-bd64-56f015ecf5c2 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:38.007724 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1251/2543] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:09:37 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:09:38.008908 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db71a2af-b556-416f-9ce0-3961864ebaf8 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:38.020045 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db71a2af-b556-416f-9ce0-3961864ebaf8 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:38.025113 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63115727-2f16-41c9-a7b7-afac336b99bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:38.025811 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63115727-2f16-41c9-a7b7-afac336b99bb admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:38.026093 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63115727-2f16-41c9-a7b7-afac336b99bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:38.026400 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63115727-2f16-41c9-a7b7-afac336b99bb admin admin] PATH_INFO: `/v3/projects/10dfd79a35f945bca2176cfb95042c79/users/b72cb46ea39e4c75999366798f757c98/roles/127fdc7ef05b4e0b98a940b334e5fcab` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:38.028889 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63115727-2f16-41c9-a7b7-afac336b99bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=10dfd79a35f945bca2176cfb95042c79, user_id=b72cb46ea39e4c75999366798f757c98, role_id=127fdc7ef05b4e0b98a940b334e5fcab)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:38.031704 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63115727-2f16-41c9-a7b7-afac336b99bb admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:38.041922 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1293/2544] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:09:38 2022] PUT /identity/v3/projects/10dfd79a35f945bca2176cfb95042c79/users/b72cb46ea39e4c75999366798f757c98/roles/127fdc7ef05b4e0b98a940b334e5fcab => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:09:38.053126 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1caa26f-5cd9-48ea-9ae3-3fa662faddf7 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:38.053412 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1caa26f-5cd9-48ea-9ae3-3fa662faddf7 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:38.053757 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1caa26f-5cd9-48ea-9ae3-3fa662faddf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:38.083166 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-f1caa26f-5cd9-48ea-9ae3-3fa662faddf7 None None] MFA Rules not processed for user `b72cb46ea39e4c75999366798f757c98`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:09:38.084394 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-f1caa26f-5cd9-48ea-9ae3-3fa662faddf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:38.154155 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1252/2545] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:09:38 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:09:38.165724 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63115727-2f16-41c9-a7b7-afac336b99bb admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:38.167422 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-63115727-2f16-41c9-a7b7-afac336b99bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:38.195481 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:38.229213 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63115727-2f16-41c9-a7b7-afac336b99bb admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:38.233277 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40327078-1a2c-4380-9365-f02e10f41495 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b8a09704b9b4ab2bffb813796ec6e77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:38.233917 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40327078-1a2c-4380-9365-f02e10f41495 service cinder] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:38.234199 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40327078-1a2c-4380-9365-f02e10f41495 service cinder] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:38.234473 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40327078-1a2c-4380-9365-f02e10f41495 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:38.244928 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40327078-1a2c-4380-9365-f02e10f41495 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:38.246379 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40327078-1a2c-4380-9365-f02e10f41495 service cinder] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:38.256838 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1294/2546] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:09:38 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:09:38.806930 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1caa26f-5cd9-48ea-9ae3-3fa662faddf7 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:38.808333 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-f1caa26f-5cd9-48ea-9ae3-3fa662faddf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:38.823472 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1caa26f-5cd9-48ea-9ae3-3fa662faddf7 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:38.827300 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff0cb59-16f4-4392-9c02-b4432ff687a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b8a09704b9b4ab2bffb813796ec6e77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:38.827894 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff0cb59-16f4-4392-9c02-b4432ff687a2 service cinder] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:38.828172 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff0cb59-16f4-4392-9c02-b4432ff687a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:38.828445 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff0cb59-16f4-4392-9c02-b4432ff687a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:38.886100 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff0cb59-16f4-4392-9c02-b4432ff687a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:38.888212 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff0cb59-16f4-4392-9c02-b4432ff687a2 service cinder] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:38.896850 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1253/2547] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:09:38 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:09:42.927265 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40327078-1a2c-4380-9365-f02e10f41495 service cinder] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:42.937629 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40327078-1a2c-4380-9365-f02e10f41495 service cinder] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:42.941371 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550064ce-2692-4277-88e0-43cbdf7bfb4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b8a09704b9b4ab2bffb813796ec6e77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:42.942011 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550064ce-2692-4277-88e0-43cbdf7bfb4d service cinder] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:42.942290 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550064ce-2692-4277-88e0-43cbdf7bfb4d service cinder] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:42.942566 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550064ce-2692-4277-88e0-43cbdf7bfb4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:43.003357 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550064ce-2692-4277-88e0-43cbdf7bfb4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:43.004944 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550064ce-2692-4277-88e0-43cbdf7bfb4d service cinder] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:43.014744 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1295/2548] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:09:42 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:09:45.359208 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff0cb59-16f4-4392-9c02-b4432ff687a2 service cinder] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:45.434040 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:45.439470 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff0cb59-16f4-4392-9c02-b4432ff687a2 service cinder] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:45.444186 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2786df1a-9915-49bc-a237-5bb7fc3062fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:45.444993 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2786df1a-9915-49bc-a237-5bb7fc3062fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:45.445337 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2786df1a-9915-49bc-a237-5bb7fc3062fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:45.445641 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2786df1a-9915-49bc-a237-5bb7fc3062fe admin admin] PATH_INFO: `/v3/users/1086252b593d4603821e430f25cacb39` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:45.446755 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2786df1a-9915-49bc-a237-5bb7fc3062fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=1086252b593d4603821e430f25cacb39)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:45.448684 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2786df1a-9915-49bc-a237-5bb7fc3062fe admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:45.501601 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-2786df1a-9915-49bc-a237-5bb7fc3062fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1086252b593d4603821e430f25cacb39'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:45.509442 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-2786df1a-9915-49bc-a237-5bb7fc3062fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1086252b593d4603821e430f25cacb39'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:45.510117 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-2786df1a-9915-49bc-a237-5bb7fc3062fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1086252b593d4603821e430f25cacb39'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:45.510735 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-2786df1a-9915-49bc-a237-5bb7fc3062fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1086252b593d4603821e430f25cacb39'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:45.519399 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-2786df1a-9915-49bc-a237-5bb7fc3062fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1086252b593d4603821e430f25cacb39'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:45.540129 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1254/2549] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:09:45 2022] DELETE /identity/v3/users/1086252b593d4603821e430f25cacb39 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:09:45.545695 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a7d32-c7e3-4c11-b2b5-12ca6a3bf8da None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:45.546195 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a7d32-c7e3-4c11-b2b5-12ca6a3bf8da None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:45.546331 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a7d32-c7e3-4c11-b2b5-12ca6a3bf8da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:45.573726 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-ae5a7d32-c7e3-4c11-b2b5-12ca6a3bf8da None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:09:45.576085 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-ae5a7d32-c7e3-4c11-b2b5-12ca6a3bf8da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:45.682833 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1296/2550] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:09:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:09:45.696703 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2786df1a-9915-49bc-a237-5bb7fc3062fe admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:45.699664 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-2786df1a-9915-49bc-a237-5bb7fc3062fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:45.776033 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2786df1a-9915-49bc-a237-5bb7fc3062fe admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:45.780704 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e113281d-3934-4a1c-84af-7f23ce1d6cf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:45.781331 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e113281d-3934-4a1c-84af-7f23ce1d6cf9 service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:45.781947 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e113281d-3934-4a1c-84af-7f23ce1d6cf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:45.782233 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e113281d-3934-4a1c-84af-7f23ce1d6cf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:45.793343 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e113281d-3934-4a1c-84af-7f23ce1d6cf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:45.796846 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e113281d-3934-4a1c-84af-7f23ce1d6cf9 service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:45.809063 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1255/2551] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:09:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:09:46.116311 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5a7d32-c7e3-4c11-b2b5-12ca6a3bf8da None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:46.118008 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-ae5a7d32-c7e3-4c11-b2b5-12ca6a3bf8da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:46.173420 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5a7d32-c7e3-4c11-b2b5-12ca6a3bf8da None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:46.186621 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dea6ec-62c9-4abf-9b3d-0bef1ec200f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:46.187553 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dea6ec-62c9-4abf-9b3d-0bef1ec200f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:46.187831 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dea6ec-62c9-4abf-9b3d-0bef1ec200f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:46.188129 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dea6ec-62c9-4abf-9b3d-0bef1ec200f7 admin admin] PATH_INFO: `/v3/projects/cf9deae6302840d39ecdfd56b8ac0203` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:46.189401 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dea6ec-62c9-4abf-9b3d-0bef1ec200f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf9deae6302840d39ecdfd56b8ac0203)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:46.191707 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dea6ec-62c9-4abf-9b3d-0bef1ec200f7 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:46.259515 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-54dea6ec-62c9-4abf-9b3d-0bef1ec200f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf9deae6302840d39ecdfd56b8ac0203', 'request_id': 'req-54dea6ec-62c9-4abf-9b3d-0bef1ec200f7'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:46.272058 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-54dea6ec-62c9-4abf-9b3d-0bef1ec200f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf9deae6302840d39ecdfd56b8ac0203', 'request_id': 'req-54dea6ec-62c9-4abf-9b3d-0bef1ec200f7'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:46.282416 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-54dea6ec-62c9-4abf-9b3d-0bef1ec200f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf9deae6302840d39ecdfd56b8ac0203', 'request_id': 'req-54dea6ec-62c9-4abf-9b3d-0bef1ec200f7'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:46.284224 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:46.300600 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-54dea6ec-62c9-4abf-9b3d-0bef1ec200f7 admin admin] The token cache is being invalidate because project cf9deae6302840d39ecdfd56b8ac0203 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:09:46.300906 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-54dea6ec-62c9-4abf-9b3d-0bef1ec200f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:46.301772 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-54dea6ec-62c9-4abf-9b3d-0bef1ec200f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:46.303680 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1297/2552] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:09:46 2022] DELETE /identity/v3/projects/cf9deae6302840d39ecdfd56b8ac0203 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:09:46.315840 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e113281d-3934-4a1c-84af-7f23ce1d6cf9 service neutron] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:46.328680 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e113281d-3934-4a1c-84af-7f23ce1d6cf9 service neutron] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:46.398404 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecc98a0-ce80-40f2-b761-8d89684e7490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:46.399047 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc98a0-ce80-40f2-b761-8d89684e7490 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:46.399317 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc98a0-ce80-40f2-b761-8d89684e7490 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:46.399586 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc98a0-ce80-40f2-b761-8d89684e7490 admin admin] PATH_INFO: `/v3/users/575072e4aaca4300ba0bb45b35797061` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:46.400711 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecc98a0-ce80-40f2-b761-8d89684e7490 admin admin] RBAC: Authorizing `identity:delete_user(user_id=575072e4aaca4300ba0bb45b35797061)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:46.402692 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecc98a0-ce80-40f2-b761-8d89684e7490 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:46.427313 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:46.464286 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-fecc98a0-ce80-40f2-b761-8d89684e7490 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '575072e4aaca4300ba0bb45b35797061'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:46.474918 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-fecc98a0-ce80-40f2-b761-8d89684e7490 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '575072e4aaca4300ba0bb45b35797061'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:46.475532 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-fecc98a0-ce80-40f2-b761-8d89684e7490 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '575072e4aaca4300ba0bb45b35797061'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:46.476153 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-fecc98a0-ce80-40f2-b761-8d89684e7490 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '575072e4aaca4300ba0bb45b35797061'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:46.485548 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-fecc98a0-ce80-40f2-b761-8d89684e7490 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '575072e4aaca4300ba0bb45b35797061'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:46.509868 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1256/2553] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:09:46 2022] DELETE /identity/v3/users/575072e4aaca4300ba0bb45b35797061 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:09:46.801817 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dea6ec-62c9-4abf-9b3d-0bef1ec200f7 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:46.803258 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-54dea6ec-62c9-4abf-9b3d-0bef1ec200f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:46.818442 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dea6ec-62c9-4abf-9b3d-0bef1ec200f7 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:46.879778 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b3b795-f8f0-4143-9f69-fb3f07117792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:46.880413 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b3b795-f8f0-4143-9f69-fb3f07117792 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:46.880696 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b3b795-f8f0-4143-9f69-fb3f07117792 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:46.880977 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b3b795-f8f0-4143-9f69-fb3f07117792 admin admin] PATH_INFO: `/v3/projects/7a272efe288241a4a0193a507e6c648e` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:46.882142 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b3b795-f8f0-4143-9f69-fb3f07117792 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a272efe288241a4a0193a507e6c648e)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:46.884057 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b3b795-f8f0-4143-9f69-fb3f07117792 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:46.932092 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-97b3b795-f8f0-4143-9f69-fb3f07117792 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a272efe288241a4a0193a507e6c648e', 'request_id': 'req-97b3b795-f8f0-4143-9f69-fb3f07117792'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:46.939873 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-97b3b795-f8f0-4143-9f69-fb3f07117792 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a272efe288241a4a0193a507e6c648e', 'request_id': 'req-97b3b795-f8f0-4143-9f69-fb3f07117792'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:46.946067 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-97b3b795-f8f0-4143-9f69-fb3f07117792 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a272efe288241a4a0193a507e6c648e', 'request_id': 'req-97b3b795-f8f0-4143-9f69-fb3f07117792'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:46.957165 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-97b3b795-f8f0-4143-9f69-fb3f07117792 admin admin] The token cache is being invalidate because project 7a272efe288241a4a0193a507e6c648e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:09:46.957462 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-97b3b795-f8f0-4143-9f69-fb3f07117792 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:46.958128 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-97b3b795-f8f0-4143-9f69-fb3f07117792 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:46.959612 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1298/2554] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:09:46 2022] DELETE /identity/v3/projects/7a272efe288241a4a0193a507e6c648e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:09:46.963832 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecc98a0-ce80-40f2-b761-8d89684e7490 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:46.965294 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-fecc98a0-ce80-40f2-b761-8d89684e7490 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:46.978413 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecc98a0-ce80-40f2-b761-8d89684e7490 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:47.035417 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b7aa23-b1a1-4f68-aa16-42e8765e07fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:47.036048 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b7aa23-b1a1-4f68-aa16-42e8765e07fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:47.036331 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b7aa23-b1a1-4f68-aa16-42e8765e07fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:47.036610 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b7aa23-b1a1-4f68-aa16-42e8765e07fa admin admin] PATH_INFO: `/v3/users/b72cb46ea39e4c75999366798f757c98` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:47.037783 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b7aa23-b1a1-4f68-aa16-42e8765e07fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=b72cb46ea39e4c75999366798f757c98)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:47.039711 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b7aa23-b1a1-4f68-aa16-42e8765e07fa admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:47.087736 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-17b7aa23-b1a1-4f68-aa16-42e8765e07fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b72cb46ea39e4c75999366798f757c98'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:47.095537 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-17b7aa23-b1a1-4f68-aa16-42e8765e07fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b72cb46ea39e4c75999366798f757c98'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:47.096144 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-17b7aa23-b1a1-4f68-aa16-42e8765e07fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b72cb46ea39e4c75999366798f757c98'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:47.097035 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-17b7aa23-b1a1-4f68-aa16-42e8765e07fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b72cb46ea39e4c75999366798f757c98'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:47.104352 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-17b7aa23-b1a1-4f68-aa16-42e8765e07fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b72cb46ea39e4c75999366798f757c98'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:47.123619 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1257/2555] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:09:46 2022] DELETE /identity/v3/users/b72cb46ea39e4c75999366798f757c98 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:09:47.426543 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b3b795-f8f0-4143-9f69-fb3f07117792 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:47.428103 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-97b3b795-f8f0-4143-9f69-fb3f07117792 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:47.448840 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b3b795-f8f0-4143-9f69-fb3f07117792 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:47.509618 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7089db-4bc9-40b9-b670-0b92213c125c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:47.510263 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7089db-4bc9-40b9-b670-0b92213c125c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:47.510568 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7089db-4bc9-40b9-b670-0b92213c125c admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:47.510846 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7089db-4bc9-40b9-b670-0b92213c125c admin admin] PATH_INFO: `/v3/projects/10dfd79a35f945bca2176cfb95042c79` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:47.512032 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7089db-4bc9-40b9-b670-0b92213c125c admin admin] RBAC: Authorizing `identity:delete_project(project_id=10dfd79a35f945bca2176cfb95042c79)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:47.514825 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7089db-4bc9-40b9-b670-0b92213c125c admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:47.539978 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:47.571111 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-ef7089db-4bc9-40b9-b670-0b92213c125c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10dfd79a35f945bca2176cfb95042c79', 'request_id': 'req-ef7089db-4bc9-40b9-b670-0b92213c125c'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:47.580068 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-ef7089db-4bc9-40b9-b670-0b92213c125c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10dfd79a35f945bca2176cfb95042c79', 'request_id': 'req-ef7089db-4bc9-40b9-b670-0b92213c125c'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:47.586947 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-ef7089db-4bc9-40b9-b670-0b92213c125c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10dfd79a35f945bca2176cfb95042c79', 'request_id': 'req-ef7089db-4bc9-40b9-b670-0b92213c125c'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:47.598448 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-ef7089db-4bc9-40b9-b670-0b92213c125c admin admin] The token cache is being invalidate because project 10dfd79a35f945bca2176cfb95042c79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:09:47.598738 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-ef7089db-4bc9-40b9-b670-0b92213c125c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:47.599437 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-ef7089db-4bc9-40b9-b670-0b92213c125c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:47.600993 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1299/2556] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:09:47 2022] DELETE /identity/v3/projects/10dfd79a35f945bca2176cfb95042c79 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:09:47.607193 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d473886-1d35-4117-8492-1e4dd62ac106 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:47.607713 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d473886-1d35-4117-8492-1e4dd62ac106 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:47.608268 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d473886-1d35-4117-8492-1e4dd62ac106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:47.628894 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-6d473886-1d35-4117-8492-1e4dd62ac106 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:09:47.630149 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-6d473886-1d35-4117-8492-1e4dd62ac106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:47.643088 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:47.694731 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1258/2557] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:09:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:09:47.703841 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c4686-9adf-4727-a8b2-5eb5c83b0574 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:47.704128 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c4686-9adf-4727-a8b2-5eb5c83b0574 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:47.704456 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c4686-9adf-4727-a8b2-5eb5c83b0574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:47.724883 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-ac7c4686-9adf-4727-a8b2-5eb5c83b0574 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:09:47.726048 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-ac7c4686-9adf-4727-a8b2-5eb5c83b0574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:47.734286 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1300/2558] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:09:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:09:47.738579 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d473886-1d35-4117-8492-1e4dd62ac106 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:47.748942 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d473886-1d35-4117-8492-1e4dd62ac106 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:47.753553 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffae2c73-e5e6-4f4d-8373-0b2478789026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:47.754159 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffae2c73-e5e6-4f4d-8373-0b2478789026 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:47.754433 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffae2c73-e5e6-4f4d-8373-0b2478789026 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:47.754699 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffae2c73-e5e6-4f4d-8373-0b2478789026 admin admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:47.755369 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffae2c73-e5e6-4f4d-8373-0b2478789026 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:09:47.755669 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffae2c73-e5e6-4f4d-8373-0b2478789026 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:47.757273 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffae2c73-e5e6-4f4d-8373-0b2478789026 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:47.770230 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1259/2559] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Aug 18 11:09:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:47.774498 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7c4686-9adf-4727-a8b2-5eb5c83b0574 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:47.784184 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7c4686-9adf-4727-a8b2-5eb5c83b0574 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:47.789248 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ccc945-9de6-4c93-a761-c441431ae874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:47.789908 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ccc945-9de6-4c93-a761-c441431ae874 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:47.790189 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ccc945-9de6-4c93-a761-c441431ae874 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:47.790464 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ccc945-9de6-4c93-a761-c441431ae874 admin admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:47.791109 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ccc945-9de6-4c93-a761-c441431ae874 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:47.793170 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ccc945-9de6-4c93-a761-c441431ae874 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:47.824692 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1301/2560] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:09:47 2022] POST /identity/v3/projects => generated 407 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 11:09:47.829107 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffae2c73-e5e6-4f4d-8373-0b2478789026 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:47.839625 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffae2c73-e5e6-4f4d-8373-0b2478789026 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:47.904480 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d5c2d8-24d1-43a4-b370-5dc0ac2ae160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:47.905105 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5c2d8-24d1-43a4-b370-5dc0ac2ae160 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:47.905389 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5c2d8-24d1-43a4-b370-5dc0ac2ae160 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:47.905695 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5c2d8-24d1-43a4-b370-5dc0ac2ae160 admin admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:47.906332 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d5c2d8-24d1-43a4-b370-5dc0ac2ae160 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:47.908300 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d5c2d8-24d1-43a4-b370-5dc0ac2ae160 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:47.935610 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1260/2561] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:09:47 2022] POST /identity/v3/users => generated 304 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:09:47.936809 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ccc945-9de6-4c93-a761-c441431ae874 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:47.947238 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ccc945-9de6-4c93-a761-c441431ae874 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:47.959541 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67014e73-f765-46a8-95bf-2185ee087ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:47.960304 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67014e73-f765-46a8-95bf-2185ee087ca6 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:47.960658 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67014e73-f765-46a8-95bf-2185ee087ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:47.961007 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67014e73-f765-46a8-95bf-2185ee087ca6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:47.961800 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67014e73-f765-46a8-95bf-2185ee087ca6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:47.963564 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67014e73-f765-46a8-95bf-2185ee087ca6 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:47.974854 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1302/2562] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:09:47 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 11:09:47.979117 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d5c2d8-24d1-43a4-b370-5dc0ac2ae160 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:47.990116 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d5c2d8-24d1-43a4-b370-5dc0ac2ae160 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:47.994750 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937e706e-3520-4aee-b429-bd134e91aa2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:47.995279 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e706e-3520-4aee-b429-bd134e91aa2a admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:47.995562 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e706e-3520-4aee-b429-bd134e91aa2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:47.995834 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e706e-3520-4aee-b429-bd134e91aa2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:47.996470 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937e706e-3520-4aee-b429-bd134e91aa2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:47.998297 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937e706e-3520-4aee-b429-bd134e91aa2a admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:48.009486 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1261/2563] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:09:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:09:48.014832 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67014e73-f765-46a8-95bf-2185ee087ca6 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:48.028213 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67014e73-f765-46a8-95bf-2185ee087ca6 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:48.034102 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0ba4bd-71a7-44bf-adef-8e34dbdd1c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:48.034884 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ba4bd-71a7-44bf-adef-8e34dbdd1c73 admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:48.035163 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ba4bd-71a7-44bf-adef-8e34dbdd1c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:48.035454 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ba4bd-71a7-44bf-adef-8e34dbdd1c73 admin admin] PATH_INFO: `/v3/projects/46487176974b436799416617e061146f/users/99e2ec76734e4cefbac28f7bbaf06e79/roles/719e5c62188d4f8a838987d6e72ca8f7` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:48.057835 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0ba4bd-71a7-44bf-adef-8e34dbdd1c73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46487176974b436799416617e061146f, user_id=99e2ec76734e4cefbac28f7bbaf06e79, role_id=719e5c62188d4f8a838987d6e72ca8f7)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:48.060570 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0ba4bd-71a7-44bf-adef-8e34dbdd1c73 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:48.073857 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1303/2564] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:09:48 2022] PUT /identity/v3/projects/46487176974b436799416617e061146f/users/99e2ec76734e4cefbac28f7bbaf06e79/roles/719e5c62188d4f8a838987d6e72ca8f7 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:09:48.087814 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f9397-4460-43c1-8139-61dbae647efa None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:48.088099 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f9397-4460-43c1-8139-61dbae647efa None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:48.088439 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f9397-4460-43c1-8139-61dbae647efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:48.121602 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-169f9397-4460-43c1-8139-61dbae647efa None None] MFA Rules not processed for user `99e2ec76734e4cefbac28f7bbaf06e79`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:09:48.123494 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-169f9397-4460-43c1-8139-61dbae647efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:48.192013 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1262/2565] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:09:48 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:09:48.196587 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0ba4bd-71a7-44bf-adef-8e34dbdd1c73 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:48.264810 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0ba4bd-71a7-44bf-adef-8e34dbdd1c73 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:48.270861 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9579a6-0085-443d-9e3a-3b4f3978ebe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:48.271467 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9579a6-0085-443d-9e3a-3b4f3978ebe3 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:48.271750 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9579a6-0085-443d-9e3a-3b4f3978ebe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:48.272122 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9579a6-0085-443d-9e3a-3b4f3978ebe3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:48.272667 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9579a6-0085-443d-9e3a-3b4f3978ebe3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:48.274823 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9579a6-0085-443d-9e3a-3b4f3978ebe3 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:48.310633 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1304/2566] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:09:48 2022] POST /identity/v3/projects => generated 409 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:09:48.315329 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f9397-4460-43c1-8139-61dbae647efa None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:48.327753 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f9397-4460-43c1-8139-61dbae647efa None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:48.337164 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:48.386606 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea611bd7-9b02-42a3-bf8f-ad02ee320793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:48.387157 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea611bd7-9b02-42a3-bf8f-ad02ee320793 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:48.387443 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea611bd7-9b02-42a3-bf8f-ad02ee320793 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:48.388363 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea611bd7-9b02-42a3-bf8f-ad02ee320793 admin admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:48.388997 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea611bd7-9b02-42a3-bf8f-ad02ee320793 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:48.390987 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea611bd7-9b02-42a3-bf8f-ad02ee320793 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:48.413167 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1263/2567] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:09:48 2022] POST /identity/v3/users => generated 311 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:09:48.417290 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9579a6-0085-443d-9e3a-3b4f3978ebe3 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:48.428365 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9579a6-0085-443d-9e3a-3b4f3978ebe3 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:48.433282 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd2f80b-40cb-4420-82c4-895667a89a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:48.433930 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd2f80b-40cb-4420-82c4-895667a89a0d admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:48.434211 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd2f80b-40cb-4420-82c4-895667a89a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:48.434998 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd2f80b-40cb-4420-82c4-895667a89a0d admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:48.435644 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd2f80b-40cb-4420-82c4-895667a89a0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:48.437859 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd2f80b-40cb-4420-82c4-895667a89a0d admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:48.448780 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1305/2568] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:09:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:09:48.453930 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea611bd7-9b02-42a3-bf8f-ad02ee320793 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:48.464640 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea611bd7-9b02-42a3-bf8f-ad02ee320793 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:48.470509 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a1359a-9b21-4732-91c2-a73eef26123d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:48.471223 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1359a-9b21-4732-91c2-a73eef26123d admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:48.471500 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1359a-9b21-4732-91c2-a73eef26123d admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:48.471776 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1359a-9b21-4732-91c2-a73eef26123d admin admin] PATH_INFO: `/v3/projects/732e791290dc4bbea6ae71c7756e6126/users/ec08c67a565a4974a395f2ef2421cd85/roles/127fdc7ef05b4e0b98a940b334e5fcab` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:48.488150 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a1359a-9b21-4732-91c2-a73eef26123d admin admin] RBAC: Authorizing `identity:create_grant(project_id=732e791290dc4bbea6ae71c7756e6126, user_id=ec08c67a565a4974a395f2ef2421cd85, role_id=127fdc7ef05b4e0b98a940b334e5fcab)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:48.490855 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a1359a-9b21-4732-91c2-a73eef26123d admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:48.505769 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1264/2569] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:09:48 2022] PUT /identity/v3/projects/732e791290dc4bbea6ae71c7756e6126/users/ec08c67a565a4974a395f2ef2421cd85/roles/127fdc7ef05b4e0b98a940b334e5fcab => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:09:48.509897 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd2f80b-40cb-4420-82c4-895667a89a0d admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:48.522249 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd2f80b-40cb-4420-82c4-895667a89a0d admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:48.540726 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:48.586891 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c12c71-d61e-4d80-ad48-778e3fd7ff3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:48.587504 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c12c71-d61e-4d80-ad48-778e3fd7ff3b admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:48.587784 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c12c71-d61e-4d80-ad48-778e3fd7ff3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:48.588058 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c12c71-d61e-4d80-ad48-778e3fd7ff3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:48.588738 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c12c71-d61e-4d80-ad48-778e3fd7ff3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:48.590363 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c12c71-d61e-4d80-ad48-778e3fd7ff3b admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:48.605874 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1306/2570] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:09:48 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:09:48.611227 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a1359a-9b21-4732-91c2-a73eef26123d admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:48.621673 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a1359a-9b21-4732-91c2-a73eef26123d admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:48.627036 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381c3fc6-c027-4707-a662-85d3d8a2c7a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:48.627692 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c3fc6-c027-4707-a662-85d3d8a2c7a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:48.627968 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c3fc6-c027-4707-a662-85d3d8a2c7a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:48.628241 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c3fc6-c027-4707-a662-85d3d8a2c7a5 admin admin] PATH_INFO: `/v3/projects/732e791290dc4bbea6ae71c7756e6126/users/ec08c67a565a4974a395f2ef2421cd85/roles/127fdc7ef05b4e0b98a940b334e5fcab` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:48.630187 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381c3fc6-c027-4707-a662-85d3d8a2c7a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=732e791290dc4bbea6ae71c7756e6126, user_id=ec08c67a565a4974a395f2ef2421cd85, role_id=127fdc7ef05b4e0b98a940b334e5fcab)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:48.632810 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381c3fc6-c027-4707-a662-85d3d8a2c7a5 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:48.643539 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1265/2571] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:09:48 2022] PUT /identity/v3/projects/732e791290dc4bbea6ae71c7756e6126/users/ec08c67a565a4974a395f2ef2421cd85/roles/127fdc7ef05b4e0b98a940b334e5fcab => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:09:48.654048 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fdddee-bf49-4161-9208-8b772066f553 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:48.654394 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fdddee-bf49-4161-9208-8b772066f553 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:48.654681 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fdddee-bf49-4161-9208-8b772066f553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:48.683066 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-30fdddee-bf49-4161-9208-8b772066f553 None None] MFA Rules not processed for user `ec08c67a565a4974a395f2ef2421cd85`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:09:48.684302 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-30fdddee-bf49-4161-9208-8b772066f553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:48.752507 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1307/2572] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:09:48 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:09:48.763829 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381c3fc6-c027-4707-a662-85d3d8a2c7a5 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:48.765572 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-381c3fc6-c027-4707-a662-85d3d8a2c7a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:48.827810 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381c3fc6-c027-4707-a662-85d3d8a2c7a5 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:48.831491 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5cd957-3b08-4828-b8eb-265c0f5a44ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b8a09704b9b4ab2bffb813796ec6e77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:48.832107 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5cd957-3b08-4828-b8eb-265c0f5a44ee service cinder] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:48.832387 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5cd957-3b08-4828-b8eb-265c0f5a44ee service cinder] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:48.832678 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5cd957-3b08-4828-b8eb-265c0f5a44ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:48.843328 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5cd957-3b08-4828-b8eb-265c0f5a44ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:48.844769 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5cd957-3b08-4828-b8eb-265c0f5a44ee service cinder] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:48.854663 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1266/2573] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:09:48 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:09:49.011356 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fdddee-bf49-4161-9208-8b772066f553 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:49.022045 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fdddee-bf49-4161-9208-8b772066f553 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:49.025661 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066d9c34-b8b0-4544-b8c0-704c7de44cbf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b8a09704b9b4ab2bffb813796ec6e77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:49.026266 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d9c34-b8b0-4544-b8c0-704c7de44cbf service cinder] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:49.026550 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d9c34-b8b0-4544-b8c0-704c7de44cbf service cinder] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:49.026824 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d9c34-b8b0-4544-b8c0-704c7de44cbf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:49.086685 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066d9c34-b8b0-4544-b8c0-704c7de44cbf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:49.088120 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066d9c34-b8b0-4544-b8c0-704c7de44cbf service cinder] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:49.097675 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1308/2574] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:09:49 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:09:50.529659 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5cd957-3b08-4828-b8eb-265c0f5a44ee service cinder] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:50.531331 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-0f5cd957-3b08-4828-b8eb-265c0f5a44ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:50.597938 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5cd957-3b08-4828-b8eb-265c0f5a44ee service cinder] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:50.602450 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e19d155-a38a-4b8b-b3ff-72b1d27257e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:50.603080 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e19d155-a38a-4b8b-b3ff-72b1d27257e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:50.603569 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e19d155-a38a-4b8b-b3ff-72b1d27257e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:50.603889 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e19d155-a38a-4b8b-b3ff-72b1d27257e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:50.606445 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-8e19d155-a38a-4b8b-b3ff-72b1d27257e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:50.637055 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:50.688789 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e19d155-a38a-4b8b-b3ff-72b1d27257e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:50.690284 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e19d155-a38a-4b8b-b3ff-72b1d27257e3 service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:50.704008 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1267/2575] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:09:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:09:54.034904 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066d9c34-b8b0-4544-b8c0-704c7de44cbf service cinder] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:54.036696 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-066d9c34-b8b0-4544-b8c0-704c7de44cbf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:54.099037 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:54.103780 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e19d155-a38a-4b8b-b3ff-72b1d27257e3 service neutron] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:54.105655 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-8e19d155-a38a-4b8b-b3ff-72b1d27257e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:54.126497 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e19d155-a38a-4b8b-b3ff-72b1d27257e3 service neutron] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:54.134905 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfea5d87-f0c9-4bb2-a3cf-703ed6fd782b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:54.135763 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea5d87-f0c9-4bb2-a3cf-703ed6fd782b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:54.136065 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea5d87-f0c9-4bb2-a3cf-703ed6fd782b admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:54.136523 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea5d87-f0c9-4bb2-a3cf-703ed6fd782b admin admin] PATH_INFO: `/v3/users/7dc5501d59fb4593b405f0e9bd2e49ef` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:54.138058 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfea5d87-f0c9-4bb2-a3cf-703ed6fd782b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dc5501d59fb4593b405f0e9bd2e49ef)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:54.139602 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066d9c34-b8b0-4544-b8c0-704c7de44cbf service cinder] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:54.140299 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfea5d87-f0c9-4bb2-a3cf-703ed6fd782b admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:54.146016 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda37adf-46c8-46db-87f4-9690a55215c1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f918bcdd83d4d48be3fff5a48c54929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:54.146763 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda37adf-46c8-46db-87f4-9690a55215c1 service placement] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:54.147501 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda37adf-46c8-46db-87f4-9690a55215c1 service placement] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:54.147786 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda37adf-46c8-46db-87f4-9690a55215c1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:54.151417 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-dda37adf-46c8-46db-87f4-9690a55215c1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:54.169769 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda37adf-46c8-46db-87f4-9690a55215c1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:54.173117 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda37adf-46c8-46db-87f4-9690a55215c1 service placement] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:54.187118 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1309/2576] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:09:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:09:54.222091 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-bfea5d87-f0c9-4bb2-a3cf-703ed6fd782b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dc5501d59fb4593b405f0e9bd2e49ef'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:54.234034 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-bfea5d87-f0c9-4bb2-a3cf-703ed6fd782b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dc5501d59fb4593b405f0e9bd2e49ef'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:54.234951 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-bfea5d87-f0c9-4bb2-a3cf-703ed6fd782b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dc5501d59fb4593b405f0e9bd2e49ef'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:54.235789 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-bfea5d87-f0c9-4bb2-a3cf-703ed6fd782b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dc5501d59fb4593b405f0e9bd2e49ef'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:54.246704 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-bfea5d87-f0c9-4bb2-a3cf-703ed6fd782b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dc5501d59fb4593b405f0e9bd2e49ef'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:54.268128 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1268/2577] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:09:54 2022] DELETE /identity/v3/users/7dc5501d59fb4593b405f0e9bd2e49ef => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:09:54.469451 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda37adf-46c8-46db-87f4-9690a55215c1 service placement] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:54.484210 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda37adf-46c8-46db-87f4-9690a55215c1 service placement] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:54.552457 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9d9336-dae2-4c4f-9dbe-d7c71869dc14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:54.552612 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d9336-dae2-4c4f-9dbe-d7c71869dc14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:54.552908 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d9336-dae2-4c4f-9dbe-d7c71869dc14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:54.553234 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d9336-dae2-4c4f-9dbe-d7c71869dc14 admin admin] PATH_INFO: `/v3/projects/3c723b1181c94699b389f0fc03e19af6` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:54.554597 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9d9336-dae2-4c4f-9dbe-d7c71869dc14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c723b1181c94699b389f0fc03e19af6)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:54.556716 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9d9336-dae2-4c4f-9dbe-d7c71869dc14 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:54.616026 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-9b9d9336-dae2-4c4f-9dbe-d7c71869dc14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c723b1181c94699b389f0fc03e19af6', 'request_id': 'req-9b9d9336-dae2-4c4f-9dbe-d7c71869dc14'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:54.624083 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-9b9d9336-dae2-4c4f-9dbe-d7c71869dc14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c723b1181c94699b389f0fc03e19af6', 'request_id': 'req-9b9d9336-dae2-4c4f-9dbe-d7c71869dc14'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:54.630629 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-9b9d9336-dae2-4c4f-9dbe-d7c71869dc14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c723b1181c94699b389f0fc03e19af6', 'request_id': 'req-9b9d9336-dae2-4c4f-9dbe-d7c71869dc14'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:54.641749 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-9b9d9336-dae2-4c4f-9dbe-d7c71869dc14 admin admin] The token cache is being invalidate because project 3c723b1181c94699b389f0fc03e19af6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:09:54.642041 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-9b9d9336-dae2-4c4f-9dbe-d7c71869dc14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:54.642701 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-9b9d9336-dae2-4c4f-9dbe-d7c71869dc14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:54.644250 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1310/2578] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:09:54 2022] DELETE /identity/v3/projects/3c723b1181c94699b389f0fc03e19af6 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:09:54.649336 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d0bce-0393-4d56-b0fe-a90923d8598e None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:54.649663 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d0bce-0393-4d56-b0fe-a90923d8598e None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:54.649949 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d0bce-0393-4d56-b0fe-a90923d8598e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:54.671474 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-d17d0bce-0393-4d56-b0fe-a90923d8598e None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:09:54.672730 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-d17d0bce-0393-4d56-b0fe-a90923d8598e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:54.732339 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1269/2579] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:09:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:09:54.741269 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec7fda-8671-414a-af87-e6ab39c1bfe3 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:54.741581 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec7fda-8671-414a-af87-e6ab39c1bfe3 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:54.741861 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec7fda-8671-414a-af87-e6ab39c1bfe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:54.762959 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-0cec7fda-8671-414a-af87-e6ab39c1bfe3 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:09:54.764483 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-0cec7fda-8671-414a-af87-e6ab39c1bfe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:54.773904 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1311/2580] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:09:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:09:54.778212 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17d0bce-0393-4d56-b0fe-a90923d8598e None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:54.788023 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17d0bce-0393-4d56-b0fe-a90923d8598e None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:54.792622 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1ada4a-e14e-4c42-afe6-2ab6fead6ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:54.793233 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ada4a-e14e-4c42-afe6-2ab6fead6ab3 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:54.793543 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ada4a-e14e-4c42-afe6-2ab6fead6ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:54.794304 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ada4a-e14e-4c42-afe6-2ab6fead6ab3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:54.795210 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1ada4a-e14e-4c42-afe6-2ab6fead6ab3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:09:54.795513 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1ada4a-e14e-4c42-afe6-2ab6fead6ab3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:54.797123 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1ada4a-e14e-4c42-afe6-2ab6fead6ab3 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:54.810384 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1270/2581] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Aug 18 11:09:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:54.814933 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cec7fda-8671-414a-af87-e6ab39c1bfe3 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:54.828993 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cec7fda-8671-414a-af87-e6ab39c1bfe3 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:54.834992 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f572c706-b6c3-45f0-889e-afdac58571ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:54.835605 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f572c706-b6c3-45f0-889e-afdac58571ce admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:54.835887 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f572c706-b6c3-45f0-889e-afdac58571ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:54.836164 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f572c706-b6c3-45f0-889e-afdac58571ce admin admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:54.836848 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f572c706-b6c3-45f0-889e-afdac58571ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:54.838775 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f572c706-b6c3-45f0-889e-afdac58571ce admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:54.868574 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1312/2582] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:09:54 2022] POST /identity/v3/projects => generated 369 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:09:54.873299 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1ada4a-e14e-4c42-afe6-2ab6fead6ab3 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:54.883385 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1ada4a-e14e-4c42-afe6-2ab6fead6ab3 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:54.895752 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:54.945318 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e6f453-850d-4cb3-8aca-588464b0afb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:54.945970 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e6f453-850d-4cb3-8aca-588464b0afb4 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:54.946251 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e6f453-850d-4cb3-8aca-588464b0afb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:54.946528 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e6f453-850d-4cb3-8aca-588464b0afb4 admin admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:54.947158 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e6f453-850d-4cb3-8aca-588464b0afb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:54.949100 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e6f453-850d-4cb3-8aca-588464b0afb4 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:54.970357 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1271/2583] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:09:54 2022] POST /identity/v3/users => generated 285 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:09:54.974558 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f572c706-b6c3-45f0-889e-afdac58571ce admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:54.985684 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f572c706-b6c3-45f0-889e-afdac58571ce admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:54.990343 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5a6b00-e5e5-463a-9708-37e9dea2c8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:54.990937 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a6b00-e5e5-463a-9708-37e9dea2c8f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:54.991216 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a6b00-e5e5-463a-9708-37e9dea2c8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:54.991489 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a6b00-e5e5-463a-9708-37e9dea2c8f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:54.992158 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5a6b00-e5e5-463a-9708-37e9dea2c8f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:54.993772 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5a6b00-e5e5-463a-9708-37e9dea2c8f1 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:55.003750 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1313/2584] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:09:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:09:55.007728 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e6f453-850d-4cb3-8aca-588464b0afb4 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:55.017731 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e6f453-850d-4cb3-8aca-588464b0afb4 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:55.022308 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050c6745-52c4-47e4-81fe-856c0dbd1082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:55.022894 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c6745-52c4-47e4-81fe-856c0dbd1082 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:55.023169 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c6745-52c4-47e4-81fe-856c0dbd1082 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:55.023439 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c6745-52c4-47e4-81fe-856c0dbd1082 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:55.024078 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050c6745-52c4-47e4-81fe-856c0dbd1082 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:55.025910 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050c6745-52c4-47e4-81fe-856c0dbd1082 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:55.037951 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1272/2585] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:09:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:09:55.042171 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5a6b00-e5e5-463a-9708-37e9dea2c8f1 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:55.053149 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5a6b00-e5e5-463a-9708-37e9dea2c8f1 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:55.057802 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1209d9-f869-4ba9-bc68-2ae1e91d20b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:55.058482 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1209d9-f869-4ba9-bc68-2ae1e91d20b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:55.058756 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1209d9-f869-4ba9-bc68-2ae1e91d20b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:55.059058 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1209d9-f869-4ba9-bc68-2ae1e91d20b3 admin admin] PATH_INFO: `/v3/projects/5255b187adb34832a8ade1639bdd9872/users/c838191a7dfc4e8586ff1b29fb6f7795/roles/719e5c62188d4f8a838987d6e72ca8f7` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:55.074406 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1209d9-f869-4ba9-bc68-2ae1e91d20b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5255b187adb34832a8ade1639bdd9872, user_id=c838191a7dfc4e8586ff1b29fb6f7795, role_id=719e5c62188d4f8a838987d6e72ca8f7)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:55.077097 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1209d9-f869-4ba9-bc68-2ae1e91d20b3 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:55.080749 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:55.093708 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1314/2586] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:09:55 2022] PUT /identity/v3/projects/5255b187adb34832a8ade1639bdd9872/users/c838191a7dfc4e8586ff1b29fb6f7795/roles/719e5c62188d4f8a838987d6e72ca8f7 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:09:55.104316 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7425e772-716b-48fd-8540-7640135ef543 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:55.104838 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7425e772-716b-48fd-8540-7640135ef543 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:55.104838 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7425e772-716b-48fd-8540-7640135ef543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:55.135382 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-7425e772-716b-48fd-8540-7640135ef543 None None] MFA Rules not processed for user `c838191a7dfc4e8586ff1b29fb6f7795`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:09:55.136627 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-7425e772-716b-48fd-8540-7640135ef543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:55.208035 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1273/2587] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:09:55 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:09:55.212551 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1209d9-f869-4ba9-bc68-2ae1e91d20b3 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:55.276181 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1209d9-f869-4ba9-bc68-2ae1e91d20b3 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:55.281751 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe66c1e3-65e5-4674-be8d-4802d6fd9eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:55.282354 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe66c1e3-65e5-4674-be8d-4802d6fd9eb8 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:55.282643 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe66c1e3-65e5-4674-be8d-4802d6fd9eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:55.282909 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe66c1e3-65e5-4674-be8d-4802d6fd9eb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:55.283552 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe66c1e3-65e5-4674-be8d-4802d6fd9eb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:55.285444 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe66c1e3-65e5-4674-be8d-4802d6fd9eb8 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:55.313767 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1315/2588] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:09:55 2022] POST /identity/v3/projects => generated 367 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:09:55.317884 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7425e772-716b-48fd-8540-7640135ef543 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:55.329309 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7425e772-716b-48fd-8540-7640135ef543 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:55.385333 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83523b0a-c76a-4109-8917-47d5943b68bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:55.385890 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83523b0a-c76a-4109-8917-47d5943b68bb admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:55.386168 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83523b0a-c76a-4109-8917-47d5943b68bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:55.386438 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83523b0a-c76a-4109-8917-47d5943b68bb admin admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:55.387074 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83523b0a-c76a-4109-8917-47d5943b68bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:55.389544 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83523b0a-c76a-4109-8917-47d5943b68bb admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:55.411753 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1274/2589] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:09:55 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:09:55.415782 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe66c1e3-65e5-4674-be8d-4802d6fd9eb8 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:55.426902 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe66c1e3-65e5-4674-be8d-4802d6fd9eb8 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:55.431694 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce274066-8800-4054-ba6a-a01cada9efe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:55.432307 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce274066-8800-4054-ba6a-a01cada9efe9 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:55.432587 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce274066-8800-4054-ba6a-a01cada9efe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:55.432890 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce274066-8800-4054-ba6a-a01cada9efe9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:55.433560 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce274066-8800-4054-ba6a-a01cada9efe9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:55.435753 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce274066-8800-4054-ba6a-a01cada9efe9 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:55.449599 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1316/2590] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:09:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:09:55.451346 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83523b0a-c76a-4109-8917-47d5943b68bb admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:55.461685 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83523b0a-c76a-4109-8917-47d5943b68bb admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:55.467201 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee354d94-b686-4c56-8e38-661afbee863c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:55.467854 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee354d94-b686-4c56-8e38-661afbee863c admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:55.468159 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee354d94-b686-4c56-8e38-661afbee863c admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:55.468572 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee354d94-b686-4c56-8e38-661afbee863c admin admin] PATH_INFO: `/v3/projects/f1bdb2a62d8d43e2ba729f7fb578caff/users/43daeba5cc2d4eb18228403adbb198ad/roles/127fdc7ef05b4e0b98a940b334e5fcab` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:55.481070 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:55.485319 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee354d94-b686-4c56-8e38-661afbee863c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1bdb2a62d8d43e2ba729f7fb578caff, user_id=43daeba5cc2d4eb18228403adbb198ad, role_id=127fdc7ef05b4e0b98a940b334e5fcab)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:55.488268 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee354d94-b686-4c56-8e38-661afbee863c admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:55.502516 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1275/2591] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:09:55 2022] PUT /identity/v3/projects/f1bdb2a62d8d43e2ba729f7fb578caff/users/43daeba5cc2d4eb18228403adbb198ad/roles/127fdc7ef05b4e0b98a940b334e5fcab => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:09:55.506404 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce274066-8800-4054-ba6a-a01cada9efe9 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:55.518260 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce274066-8800-4054-ba6a-a01cada9efe9 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:55.585843 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76963d64-1ab7-43fc-9a03-1cd1a6d87926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:55.586452 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76963d64-1ab7-43fc-9a03-1cd1a6d87926 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:55.586858 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76963d64-1ab7-43fc-9a03-1cd1a6d87926 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:55.587132 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76963d64-1ab7-43fc-9a03-1cd1a6d87926 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:55.587793 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76963d64-1ab7-43fc-9a03-1cd1a6d87926 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:55.589374 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76963d64-1ab7-43fc-9a03-1cd1a6d87926 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:55.603890 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1317/2592] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:09:55 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:09:55.608752 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee354d94-b686-4c56-8e38-661afbee863c admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:55.620494 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee354d94-b686-4c56-8e38-661afbee863c admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:55.626135 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b028e4a0-ac14-4e7e-bd00-5883869b3d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:55.626828 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028e4a0-ac14-4e7e-bd00-5883869b3d96 admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:55.627110 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028e4a0-ac14-4e7e-bd00-5883869b3d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:55.627385 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028e4a0-ac14-4e7e-bd00-5883869b3d96 admin admin] PATH_INFO: `/v3/projects/f1bdb2a62d8d43e2ba729f7fb578caff/users/43daeba5cc2d4eb18228403adbb198ad/roles/127fdc7ef05b4e0b98a940b334e5fcab` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:55.629341 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b028e4a0-ac14-4e7e-bd00-5883869b3d96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1bdb2a62d8d43e2ba729f7fb578caff, user_id=43daeba5cc2d4eb18228403adbb198ad, role_id=127fdc7ef05b4e0b98a940b334e5fcab)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:55.632008 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b028e4a0-ac14-4e7e-bd00-5883869b3d96 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:55.643581 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1276/2593] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:09:55 2022] PUT /identity/v3/projects/f1bdb2a62d8d43e2ba729f7fb578caff/users/43daeba5cc2d4eb18228403adbb198ad/roles/127fdc7ef05b4e0b98a940b334e5fcab => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:09:55.654690 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16458bfc-25dd-47a8-8cb6-02698efdb6a3 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:55.654976 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16458bfc-25dd-47a8-8cb6-02698efdb6a3 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:55.655255 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16458bfc-25dd-47a8-8cb6-02698efdb6a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:55.687570 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-16458bfc-25dd-47a8-8cb6-02698efdb6a3 None None] MFA Rules not processed for user `43daeba5cc2d4eb18228403adbb198ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:09:55.689028 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-16458bfc-25dd-47a8-8cb6-02698efdb6a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:55.744542 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:55.767109 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1318/2594] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:09:55 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:09:55.779293 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b028e4a0-ac14-4e7e-bd00-5883869b3d96 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:55.781060 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-b028e4a0-ac14-4e7e-bd00-5883869b3d96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:55.843251 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b028e4a0-ac14-4e7e-bd00-5883869b3d96 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:55.847208 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c142c031-f18a-46f3-8ee7-d25e6757dccf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b8a09704b9b4ab2bffb813796ec6e77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:55.847844 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c142c031-f18a-46f3-8ee7-d25e6757dccf service cinder] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:55.848123 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c142c031-f18a-46f3-8ee7-d25e6757dccf service cinder] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:55.848400 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c142c031-f18a-46f3-8ee7-d25e6757dccf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:55.857855 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c142c031-f18a-46f3-8ee7-d25e6757dccf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:55.859309 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c142c031-f18a-46f3-8ee7-d25e6757dccf service cinder] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:55.868897 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1277/2595] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:09:55 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:09:56.838622 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16458bfc-25dd-47a8-8cb6-02698efdb6a3 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:56.844647 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-16458bfc-25dd-47a8-8cb6-02698efdb6a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:56.947564 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16458bfc-25dd-47a8-8cb6-02698efdb6a3 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:56.953595 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba06c7ea-6abc-45c1-8246-e383c7d03299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:56.954247 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba06c7ea-6abc-45c1-8246-e383c7d03299 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:56.954523 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba06c7ea-6abc-45c1-8246-e383c7d03299 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:56.954796 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba06c7ea-6abc-45c1-8246-e383c7d03299 admin admin] PATH_INFO: `/v3/users/99e2ec76734e4cefbac28f7bbaf06e79` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:56.955996 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba06c7ea-6abc-45c1-8246-e383c7d03299 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99e2ec76734e4cefbac28f7bbaf06e79)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:56.958127 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba06c7ea-6abc-45c1-8246-e383c7d03299 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:57.014783 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-ba06c7ea-6abc-45c1-8246-e383c7d03299 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99e2ec76734e4cefbac28f7bbaf06e79'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:57.015584 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-ba06c7ea-6abc-45c1-8246-e383c7d03299 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99e2ec76734e4cefbac28f7bbaf06e79'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:57.022960 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-ba06c7ea-6abc-45c1-8246-e383c7d03299 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99e2ec76734e4cefbac28f7bbaf06e79'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:57.036853 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-ba06c7ea-6abc-45c1-8246-e383c7d03299 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99e2ec76734e4cefbac28f7bbaf06e79'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:57.045187 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-ba06c7ea-6abc-45c1-8246-e383c7d03299 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99e2ec76734e4cefbac28f7bbaf06e79'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:57.052282 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1319/2596] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:09:56 2022] DELETE /identity/v3/users/99e2ec76734e4cefbac28f7bbaf06e79 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:09:57.057038 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724175b3-8e83-4506-8a3c-d0943390d425 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:57.057488 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724175b3-8e83-4506-8a3c-d0943390d425 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:57.057779 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724175b3-8e83-4506-8a3c-d0943390d425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:57.079458 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-724175b3-8e83-4506-8a3c-d0943390d425 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:09:57.080681 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-724175b3-8e83-4506-8a3c-d0943390d425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:57.147993 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1278/2597] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:09:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:09:57.158570 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba06c7ea-6abc-45c1-8246-e383c7d03299 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:57.159994 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-ba06c7ea-6abc-45c1-8246-e383c7d03299 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:57.233890 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba06c7ea-6abc-45c1-8246-e383c7d03299 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:57.237618 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289d29ca-7bba-499f-b7da-58ab172a1f52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:57.238343 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289d29ca-7bba-499f-b7da-58ab172a1f52 service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:57.238687 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289d29ca-7bba-499f-b7da-58ab172a1f52 service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:57.239023 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289d29ca-7bba-499f-b7da-58ab172a1f52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:57.250101 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289d29ca-7bba-499f-b7da-58ab172a1f52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:57.251571 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289d29ca-7bba-499f-b7da-58ab172a1f52 service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:57.263524 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1320/2598] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:09:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 11:09:57.374466 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724175b3-8e83-4506-8a3c-d0943390d425 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:57.375978 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-724175b3-8e83-4506-8a3c-d0943390d425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:57.389912 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724175b3-8e83-4506-8a3c-d0943390d425 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:57.394668 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e071095b-5524-4f18-ac19-971eb6cedb39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:57.395712 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e071095b-5524-4f18-ac19-971eb6cedb39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:57.395996 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e071095b-5524-4f18-ac19-971eb6cedb39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:57.396272 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e071095b-5524-4f18-ac19-971eb6cedb39 admin admin] PATH_INFO: `/v3/users/c838191a7dfc4e8586ff1b29fb6f7795` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:57.397614 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e071095b-5524-4f18-ac19-971eb6cedb39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c838191a7dfc4e8586ff1b29fb6f7795)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:57.399459 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e071095b-5524-4f18-ac19-971eb6cedb39 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:57.456179 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-e071095b-5524-4f18-ac19-971eb6cedb39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c838191a7dfc4e8586ff1b29fb6f7795'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:57.464908 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-e071095b-5524-4f18-ac19-971eb6cedb39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c838191a7dfc4e8586ff1b29fb6f7795'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:57.465766 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-e071095b-5524-4f18-ac19-971eb6cedb39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c838191a7dfc4e8586ff1b29fb6f7795'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:57.466399 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-e071095b-5524-4f18-ac19-971eb6cedb39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c838191a7dfc4e8586ff1b29fb6f7795'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:57.474319 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-e071095b-5524-4f18-ac19-971eb6cedb39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c838191a7dfc4e8586ff1b29fb6f7795'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:57.485070 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:57.494364 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1279/2599] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:09:57 2022] DELETE /identity/v3/users/c838191a7dfc4e8586ff1b29fb6f7795 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:09:57.499865 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc62d03-78da-4523-9cc9-f48786a248e0 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:57.500156 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc62d03-78da-4523-9cc9-f48786a248e0 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:57.500467 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc62d03-78da-4523-9cc9-f48786a248e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:57.521153 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-6fc62d03-78da-4523-9cc9-f48786a248e0 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:09:57.522435 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-6fc62d03-78da-4523-9cc9-f48786a248e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:57.533165 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:57.580040 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e071095b-5524-4f18-ac19-971eb6cedb39 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:57.581810 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-e071095b-5524-4f18-ac19-971eb6cedb39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:57.594751 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1321/2600] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:09:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:09:57.605568 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc62d03-78da-4523-9cc9-f48786a248e0 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:57.607173 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-6fc62d03-78da-4523-9cc9-f48786a248e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:57.658430 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e071095b-5524-4f18-ac19-971eb6cedb39 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:57.663720 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5631b8-9ef7-4cd6-8987-589224b8d84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:57.664437 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5631b8-9ef7-4cd6-8987-589224b8d84d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:57.664792 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5631b8-9ef7-4cd6-8987-589224b8d84d admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:57.665163 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5631b8-9ef7-4cd6-8987-589224b8d84d admin admin] PATH_INFO: `/v3/projects/46487176974b436799416617e061146f` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:57.666536 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5631b8-9ef7-4cd6-8987-589224b8d84d admin admin] RBAC: Authorizing `identity:delete_project(project_id=46487176974b436799416617e061146f)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:57.670349 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5631b8-9ef7-4cd6-8987-589224b8d84d admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:57.671888 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc62d03-78da-4523-9cc9-f48786a248e0 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:57.675721 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74770f1d-edfa-4e43-8145-893684578c38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:57.676353 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74770f1d-edfa-4e43-8145-893684578c38 service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:57.676611 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74770f1d-edfa-4e43-8145-893684578c38 service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:57.676891 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74770f1d-edfa-4e43-8145-893684578c38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:57.687348 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74770f1d-edfa-4e43-8145-893684578c38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:57.688808 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74770f1d-edfa-4e43-8145-893684578c38 service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:57.699407 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1322/2601] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:09:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:09:57.721944 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-4b5631b8-9ef7-4cd6-8987-589224b8d84d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46487176974b436799416617e061146f', 'request_id': 'req-4b5631b8-9ef7-4cd6-8987-589224b8d84d'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:57.730478 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-4b5631b8-9ef7-4cd6-8987-589224b8d84d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46487176974b436799416617e061146f', 'request_id': 'req-4b5631b8-9ef7-4cd6-8987-589224b8d84d'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:57.738415 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-4b5631b8-9ef7-4cd6-8987-589224b8d84d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46487176974b436799416617e061146f', 'request_id': 'req-4b5631b8-9ef7-4cd6-8987-589224b8d84d'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:57.750331 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-4b5631b8-9ef7-4cd6-8987-589224b8d84d admin admin] The token cache is being invalidate because project 46487176974b436799416617e061146f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:09:57.750645 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-4b5631b8-9ef7-4cd6-8987-589224b8d84d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:57.751369 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-4b5631b8-9ef7-4cd6-8987-589224b8d84d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:57.752927 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1280/2602] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:09:57 2022] DELETE /identity/v3/projects/46487176974b436799416617e061146f => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:09:57.757024 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74770f1d-edfa-4e43-8145-893684578c38 service neutron] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:57.767931 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74770f1d-edfa-4e43-8145-893684578c38 service neutron] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:57.956568 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74366683-41db-48ff-85aa-f17e9401e126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:57.957174 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74366683-41db-48ff-85aa-f17e9401e126 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:57.957409 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74366683-41db-48ff-85aa-f17e9401e126 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:57.957734 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74366683-41db-48ff-85aa-f17e9401e126 admin admin] PATH_INFO: `/v3/users/ec08c67a565a4974a395f2ef2421cd85` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:57.958906 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74366683-41db-48ff-85aa-f17e9401e126 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec08c67a565a4974a395f2ef2421cd85)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:57.960850 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74366683-41db-48ff-85aa-f17e9401e126 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:58.007963 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5631b8-9ef7-4cd6-8987-589224b8d84d admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:58.009749 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-4b5631b8-9ef7-4cd6-8987-589224b8d84d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:58.010606 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-74366683-41db-48ff-85aa-f17e9401e126 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec08c67a565a4974a395f2ef2421cd85'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:58.011312 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-74366683-41db-48ff-85aa-f17e9401e126 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec08c67a565a4974a395f2ef2421cd85'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:58.019775 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-74366683-41db-48ff-85aa-f17e9401e126 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec08c67a565a4974a395f2ef2421cd85'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:58.022900 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:58.023981 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5631b8-9ef7-4cd6-8987-589224b8d84d admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:58.030999 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e024cb-ca8e-489b-b76f-a74db8d98bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:58.031708 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e024cb-ca8e-489b-b76f-a74db8d98bf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:58.031913 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e024cb-ca8e-489b-b76f-a74db8d98bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:58.032339 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e024cb-ca8e-489b-b76f-a74db8d98bf5 admin admin] PATH_INFO: `/v3/projects/5255b187adb34832a8ade1639bdd9872` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:58.033483 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e024cb-ca8e-489b-b76f-a74db8d98bf5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5255b187adb34832a8ade1639bdd9872)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:58.035450 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e024cb-ca8e-489b-b76f-a74db8d98bf5 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:58.036412 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-74366683-41db-48ff-85aa-f17e9401e126 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec08c67a565a4974a395f2ef2421cd85'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:58.046122 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-74366683-41db-48ff-85aa-f17e9401e126 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec08c67a565a4974a395f2ef2421cd85'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:58.052981 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1323/2603] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:09:57 2022] DELETE /identity/v3/users/ec08c67a565a4974a395f2ef2421cd85 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:09:58.091440 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-45e024cb-ca8e-489b-b76f-a74db8d98bf5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5255b187adb34832a8ade1639bdd9872', 'request_id': 'req-45e024cb-ca8e-489b-b76f-a74db8d98bf5'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:58.099648 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-45e024cb-ca8e-489b-b76f-a74db8d98bf5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5255b187adb34832a8ade1639bdd9872', 'request_id': 'req-45e024cb-ca8e-489b-b76f-a74db8d98bf5'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:58.106733 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-45e024cb-ca8e-489b-b76f-a74db8d98bf5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5255b187adb34832a8ade1639bdd9872', 'request_id': 'req-45e024cb-ca8e-489b-b76f-a74db8d98bf5'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:58.119041 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-45e024cb-ca8e-489b-b76f-a74db8d98bf5 admin admin] The token cache is being invalidate because project 5255b187adb34832a8ade1639bdd9872 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:09:58.119756 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-45e024cb-ca8e-489b-b76f-a74db8d98bf5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:58.120895 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-45e024cb-ca8e-489b-b76f-a74db8d98bf5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:58.123456 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1281/2604] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:09:58 2022] DELETE /identity/v3/projects/5255b187adb34832a8ade1639bdd9872 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:09:58.128188 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74366683-41db-48ff-85aa-f17e9401e126 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:58.129838 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-74366683-41db-48ff-85aa-f17e9401e126 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:58.208731 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74366683-41db-48ff-85aa-f17e9401e126 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:58.293601 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c66db7-d5db-4d91-9649-3dcc54eeeee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:58.295131 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c66db7-d5db-4d91-9649-3dcc54eeeee2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:58.295408 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c66db7-d5db-4d91-9649-3dcc54eeeee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:58.295675 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c66db7-d5db-4d91-9649-3dcc54eeeee2 admin admin] PATH_INFO: `/v3/users/43daeba5cc2d4eb18228403adbb198ad` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:58.296850 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c66db7-d5db-4d91-9649-3dcc54eeeee2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43daeba5cc2d4eb18228403adbb198ad)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:58.298882 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c66db7-d5db-4d91-9649-3dcc54eeeee2 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:58.348267 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-26c66db7-d5db-4d91-9649-3dcc54eeeee2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43daeba5cc2d4eb18228403adbb198ad'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:58.348933 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-26c66db7-d5db-4d91-9649-3dcc54eeeee2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43daeba5cc2d4eb18228403adbb198ad'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:58.356356 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-26c66db7-d5db-4d91-9649-3dcc54eeeee2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43daeba5cc2d4eb18228403adbb198ad'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:58.368634 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-26c66db7-d5db-4d91-9649-3dcc54eeeee2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43daeba5cc2d4eb18228403adbb198ad'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:58.376135 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-26c66db7-d5db-4d91-9649-3dcc54eeeee2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43daeba5cc2d4eb18228403adbb198ad'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:58.381307 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e024cb-ca8e-489b-b76f-a74db8d98bf5 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:58.382883 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-45e024cb-ca8e-489b-b76f-a74db8d98bf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:58.388603 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1324/2605] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:09:58 2022] DELETE /identity/v3/users/43daeba5cc2d4eb18228403adbb198ad => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:09:58.402329 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e024cb-ca8e-489b-b76f-a74db8d98bf5 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:58.407996 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:58.474956 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e343d67-fc1b-4033-b517-6df97ead8e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:58.475632 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e343d67-fc1b-4033-b517-6df97ead8e4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:58.475968 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e343d67-fc1b-4033-b517-6df97ead8e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:58.476321 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e343d67-fc1b-4033-b517-6df97ead8e4d admin admin] PATH_INFO: `/v3/projects/732e791290dc4bbea6ae71c7756e6126` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:58.478098 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e343d67-fc1b-4033-b517-6df97ead8e4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=732e791290dc4bbea6ae71c7756e6126)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:58.479550 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e343d67-fc1b-4033-b517-6df97ead8e4d admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:58.534093 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-2e343d67-fc1b-4033-b517-6df97ead8e4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '732e791290dc4bbea6ae71c7756e6126', 'request_id': 'req-2e343d67-fc1b-4033-b517-6df97ead8e4d'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:58.547068 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-2e343d67-fc1b-4033-b517-6df97ead8e4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '732e791290dc4bbea6ae71c7756e6126', 'request_id': 'req-2e343d67-fc1b-4033-b517-6df97ead8e4d'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:58.555230 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-2e343d67-fc1b-4033-b517-6df97ead8e4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '732e791290dc4bbea6ae71c7756e6126', 'request_id': 'req-2e343d67-fc1b-4033-b517-6df97ead8e4d'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:58.567693 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-2e343d67-fc1b-4033-b517-6df97ead8e4d admin admin] The token cache is being invalidate because project 732e791290dc4bbea6ae71c7756e6126 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:09:58.567987 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-2e343d67-fc1b-4033-b517-6df97ead8e4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:58.568697 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-2e343d67-fc1b-4033-b517-6df97ead8e4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:58.570221 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1282/2606] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:09:58 2022] DELETE /identity/v3/projects/732e791290dc4bbea6ae71c7756e6126 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:09:58.575505 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec6916b-3185-42b7-91c7-7c29c8bbb927 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:58.576263 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec6916b-3185-42b7-91c7-7c29c8bbb927 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:58.576783 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec6916b-3185-42b7-91c7-7c29c8bbb927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:58.584667 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:58.600591 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-bec6916b-3185-42b7-91c7-7c29c8bbb927 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:09:58.602508 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-bec6916b-3185-42b7-91c7-7c29c8bbb927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:58.673857 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1325/2607] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:09:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:09:58.687189 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696061bf-8235-444c-850b-9bf287175644 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:58.687559 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696061bf-8235-444c-850b-9bf287175644 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:58.687899 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696061bf-8235-444c-850b-9bf287175644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:58.694706 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec6916b-3185-42b7-91c7-7c29c8bbb927 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:58.697378 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-bec6916b-3185-42b7-91c7-7c29c8bbb927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:58.722843 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-696061bf-8235-444c-850b-9bf287175644 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:09:58.724045 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-696061bf-8235-444c-850b-9bf287175644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:58.725026 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec6916b-3185-42b7-91c7-7c29c8bbb927 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:58.733682 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630fa329-032e-4aee-a157-cbe211908837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:58.734446 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630fa329-032e-4aee-a157-cbe211908837 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:58.734722 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1283/2608] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:09:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:09:58.734849 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630fa329-032e-4aee-a157-cbe211908837 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:58.735094 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630fa329-032e-4aee-a157-cbe211908837 admin admin] PATH_INFO: `/v3/projects/f1bdb2a62d8d43e2ba729f7fb578caff` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:58.736348 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630fa329-032e-4aee-a157-cbe211908837 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1bdb2a62d8d43e2ba729f7fb578caff)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:58.738286 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630fa329-032e-4aee-a157-cbe211908837 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:58.739133 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696061bf-8235-444c-850b-9bf287175644 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:58.750331 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696061bf-8235-444c-850b-9bf287175644 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:58.755278 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13562417-3384-4945-9de9-24ac7d0ad779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:58.755877 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13562417-3384-4945-9de9-24ac7d0ad779 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:58.756156 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13562417-3384-4945-9de9-24ac7d0ad779 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:58.756452 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13562417-3384-4945-9de9-24ac7d0ad779 admin admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:58.757093 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13562417-3384-4945-9de9-24ac7d0ad779 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:09:58.757392 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13562417-3384-4945-9de9-24ac7d0ad779 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:58.759052 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13562417-3384-4945-9de9-24ac7d0ad779 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:58.772331 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1284/2609] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Aug 18 11:09:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:09:58.777017 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13562417-3384-4945-9de9-24ac7d0ad779 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:58.787462 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13562417-3384-4945-9de9-24ac7d0ad779 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:58.788668 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-630fa329-032e-4aee-a157-cbe211908837 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1bdb2a62d8d43e2ba729f7fb578caff', 'request_id': 'req-630fa329-032e-4aee-a157-cbe211908837'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:58.797250 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-630fa329-032e-4aee-a157-cbe211908837 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1bdb2a62d8d43e2ba729f7fb578caff', 'request_id': 'req-630fa329-032e-4aee-a157-cbe211908837'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:58.804523 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-630fa329-032e-4aee-a157-cbe211908837 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1bdb2a62d8d43e2ba729f7fb578caff', 'request_id': 'req-630fa329-032e-4aee-a157-cbe211908837'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:58.817425 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-630fa329-032e-4aee-a157-cbe211908837 admin admin] The token cache is being invalidate because project f1bdb2a62d8d43e2ba729f7fb578caff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:09:58.817945 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-630fa329-032e-4aee-a157-cbe211908837 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:58.818875 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-630fa329-032e-4aee-a157-cbe211908837 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:09:58.820777 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1326/2610] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:09:58 2022] DELETE /identity/v3/projects/f1bdb2a62d8d43e2ba729f7fb578caff => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:09:58.825712 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f10fa4a-769e-4d3e-b043-24de4f0b8778 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:58.825991 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f10fa4a-769e-4d3e-b043-24de4f0b8778 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:58.826267 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f10fa4a-769e-4d3e-b043-24de4f0b8778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:58.845862 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-7f10fa4a-769e-4d3e-b043-24de4f0b8778 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:09:58.847709 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-7f10fa4a-769e-4d3e-b043-24de4f0b8778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:58.847875 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99abde8-286a-4d0b-9dce-6a40cda32c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:58.848369 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99abde8-286a-4d0b-9dce-6a40cda32c6a admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:58.848646 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99abde8-286a-4d0b-9dce-6a40cda32c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:58.848923 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99abde8-286a-4d0b-9dce-6a40cda32c6a admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:58.849581 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99abde8-286a-4d0b-9dce-6a40cda32c6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:58.851472 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99abde8-286a-4d0b-9dce-6a40cda32c6a admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:58.855896 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1327/2611] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:09:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:09:58.865030 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a1325e-9043-473d-887e-b1066d1f5a04 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:58.865474 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a1325e-9043-473d-887e-b1066d1f5a04 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:58.865801 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a1325e-9043-473d-887e-b1066d1f5a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:58.885772 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1285/2612] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:09:58 2022] POST /identity/v3/projects => generated 375 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 11:09:58.887060 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-22a1325e-9043-473d-887e-b1066d1f5a04 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:09:58.887203 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99abde8-286a-4d0b-9dce-6a40cda32c6a admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:58.889170 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-22a1325e-9043-473d-887e-b1066d1f5a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:58.890101 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-c99abde8-286a-4d0b-9dce-6a40cda32c6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:58.894620 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:58.952321 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1328/2613] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:09:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:09:58.956736 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a1325e-9043-473d-887e-b1066d1f5a04 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:58.966085 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a1325e-9043-473d-887e-b1066d1f5a04 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:58.966440 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99abde8-286a-4d0b-9dce-6a40cda32c6a admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:58.970751 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a1e447-6a5c-4fb2-8caf-34118bb2c447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:58.971274 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dda5667-af2c-401e-8801-76777a960d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:58.971426 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1e447-6a5c-4fb2-8caf-34118bb2c447 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:58.971654 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1e447-6a5c-4fb2-8caf-34118bb2c447 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:58.971891 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda5667-af2c-401e-8801-76777a960d83 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:58.972003 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1e447-6a5c-4fb2-8caf-34118bb2c447 admin admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:58.972175 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda5667-af2c-401e-8801-76777a960d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:58.972456 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda5667-af2c-401e-8801-76777a960d83 admin admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:58.972587 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a1e447-6a5c-4fb2-8caf-34118bb2c447 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:09:58.972823 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a1e447-6a5c-4fb2-8caf-34118bb2c447 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:58.973089 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dda5667-af2c-401e-8801-76777a960d83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:58.974465 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a1e447-6a5c-4fb2-8caf-34118bb2c447 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:58.975111 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dda5667-af2c-401e-8801-76777a960d83 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:58.994262 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1329/2614] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Aug 18 11:09:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:09:59.001545 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1286/2615] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:09:58 2022] POST /identity/v3/users => generated 288 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 11:09:59.001704 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a1e447-6a5c-4fb2-8caf-34118bb2c447 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:59.002630 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dda5667-af2c-401e-8801-76777a960d83 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:59.009049 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a1e447-6a5c-4fb2-8caf-34118bb2c447 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:59.013797 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dda5667-af2c-401e-8801-76777a960d83 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:59.014590 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707cc153-4a9f-4cfd-a40e-d7b45d7f4227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:59.015196 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707cc153-4a9f-4cfd-a40e-d7b45d7f4227 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:59.015468 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707cc153-4a9f-4cfd-a40e-d7b45d7f4227 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:59.015734 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707cc153-4a9f-4cfd-a40e-d7b45d7f4227 admin admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:59.016383 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707cc153-4a9f-4cfd-a40e-d7b45d7f4227 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:59.018290 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707cc153-4a9f-4cfd-a40e-d7b45d7f4227 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:59.018409 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc27473b-3457-46b1-8e2d-f527a01372f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:59.018977 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc27473b-3457-46b1-8e2d-f527a01372f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:59.019256 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc27473b-3457-46b1-8e2d-f527a01372f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:59.019528 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc27473b-3457-46b1-8e2d-f527a01372f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:59.020197 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc27473b-3457-46b1-8e2d-f527a01372f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:59.021955 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc27473b-3457-46b1-8e2d-f527a01372f4 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:59.022922 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:59.033084 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1287/2616] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:09:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:09:59.037406 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc27473b-3457-46b1-8e2d-f527a01372f4 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:59.047735 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1330/2617] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:09:58 2022] POST /identity/v3/projects => generated 369 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:09:59.051450 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc27473b-3457-46b1-8e2d-f527a01372f4 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:59.051807 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707cc153-4a9f-4cfd-a40e-d7b45d7f4227 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:59.109432 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3297c506-108e-491c-ab11-d4f052ad2bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:59.110061 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3297c506-108e-491c-ab11-d4f052ad2bcb admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:59.110458 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3297c506-108e-491c-ab11-d4f052ad2bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:59.110612 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3297c506-108e-491c-ab11-d4f052ad2bcb admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:59.111255 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3297c506-108e-491c-ab11-d4f052ad2bcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:59.112857 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3297c506-108e-491c-ab11-d4f052ad2bcb admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:59.115436 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707cc153-4a9f-4cfd-a40e-d7b45d7f4227 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:59.120420 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9b5072-02ca-48bf-86f5-e5c995817b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:59.121025 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b5072-02ca-48bf-86f5-e5c995817b80 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:59.121303 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b5072-02ca-48bf-86f5-e5c995817b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:59.121598 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b5072-02ca-48bf-86f5-e5c995817b80 admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:59.122992 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9b5072-02ca-48bf-86f5-e5c995817b80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:59.124543 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1288/2618] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:09:59 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 11:09:59.124907 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9b5072-02ca-48bf-86f5-e5c995817b80 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:59.128603 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3297c506-108e-491c-ab11-d4f052ad2bcb admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:59.140051 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3297c506-108e-491c-ab11-d4f052ad2bcb admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:59.144792 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef0ff09-653d-4758-b131-cb2dfcfbe4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:59.145411 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef0ff09-653d-4758-b131-cb2dfcfbe4f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:59.145719 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef0ff09-653d-4758-b131-cb2dfcfbe4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:59.145996 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef0ff09-653d-4758-b131-cb2dfcfbe4f0 admin admin] PATH_INFO: `/v3/projects/94bd8c87d54641678bb4f0136a354acc/users/cf7572ed57244428ae3db89b3b408791/roles/719e5c62188d4f8a838987d6e72ca8f7` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:59.147594 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1331/2619] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:09:59 2022] POST /identity/v3/users => generated 285 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 11:09:59.151522 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9b5072-02ca-48bf-86f5-e5c995817b80 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:59.161377 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9b5072-02ca-48bf-86f5-e5c995817b80 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:59.161792 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef0ff09-653d-4758-b131-cb2dfcfbe4f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94bd8c87d54641678bb4f0136a354acc, user_id=cf7572ed57244428ae3db89b3b408791, role_id=719e5c62188d4f8a838987d6e72ca8f7)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:59.164445 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef0ff09-653d-4758-b131-cb2dfcfbe4f0 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:59.166171 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c93364-ff9b-4746-a12c-2b5d7531d400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:59.166763 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c93364-ff9b-4746-a12c-2b5d7531d400 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:59.167037 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c93364-ff9b-4746-a12c-2b5d7531d400 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:59.167316 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c93364-ff9b-4746-a12c-2b5d7531d400 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:59.167953 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c93364-ff9b-4746-a12c-2b5d7531d400 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:59.170560 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c93364-ff9b-4746-a12c-2b5d7531d400 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:59.179345 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1289/2620] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:09:59 2022] PUT /identity/v3/projects/94bd8c87d54641678bb4f0136a354acc/users/cf7572ed57244428ae3db89b3b408791/roles/719e5c62188d4f8a838987d6e72ca8f7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:09:59.187530 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1332/2621] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:09:59 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 11:09:59.191608 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef0ff09-653d-4758-b131-cb2dfcfbe4f0 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:59.192782 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb75964-bdd7-434d-ac97-8a6f6b92918c None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:59.193064 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb75964-bdd7-434d-ac97-8a6f6b92918c None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:59.193367 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb75964-bdd7-434d-ac97-8a6f6b92918c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:59.226594 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-6fb75964-bdd7-434d-ac97-8a6f6b92918c None None] MFA Rules not processed for user `cf7572ed57244428ae3db89b3b408791`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:09:59.227998 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-6fb75964-bdd7-434d-ac97-8a6f6b92918c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:59.245753 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:59.258319 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef0ff09-653d-4758-b131-cb2dfcfbe4f0 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:59.263480 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ec655b-6dc8-4520-b107-ee393e5fe437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:59.264092 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec655b-6dc8-4520-b107-ee393e5fe437 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:59.264380 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec655b-6dc8-4520-b107-ee393e5fe437 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:59.264654 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec655b-6dc8-4520-b107-ee393e5fe437 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:59.265299 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ec655b-6dc8-4520-b107-ee393e5fe437 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:59.266950 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ec655b-6dc8-4520-b107-ee393e5fe437 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:59.280457 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1290/2622] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:09:59 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:09:59.281506 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ec655b-6dc8-4520-b107-ee393e5fe437 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:59.292250 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ec655b-6dc8-4520-b107-ee393e5fe437 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:59.297952 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c46a50e-292a-4d7c-aab4-cf816e9a4a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:59.298663 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c46a50e-292a-4d7c-aab4-cf816e9a4a3e admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:59.298948 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c46a50e-292a-4d7c-aab4-cf816e9a4a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:59.299226 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c46a50e-292a-4d7c-aab4-cf816e9a4a3e admin admin] PATH_INFO: `/v3/projects/8621d28bbd22458192a023db5d543ebc/users/eea2191e0c5d4fceb7f431929923d9d9/roles/719e5c62188d4f8a838987d6e72ca8f7` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:59.301205 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1333/2623] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:09:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:09:59.312743 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb75964-bdd7-434d-ac97-8a6f6b92918c None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:59.314166 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-6fb75964-bdd7-434d-ac97-8a6f6b92918c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:59.316391 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c46a50e-292a-4d7c-aab4-cf816e9a4a3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8621d28bbd22458192a023db5d543ebc, user_id=eea2191e0c5d4fceb7f431929923d9d9, role_id=719e5c62188d4f8a838987d6e72ca8f7)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:59.319216 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c46a50e-292a-4d7c-aab4-cf816e9a4a3e admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:59.333106 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1291/2624] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:09:59 2022] PUT /identity/v3/projects/8621d28bbd22458192a023db5d543ebc/users/eea2191e0c5d4fceb7f431929923d9d9/roles/719e5c62188d4f8a838987d6e72ca8f7 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:09:59.343810 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1abce2b-3a72-43cc-8813-cec4ab8c1955 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:59.344091 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1abce2b-3a72-43cc-8813-cec4ab8c1955 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:59.344364 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1abce2b-3a72-43cc-8813-cec4ab8c1955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:59.373865 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-d1abce2b-3a72-43cc-8813-cec4ab8c1955 None None] MFA Rules not processed for user `eea2191e0c5d4fceb7f431929923d9d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:09:59.375236 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-d1abce2b-3a72-43cc-8813-cec4ab8c1955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:59.377048 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb75964-bdd7-434d-ac97-8a6f6b92918c None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:59.381908 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:59.429488 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7514f405-0b8b-42ef-9089-81e53eee05cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b8a09704b9b4ab2bffb813796ec6e77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:59.430254 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7514f405-0b8b-42ef-9089-81e53eee05cd service cinder] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:59.430501 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7514f405-0b8b-42ef-9089-81e53eee05cd service cinder] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:59.430796 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7514f405-0b8b-42ef-9089-81e53eee05cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:59.443537 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1292/2625] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:09:59 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:09:59.447930 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1abce2b-3a72-43cc-8813-cec4ab8c1955 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:59.489026 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7514f405-0b8b-42ef-9089-81e53eee05cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:59.490518 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7514f405-0b8b-42ef-9089-81e53eee05cd service cinder] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:59.499792 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1334/2626] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:09:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 11:09:59.513646 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1abce2b-3a72-43cc-8813-cec4ab8c1955 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:59.518891 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dac60a-ffb5-419d-a88a-12d2fd71aa1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:59.520088 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dac60a-ffb5-419d-a88a-12d2fd71aa1b admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:59.520375 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dac60a-ffb5-419d-a88a-12d2fd71aa1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:59.520638 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dac60a-ffb5-419d-a88a-12d2fd71aa1b admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:59.521269 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dac60a-ffb5-419d-a88a-12d2fd71aa1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:59.523374 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dac60a-ffb5-419d-a88a-12d2fd71aa1b admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:59.553410 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1293/2627] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:09:59 2022] POST /identity/v3/projects => generated 365 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 11:09:59.557797 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7514f405-0b8b-42ef-9089-81e53eee05cd service cinder] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:59.568782 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7514f405-0b8b-42ef-9089-81e53eee05cd service cinder] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:59.639048 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38226599-4cd1-4e44-8e84-f173896cde6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:59.639776 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38226599-4cd1-4e44-8e84-f173896cde6e admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:59.640066 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38226599-4cd1-4e44-8e84-f173896cde6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:59.640444 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38226599-4cd1-4e44-8e84-f173896cde6e admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:59.641283 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38226599-4cd1-4e44-8e84-f173896cde6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:59.643327 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38226599-4cd1-4e44-8e84-f173896cde6e admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:59.665429 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1335/2628] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:09:59 2022] POST /identity/v3/users => generated 289 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:09:59.670840 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dac60a-ffb5-419d-a88a-12d2fd71aa1b admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:59.682287 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dac60a-ffb5-419d-a88a-12d2fd71aa1b admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:59.687258 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ee655f-f617-4dcb-93bd-42a629f834a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:59.687866 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee655f-f617-4dcb-93bd-42a629f834a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:59.688141 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee655f-f617-4dcb-93bd-42a629f834a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:59.688412 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee655f-f617-4dcb-93bd-42a629f834a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:59.689050 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ee655f-f617-4dcb-93bd-42a629f834a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:59.690669 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ee655f-f617-4dcb-93bd-42a629f834a8 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:59.702513 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1294/2629] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:09:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:09:59.706805 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38226599-4cd1-4e44-8e84-f173896cde6e admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:59.718310 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38226599-4cd1-4e44-8e84-f173896cde6e admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:59.723429 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eee228a-a82c-440b-b653-ff65df009020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:59.724197 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee228a-a82c-440b-b653-ff65df009020 admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:59.724460 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee228a-a82c-440b-b653-ff65df009020 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:59.724736 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee228a-a82c-440b-b653-ff65df009020 admin admin] PATH_INFO: `/v3/projects/e64e5606f5b346a78959a283fda931fd/users/f624180f7bb24cf5a8ff423a561e8351/roles/127fdc7ef05b4e0b98a940b334e5fcab` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:59.742366 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eee228a-a82c-440b-b653-ff65df009020 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e64e5606f5b346a78959a283fda931fd, user_id=f624180f7bb24cf5a8ff423a561e8351, role_id=127fdc7ef05b4e0b98a940b334e5fcab)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:59.745132 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eee228a-a82c-440b-b653-ff65df009020 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:59.767577 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1336/2630] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:09:59 2022] PUT /identity/v3/projects/e64e5606f5b346a78959a283fda931fd/users/f624180f7bb24cf5a8ff423a561e8351/roles/127fdc7ef05b4e0b98a940b334e5fcab => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:09:59.768494 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ee655f-f617-4dcb-93bd-42a629f834a8 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:59.780489 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ee655f-f617-4dcb-93bd-42a629f834a8 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:59.810827 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:59.854396 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0a72a0-115d-494b-981c-258f73cfdf65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:59.855192 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a72a0-115d-494b-981c-258f73cfdf65 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:59.855546 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a72a0-115d-494b-981c-258f73cfdf65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:59.855859 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a72a0-115d-494b-981c-258f73cfdf65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:59.856832 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0a72a0-115d-494b-981c-258f73cfdf65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:59.858918 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0a72a0-115d-494b-981c-258f73cfdf65 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:59.873811 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1295/2631] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:09:59 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:09:59.876163 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eee228a-a82c-440b-b653-ff65df009020 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:59.885091 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eee228a-a82c-440b-b653-ff65df009020 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:59.890539 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d009df0-3553-421d-931d-8541e745b1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:59.891303 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d009df0-3553-421d-931d-8541e745b1d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:59.891638 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d009df0-3553-421d-931d-8541e745b1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:59.891973 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d009df0-3553-421d-931d-8541e745b1d8 admin admin] PATH_INFO: `/v3/projects/e64e5606f5b346a78959a283fda931fd/users/f624180f7bb24cf5a8ff423a561e8351/roles/127fdc7ef05b4e0b98a940b334e5fcab` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:59.894693 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d009df0-3553-421d-931d-8541e745b1d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e64e5606f5b346a78959a283fda931fd, user_id=f624180f7bb24cf5a8ff423a561e8351, role_id=127fdc7ef05b4e0b98a940b334e5fcab)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:59.897647 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d009df0-3553-421d-931d-8541e745b1d8 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:59.909472 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1337/2632] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:09:59 2022] PUT /identity/v3/projects/e64e5606f5b346a78959a283fda931fd/users/f624180f7bb24cf5a8ff423a561e8351/roles/127fdc7ef05b4e0b98a940b334e5fcab => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:09:59.921224 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9687b6-b2c7-4c8f-b290-31c0b33bdb32 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:59.921509 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9687b6-b2c7-4c8f-b290-31c0b33bdb32 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:59.921812 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9687b6-b2c7-4c8f-b290-31c0b33bdb32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:59.950896 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-9a9687b6-b2c7-4c8f-b290-31c0b33bdb32 None None] MFA Rules not processed for user `f624180f7bb24cf5a8ff423a561e8351`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:09:59.952243 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-9a9687b6-b2c7-4c8f-b290-31c0b33bdb32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:00.022325 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1296/2633] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:09:59 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:10:00.035326 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d009df0-3553-421d-931d-8541e745b1d8 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:00.053724 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:00.095764 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d009df0-3553-421d-931d-8541e745b1d8 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:00.099392 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de54e3a0-9590-4b23-af13-5bf2e4dd7044 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b8a09704b9b4ab2bffb813796ec6e77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:00.100018 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de54e3a0-9590-4b23-af13-5bf2e4dd7044 service cinder] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:00.100293 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de54e3a0-9590-4b23-af13-5bf2e4dd7044 service cinder] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:00.100562 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de54e3a0-9590-4b23-af13-5bf2e4dd7044 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:00.109665 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de54e3a0-9590-4b23-af13-5bf2e4dd7044 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:00.111078 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de54e3a0-9590-4b23-af13-5bf2e4dd7044 service cinder] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:00.120556 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1338/2634] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:10:00 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:10:00.166002 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9687b6-b2c7-4c8f-b290-31c0b33bdb32 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:00.167412 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-9a9687b6-b2c7-4c8f-b290-31c0b33bdb32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:00.180125 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9687b6-b2c7-4c8f-b290-31c0b33bdb32 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:00.183798 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceb0f02-87c3-483c-9023-fd55525b484c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b8a09704b9b4ab2bffb813796ec6e77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:00.184932 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb0f02-87c3-483c-9023-fd55525b484c service cinder] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:00.185214 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb0f02-87c3-483c-9023-fd55525b484c service cinder] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:00.185492 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb0f02-87c3-483c-9023-fd55525b484c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:00.243924 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceb0f02-87c3-483c-9023-fd55525b484c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:00.245358 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceb0f02-87c3-483c-9023-fd55525b484c service cinder] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:00.254990 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1297/2635] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:10:00 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:10:00.886229 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54709e0-1a2f-4256-a02e-89fea2821879 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:00.886605 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54709e0-1a2f-4256-a02e-89fea2821879 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:00.887032 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54709e0-1a2f-4256-a02e-89fea2821879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:00.909939 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-d54709e0-1a2f-4256-a02e-89fea2821879 None None] MFA Rules not processed for user `cf7572ed57244428ae3db89b3b408791`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:10:00.911341 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-d54709e0-1a2f-4256-a02e-89fea2821879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:00.969065 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1339/2636] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:10:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:10:03.698346 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceb0f02-87c3-483c-9023-fd55525b484c service cinder] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:03.755058 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:03.774974 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceb0f02-87c3-483c-9023-fd55525b484c service cinder] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:03.781171 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce98c0b-30f5-48d8-83b9-50008834ae3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:03.781957 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce98c0b-30f5-48d8-83b9-50008834ae3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:03.782308 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce98c0b-30f5-48d8-83b9-50008834ae3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:03.782718 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce98c0b-30f5-48d8-83b9-50008834ae3f admin admin] PATH_INFO: `/v3/users/eea2191e0c5d4fceb7f431929923d9d9` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:03.783949 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce98c0b-30f5-48d8-83b9-50008834ae3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=eea2191e0c5d4fceb7f431929923d9d9)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:03.786017 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce98c0b-30f5-48d8-83b9-50008834ae3f admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:03.853038 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-1ce98c0b-30f5-48d8-83b9-50008834ae3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eea2191e0c5d4fceb7f431929923d9d9'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:03.863168 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-1ce98c0b-30f5-48d8-83b9-50008834ae3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eea2191e0c5d4fceb7f431929923d9d9'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:03.863901 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-1ce98c0b-30f5-48d8-83b9-50008834ae3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eea2191e0c5d4fceb7f431929923d9d9'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:03.864569 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-1ce98c0b-30f5-48d8-83b9-50008834ae3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eea2191e0c5d4fceb7f431929923d9d9'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:03.875447 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-1ce98c0b-30f5-48d8-83b9-50008834ae3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eea2191e0c5d4fceb7f431929923d9d9'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:03.898138 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1298/2637] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:10:03 2022] DELETE /identity/v3/users/eea2191e0c5d4fceb7f431929923d9d9 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:10:03.905494 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb769493-6dd6-429e-bb28-eb82ba9ec314 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:03.906036 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb769493-6dd6-429e-bb28-eb82ba9ec314 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:03.906266 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb769493-6dd6-429e-bb28-eb82ba9ec314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:03.927624 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-fb769493-6dd6-429e-bb28-eb82ba9ec314 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:10:03.928889 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-fb769493-6dd6-429e-bb28-eb82ba9ec314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:03.992336 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1340/2638] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:10:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:10:04.003948 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce98c0b-30f5-48d8-83b9-50008834ae3f admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:04.005287 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-1ce98c0b-30f5-48d8-83b9-50008834ae3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:04.074514 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce98c0b-30f5-48d8-83b9-50008834ae3f admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:04.078706 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2142c3a0-d8e9-4b1c-b5a9-a9a8f1a9ca36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:04.079340 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2142c3a0-d8e9-4b1c-b5a9-a9a8f1a9ca36 service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:04.079620 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2142c3a0-d8e9-4b1c-b5a9-a9a8f1a9ca36 service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:04.079893 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2142c3a0-d8e9-4b1c-b5a9-a9a8f1a9ca36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:04.090259 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2142c3a0-d8e9-4b1c-b5a9-a9a8f1a9ca36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:04.092126 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2142c3a0-d8e9-4b1c-b5a9-a9a8f1a9ca36 service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:04.102383 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1299/2639] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:10:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 11:10:04.384283 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb769493-6dd6-429e-bb28-eb82ba9ec314 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:04.386149 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-fb769493-6dd6-429e-bb28-eb82ba9ec314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:04.408351 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb769493-6dd6-429e-bb28-eb82ba9ec314 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:04.417586 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc40ab5b-22f9-4b63-922f-10ba91520296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:04.420213 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc40ab5b-22f9-4b63-922f-10ba91520296 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:04.420213 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc40ab5b-22f9-4b63-922f-10ba91520296 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:04.421057 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc40ab5b-22f9-4b63-922f-10ba91520296 admin admin] PATH_INFO: `/v3/projects/8621d28bbd22458192a023db5d543ebc` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:04.422517 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc40ab5b-22f9-4b63-922f-10ba91520296 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8621d28bbd22458192a023db5d543ebc)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:04.424611 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc40ab5b-22f9-4b63-922f-10ba91520296 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:04.486587 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-cc40ab5b-22f9-4b63-922f-10ba91520296 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8621d28bbd22458192a023db5d543ebc', 'request_id': 'req-cc40ab5b-22f9-4b63-922f-10ba91520296'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:04.498821 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-cc40ab5b-22f9-4b63-922f-10ba91520296 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8621d28bbd22458192a023db5d543ebc', 'request_id': 'req-cc40ab5b-22f9-4b63-922f-10ba91520296'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:04.500887 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:04.505951 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-cc40ab5b-22f9-4b63-922f-10ba91520296 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8621d28bbd22458192a023db5d543ebc', 'request_id': 'req-cc40ab5b-22f9-4b63-922f-10ba91520296'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:04.521730 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-cc40ab5b-22f9-4b63-922f-10ba91520296 admin admin] The token cache is being invalidate because project 8621d28bbd22458192a023db5d543ebc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:10:04.522020 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-cc40ab5b-22f9-4b63-922f-10ba91520296 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:04.522701 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-cc40ab5b-22f9-4b63-922f-10ba91520296 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:04.524184 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1341/2640] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:10:04 2022] DELETE /identity/v3/projects/8621d28bbd22458192a023db5d543ebc => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:10:04.528837 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2142c3a0-d8e9-4b1c-b5a9-a9a8f1a9ca36 service neutron] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:04.539571 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2142c3a0-d8e9-4b1c-b5a9-a9a8f1a9ca36 service neutron] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:04.600976 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b1720b-a4a9-4ee4-ad2a-2852517eb570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:04.601609 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1720b-a4a9-4ee4-ad2a-2852517eb570 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:04.601897 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1720b-a4a9-4ee4-ad2a-2852517eb570 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:04.602264 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1720b-a4a9-4ee4-ad2a-2852517eb570 admin admin] PATH_INFO: `/v3/users/f624180f7bb24cf5a8ff423a561e8351` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:04.603295 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b1720b-a4a9-4ee4-ad2a-2852517eb570 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f624180f7bb24cf5a8ff423a561e8351)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:04.605210 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b1720b-a4a9-4ee4-ad2a-2852517eb570 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:04.618440 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:04.655103 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-12b1720b-a4a9-4ee4-ad2a-2852517eb570 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f624180f7bb24cf5a8ff423a561e8351'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:04.662237 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-12b1720b-a4a9-4ee4-ad2a-2852517eb570 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f624180f7bb24cf5a8ff423a561e8351'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:04.662849 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-12b1720b-a4a9-4ee4-ad2a-2852517eb570 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f624180f7bb24cf5a8ff423a561e8351'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:04.663462 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-12b1720b-a4a9-4ee4-ad2a-2852517eb570 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f624180f7bb24cf5a8ff423a561e8351'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:04.671865 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-12b1720b-a4a9-4ee4-ad2a-2852517eb570 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f624180f7bb24cf5a8ff423a561e8351'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:04.690880 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1300/2641] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:10:04 2022] DELETE /identity/v3/users/f624180f7bb24cf5a8ff423a561e8351 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:10:05.001217 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc40ab5b-22f9-4b63-922f-10ba91520296 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:05.003004 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-cc40ab5b-22f9-4b63-922f-10ba91520296 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:05.026706 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc40ab5b-22f9-4b63-922f-10ba91520296 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:05.086804 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a16468e-82b4-4e13-b276-be17c11a6630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:05.087435 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a16468e-82b4-4e13-b276-be17c11a6630 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:05.087711 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a16468e-82b4-4e13-b276-be17c11a6630 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:05.087986 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a16468e-82b4-4e13-b276-be17c11a6630 admin admin] PATH_INFO: `/v3/projects/e64e5606f5b346a78959a283fda931fd` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:05.089102 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a16468e-82b4-4e13-b276-be17c11a6630 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e64e5606f5b346a78959a283fda931fd)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:05.091831 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a16468e-82b4-4e13-b276-be17c11a6630 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:05.141548 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-3a16468e-82b4-4e13-b276-be17c11a6630 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e64e5606f5b346a78959a283fda931fd', 'request_id': 'req-3a16468e-82b4-4e13-b276-be17c11a6630'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:05.149042 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-3a16468e-82b4-4e13-b276-be17c11a6630 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e64e5606f5b346a78959a283fda931fd', 'request_id': 'req-3a16468e-82b4-4e13-b276-be17c11a6630'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:05.155907 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-3a16468e-82b4-4e13-b276-be17c11a6630 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e64e5606f5b346a78959a283fda931fd', 'request_id': 'req-3a16468e-82b4-4e13-b276-be17c11a6630'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:05.166400 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-3a16468e-82b4-4e13-b276-be17c11a6630 admin admin] The token cache is being invalidate because project e64e5606f5b346a78959a283fda931fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:10:05.166691 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-3a16468e-82b4-4e13-b276-be17c11a6630 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:05.167332 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-3a16468e-82b4-4e13-b276-be17c11a6630 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:05.168892 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1342/2642] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:10:04 2022] DELETE /identity/v3/projects/e64e5606f5b346a78959a283fda931fd => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:10:05.174037 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49ff5dd-781d-4f61-a9a3-2d3e294c8247 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:05.174548 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49ff5dd-781d-4f61-a9a3-2d3e294c8247 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:05.174649 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49ff5dd-781d-4f61-a9a3-2d3e294c8247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:05.195960 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-b49ff5dd-781d-4f61-a9a3-2d3e294c8247 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:10:05.197153 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-b49ff5dd-781d-4f61-a9a3-2d3e294c8247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:05.272134 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1301/2643] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:10:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:10:05.281427 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e5759f-0933-408a-b9ca-71e3c54bc915 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:05.281804 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e5759f-0933-408a-b9ca-71e3c54bc915 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:05.282091 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e5759f-0933-408a-b9ca-71e3c54bc915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:05.302653 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-66e5759f-0933-408a-b9ca-71e3c54bc915 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:10:05.303804 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-66e5759f-0933-408a-b9ca-71e3c54bc915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:05.312553 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1343/2644] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:10:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:10:05.316913 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49ff5dd-781d-4f61-a9a3-2d3e294c8247 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:05.327384 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49ff5dd-781d-4f61-a9a3-2d3e294c8247 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:05.331922 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e1f195-eb1c-449d-ae86-ab352c78ae13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:05.332522 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e1f195-eb1c-449d-ae86-ab352c78ae13 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:05.332795 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e1f195-eb1c-449d-ae86-ab352c78ae13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:05.333067 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e1f195-eb1c-449d-ae86-ab352c78ae13 admin admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:05.333775 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e1f195-eb1c-449d-ae86-ab352c78ae13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:05.334072 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e1f195-eb1c-449d-ae86-ab352c78ae13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:05.335665 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e1f195-eb1c-449d-ae86-ab352c78ae13 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:05.350543 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1302/2645] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Aug 18 11:10:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:05.355135 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e5759f-0933-408a-b9ca-71e3c54bc915 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:05.365295 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e5759f-0933-408a-b9ca-71e3c54bc915 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:05.370047 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc667449-c154-4aaf-9c16-e2d74d487ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:05.370652 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc667449-c154-4aaf-9c16-e2d74d487ef1 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:05.370933 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc667449-c154-4aaf-9c16-e2d74d487ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:05.371209 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc667449-c154-4aaf-9c16-e2d74d487ef1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:05.371877 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc667449-c154-4aaf-9c16-e2d74d487ef1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:05.374459 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc667449-c154-4aaf-9c16-e2d74d487ef1 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:05.407058 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1344/2646] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:10:05 2022] POST /identity/v3/projects => generated 391 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:10:05.408484 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e1f195-eb1c-449d-ae86-ab352c78ae13 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:05.418396 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e1f195-eb1c-449d-ae86-ab352c78ae13 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:05.479895 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e792f02-edb6-4563-b433-8366fed31072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:05.480504 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e792f02-edb6-4563-b433-8366fed31072 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:05.480786 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e792f02-edb6-4563-b433-8366fed31072 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:05.481211 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e792f02-edb6-4563-b433-8366fed31072 admin admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:05.482430 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e792f02-edb6-4563-b433-8366fed31072 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:05.484369 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e792f02-edb6-4563-b433-8366fed31072 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:05.509928 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1303/2647] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:10:05 2022] POST /identity/v3/users => generated 296 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 11:10:05.511009 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc667449-c154-4aaf-9c16-e2d74d487ef1 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:05.523760 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc667449-c154-4aaf-9c16-e2d74d487ef1 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:05.530093 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159bc1fc-922f-494e-9f73-00727652ba81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:05.530723 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159bc1fc-922f-494e-9f73-00727652ba81 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:05.531022 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159bc1fc-922f-494e-9f73-00727652ba81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:05.531278 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159bc1fc-922f-494e-9f73-00727652ba81 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:05.531933 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159bc1fc-922f-494e-9f73-00727652ba81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:05.533558 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159bc1fc-922f-494e-9f73-00727652ba81 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:05.546248 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1345/2648] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:10:05 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 11:10:05.550510 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e792f02-edb6-4563-b433-8366fed31072 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:05.561582 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e792f02-edb6-4563-b433-8366fed31072 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:05.569613 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704e3702-e927-4a11-b162-8c83f4d8cc8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:05.570239 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704e3702-e927-4a11-b162-8c83f4d8cc8d admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:05.570519 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704e3702-e927-4a11-b162-8c83f4d8cc8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:05.570791 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704e3702-e927-4a11-b162-8c83f4d8cc8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:05.571436 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704e3702-e927-4a11-b162-8c83f4d8cc8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:05.573091 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704e3702-e927-4a11-b162-8c83f4d8cc8d admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:05.574634 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:05.590756 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1304/2649] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:10:05 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:10:05.593113 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159bc1fc-922f-494e-9f73-00727652ba81 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:05.603421 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159bc1fc-922f-494e-9f73-00727652ba81 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:05.608449 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f90806-f08a-44b8-b373-af5c646291cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:05.609107 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f90806-f08a-44b8-b373-af5c646291cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:05.609383 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f90806-f08a-44b8-b373-af5c646291cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:05.609712 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f90806-f08a-44b8-b373-af5c646291cc admin admin] PATH_INFO: `/v3/projects/178340866c4c40f18adc6e1059c4587f/users/5c2fa81999954a71955ab4890d3afd6e/roles/719e5c62188d4f8a838987d6e72ca8f7` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:05.626877 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f90806-f08a-44b8-b373-af5c646291cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=178340866c4c40f18adc6e1059c4587f, user_id=5c2fa81999954a71955ab4890d3afd6e, role_id=719e5c62188d4f8a838987d6e72ca8f7)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:05.629738 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f90806-f08a-44b8-b373-af5c646291cc admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:05.647382 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1346/2650] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:10:05 2022] PUT /identity/v3/projects/178340866c4c40f18adc6e1059c4587f/users/5c2fa81999954a71955ab4890d3afd6e/roles/719e5c62188d4f8a838987d6e72ca8f7 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:10:05.659062 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9811d77-82cb-49e9-b8de-475427c9b56a None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:05.659576 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9811d77-82cb-49e9-b8de-475427c9b56a None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:05.659867 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9811d77-82cb-49e9-b8de-475427c9b56a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:05.690742 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-f9811d77-82cb-49e9-b8de-475427c9b56a None None] MFA Rules not processed for user `5c2fa81999954a71955ab4890d3afd6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:10:05.691981 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-f9811d77-82cb-49e9-b8de-475427c9b56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:05.760932 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1305/2651] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:10:05 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:10:05.766290 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f90806-f08a-44b8-b373-af5c646291cc admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:05.781103 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:05.836229 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f90806-f08a-44b8-b373-af5c646291cc admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:05.841324 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f626d1-2af1-446c-b63b-fb6e9f418197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:05.841971 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f626d1-2af1-446c-b63b-fb6e9f418197 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:05.842261 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f626d1-2af1-446c-b63b-fb6e9f418197 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:05.842536 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f626d1-2af1-446c-b63b-fb6e9f418197 admin admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:05.843179 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f626d1-2af1-446c-b63b-fb6e9f418197 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:05.845073 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f626d1-2af1-446c-b63b-fb6e9f418197 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:05.874441 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1347/2652] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:10:05 2022] POST /identity/v3/projects => generated 391 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:10:05.878606 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9811d77-82cb-49e9-b8de-475427c9b56a None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:05.889638 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9811d77-82cb-49e9-b8de-475427c9b56a None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:05.947522 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34a63e8-5652-44cc-b9cc-8f4270034af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:05.948129 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a63e8-5652-44cc-b9cc-8f4270034af3 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:05.948410 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a63e8-5652-44cc-b9cc-8f4270034af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:05.948685 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a63e8-5652-44cc-b9cc-8f4270034af3 admin admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:05.949306 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34a63e8-5652-44cc-b9cc-8f4270034af3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:05.951435 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34a63e8-5652-44cc-b9cc-8f4270034af3 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:05.972321 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1306/2653] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:10:05 2022] POST /identity/v3/users => generated 302 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 11:10:05.976168 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f626d1-2af1-446c-b63b-fb6e9f418197 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:05.987318 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f626d1-2af1-446c-b63b-fb6e9f418197 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:05.992583 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e526da-ed7b-4f20-ad5e-6259270a7b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:05.993187 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e526da-ed7b-4f20-ad5e-6259270a7b1d admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:05.993469 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e526da-ed7b-4f20-ad5e-6259270a7b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:05.993771 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e526da-ed7b-4f20-ad5e-6259270a7b1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:05.994441 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e526da-ed7b-4f20-ad5e-6259270a7b1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:05.996040 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e526da-ed7b-4f20-ad5e-6259270a7b1d admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:06.007544 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1348/2654] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:10:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:10:06.011687 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34a63e8-5652-44cc-b9cc-8f4270034af3 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:06.021982 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34a63e8-5652-44cc-b9cc-8f4270034af3 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:06.026705 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a4075d-54fa-49e4-a954-4e84025f7086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:06.027377 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a4075d-54fa-49e4-a954-4e84025f7086 admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:06.027660 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a4075d-54fa-49e4-a954-4e84025f7086 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:06.027987 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a4075d-54fa-49e4-a954-4e84025f7086 admin admin] PATH_INFO: `/v3/projects/5816d04fa54140b6a87ff1af81956f93/users/e7b534ed4ad84ed9829f7723afe76db7/roles/127fdc7ef05b4e0b98a940b334e5fcab` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:06.045400 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a4075d-54fa-49e4-a954-4e84025f7086 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5816d04fa54140b6a87ff1af81956f93, user_id=e7b534ed4ad84ed9829f7723afe76db7, role_id=127fdc7ef05b4e0b98a940b334e5fcab)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:06.048146 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a4075d-54fa-49e4-a954-4e84025f7086 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:06.062854 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1307/2655] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:10:06 2022] PUT /identity/v3/projects/5816d04fa54140b6a87ff1af81956f93/users/e7b534ed4ad84ed9829f7723afe76db7/roles/127fdc7ef05b4e0b98a940b334e5fcab => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:10:06.067785 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e526da-ed7b-4f20-ad5e-6259270a7b1d admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:06.078480 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e526da-ed7b-4f20-ad5e-6259270a7b1d admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:06.138731 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fdc6fe-95d9-4223-bdec-5cd5bb12fea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:06.139257 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fdc6fe-95d9-4223-bdec-5cd5bb12fea0 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:06.139539 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fdc6fe-95d9-4223-bdec-5cd5bb12fea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:06.139918 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fdc6fe-95d9-4223-bdec-5cd5bb12fea0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:06.140463 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fdc6fe-95d9-4223-bdec-5cd5bb12fea0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:06.142194 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fdc6fe-95d9-4223-bdec-5cd5bb12fea0 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:06.152656 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1349/2656] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:10:06 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:10:06.157639 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a4075d-54fa-49e4-a954-4e84025f7086 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:06.168225 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a4075d-54fa-49e4-a954-4e84025f7086 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:06.174601 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac4ee03-6296-4b7e-be53-f7485e4163bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:06.175295 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac4ee03-6296-4b7e-be53-f7485e4163bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:06.175569 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac4ee03-6296-4b7e-be53-f7485e4163bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:06.175861 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac4ee03-6296-4b7e-be53-f7485e4163bc admin admin] PATH_INFO: `/v3/projects/5816d04fa54140b6a87ff1af81956f93/users/e7b534ed4ad84ed9829f7723afe76db7/roles/127fdc7ef05b4e0b98a940b334e5fcab` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:06.177867 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac4ee03-6296-4b7e-be53-f7485e4163bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5816d04fa54140b6a87ff1af81956f93, user_id=e7b534ed4ad84ed9829f7723afe76db7, role_id=127fdc7ef05b4e0b98a940b334e5fcab)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:06.180546 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac4ee03-6296-4b7e-be53-f7485e4163bc admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:06.192780 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1308/2657] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:10:06 2022] PUT /identity/v3/projects/5816d04fa54140b6a87ff1af81956f93/users/e7b534ed4ad84ed9829f7723afe76db7/roles/127fdc7ef05b4e0b98a940b334e5fcab => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:10:06.205025 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9326dbb1-d4f5-485a-912f-7a619b5cea0a None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:06.205311 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9326dbb1-d4f5-485a-912f-7a619b5cea0a None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:06.205618 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9326dbb1-d4f5-485a-912f-7a619b5cea0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:06.235687 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-9326dbb1-d4f5-485a-912f-7a619b5cea0a None None] MFA Rules not processed for user `e7b534ed4ad84ed9829f7723afe76db7`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:10:06.236937 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-9326dbb1-d4f5-485a-912f-7a619b5cea0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:06.305338 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1350/2658] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:10:06 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:10:06.316324 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac4ee03-6296-4b7e-be53-f7485e4163bc admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:06.318080 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-cac4ee03-6296-4b7e-be53-f7485e4163bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:06.361636 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:06.377719 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac4ee03-6296-4b7e-be53-f7485e4163bc admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:06.381372 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57a085d-acf2-403f-b281-0593f3a82e56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b8a09704b9b4ab2bffb813796ec6e77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:06.382003 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a085d-acf2-403f-b281-0593f3a82e56 service cinder] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:06.382284 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a085d-acf2-403f-b281-0593f3a82e56 service cinder] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:06.382555 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a085d-acf2-403f-b281-0593f3a82e56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:06.392249 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57a085d-acf2-403f-b281-0593f3a82e56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:06.393637 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57a085d-acf2-403f-b281-0593f3a82e56 service cinder] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:06.403644 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1309/2659] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:10:06 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:10:06.452224 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9326dbb1-d4f5-485a-912f-7a619b5cea0a None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:06.453637 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-9326dbb1-d4f5-485a-912f-7a619b5cea0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:06.466659 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9326dbb1-d4f5-485a-912f-7a619b5cea0a None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:06.469658 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b5e214-a5f2-4f39-b0a9-007543d82fa7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b8a09704b9b4ab2bffb813796ec6e77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:06.470256 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b5e214-a5f2-4f39-b0a9-007543d82fa7 service cinder] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:06.470533 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b5e214-a5f2-4f39-b0a9-007543d82fa7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:06.470804 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b5e214-a5f2-4f39-b0a9-007543d82fa7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:06.476128 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:06.529369 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b5e214-a5f2-4f39-b0a9-007543d82fa7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:06.530845 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b5e214-a5f2-4f39-b0a9-007543d82fa7 service cinder] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:06.539867 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1351/2660] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:10:06 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:10:09.948291 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57a085d-acf2-403f-b281-0593f3a82e56 service cinder] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:10.024519 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57a085d-acf2-403f-b281-0593f3a82e56 service cinder] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:10.029435 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0523e4-9e58-4605-afd8-0fc76b6a8b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:10.030132 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0523e4-9e58-4605-afd8-0fc76b6a8b57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:10.030411 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0523e4-9e58-4605-afd8-0fc76b6a8b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:10.030688 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0523e4-9e58-4605-afd8-0fc76b6a8b57 admin admin] PATH_INFO: `/v3/users/5c2fa81999954a71955ab4890d3afd6e` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:10.032091 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0523e4-9e58-4605-afd8-0fc76b6a8b57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c2fa81999954a71955ab4890d3afd6e)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:10.034281 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0523e4-9e58-4605-afd8-0fc76b6a8b57 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:10.081837 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-bf0523e4-9e58-4605-afd8-0fc76b6a8b57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c2fa81999954a71955ab4890d3afd6e'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:10.089189 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-bf0523e4-9e58-4605-afd8-0fc76b6a8b57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c2fa81999954a71955ab4890d3afd6e'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:10.089831 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-bf0523e4-9e58-4605-afd8-0fc76b6a8b57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c2fa81999954a71955ab4890d3afd6e'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:10.091044 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-bf0523e4-9e58-4605-afd8-0fc76b6a8b57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c2fa81999954a71955ab4890d3afd6e'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:10.098034 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-bf0523e4-9e58-4605-afd8-0fc76b6a8b57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c2fa81999954a71955ab4890d3afd6e'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:10.115654 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1310/2661] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:10:09 2022] DELETE /identity/v3/users/5c2fa81999954a71955ab4890d3afd6e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:10:10.120300 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4397e573-e41b-495b-b88e-b0ca410a4d43 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:10.120763 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4397e573-e41b-495b-b88e-b0ca410a4d43 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:10.120880 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4397e573-e41b-495b-b88e-b0ca410a4d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:10.141750 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-4397e573-e41b-495b-b88e-b0ca410a4d43 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:10:10.142935 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-4397e573-e41b-495b-b88e-b0ca410a4d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:10.204241 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1352/2662] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:10:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:10:10.214908 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0523e4-9e58-4605-afd8-0fc76b6a8b57 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:10.217354 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-bf0523e4-9e58-4605-afd8-0fc76b6a8b57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:10.284406 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0523e4-9e58-4605-afd8-0fc76b6a8b57 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:10.288264 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd347aa4-9069-4909-bfa5-1a96d2521d27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:10.288886 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd347aa4-9069-4909-bfa5-1a96d2521d27 service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:10.289162 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd347aa4-9069-4909-bfa5-1a96d2521d27 service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:10.289437 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd347aa4-9069-4909-bfa5-1a96d2521d27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:10.299932 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd347aa4-9069-4909-bfa5-1a96d2521d27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:10.301471 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd347aa4-9069-4909-bfa5-1a96d2521d27 service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:10.313306 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1311/2663] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:10:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:10:10.585569 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4397e573-e41b-495b-b88e-b0ca410a4d43 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:10.587087 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-4397e573-e41b-495b-b88e-b0ca410a4d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:10.600183 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4397e573-e41b-495b-b88e-b0ca410a4d43 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:10.606798 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a521983-8074-453a-b769-5eca14a7e57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:10.607675 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a521983-8074-453a-b769-5eca14a7e57f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:10.607990 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a521983-8074-453a-b769-5eca14a7e57f admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:10.608223 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a521983-8074-453a-b769-5eca14a7e57f admin admin] PATH_INFO: `/v3/projects/178340866c4c40f18adc6e1059c4587f` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:10.609950 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a521983-8074-453a-b769-5eca14a7e57f admin admin] RBAC: Authorizing `identity:delete_project(project_id=178340866c4c40f18adc6e1059c4587f)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:10.612071 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a521983-8074-453a-b769-5eca14a7e57f admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:10.661389 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-0a521983-8074-453a-b769-5eca14a7e57f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '178340866c4c40f18adc6e1059c4587f', 'request_id': 'req-0a521983-8074-453a-b769-5eca14a7e57f'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:10.669694 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-0a521983-8074-453a-b769-5eca14a7e57f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '178340866c4c40f18adc6e1059c4587f', 'request_id': 'req-0a521983-8074-453a-b769-5eca14a7e57f'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:10.676241 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-0a521983-8074-453a-b769-5eca14a7e57f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '178340866c4c40f18adc6e1059c4587f', 'request_id': 'req-0a521983-8074-453a-b769-5eca14a7e57f'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:10.687507 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-0a521983-8074-453a-b769-5eca14a7e57f admin admin] The token cache is being invalidate because project 178340866c4c40f18adc6e1059c4587f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:10:10.687791 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-0a521983-8074-453a-b769-5eca14a7e57f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:10.688455 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-0a521983-8074-453a-b769-5eca14a7e57f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:10.689990 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1353/2664] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:10:10 2022] DELETE /identity/v3/projects/178340866c4c40f18adc6e1059c4587f => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:10:10.694115 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd347aa4-9069-4909-bfa5-1a96d2521d27 service neutron] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:10.699263 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:10.706045 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd347aa4-9069-4909-bfa5-1a96d2521d27 service neutron] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:10.772689 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aa08cb-a7f2-4613-990f-26ab2ca58267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:10.773335 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aa08cb-a7f2-4613-990f-26ab2ca58267 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:10.773655 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aa08cb-a7f2-4613-990f-26ab2ca58267 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:10.773953 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aa08cb-a7f2-4613-990f-26ab2ca58267 admin admin] PATH_INFO: `/v3/users/e7b534ed4ad84ed9829f7723afe76db7` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:10.775200 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aa08cb-a7f2-4613-990f-26ab2ca58267 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7b534ed4ad84ed9829f7723afe76db7)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:10.777122 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aa08cb-a7f2-4613-990f-26ab2ca58267 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:10.830693 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-08aa08cb-a7f2-4613-990f-26ab2ca58267 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7b534ed4ad84ed9829f7723afe76db7'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:10.839526 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-08aa08cb-a7f2-4613-990f-26ab2ca58267 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7b534ed4ad84ed9829f7723afe76db7'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:10.840803 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-08aa08cb-a7f2-4613-990f-26ab2ca58267 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7b534ed4ad84ed9829f7723afe76db7'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:10.841588 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-08aa08cb-a7f2-4613-990f-26ab2ca58267 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7b534ed4ad84ed9829f7723afe76db7'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:10.849370 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-08aa08cb-a7f2-4613-990f-26ab2ca58267 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7b534ed4ad84ed9829f7723afe76db7'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:10.868613 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1312/2665] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:10:10 2022] DELETE /identity/v3/users/e7b534ed4ad84ed9829f7723afe76db7 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:10:11.151185 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a521983-8074-453a-b769-5eca14a7e57f admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:11.152704 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-0a521983-8074-453a-b769-5eca14a7e57f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:11.166132 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a521983-8074-453a-b769-5eca14a7e57f admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:11.196048 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:11.228029 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad13224-64dc-460e-97e9-3aa02ccc3d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:11.228661 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad13224-64dc-460e-97e9-3aa02ccc3d10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:11.228941 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad13224-64dc-460e-97e9-3aa02ccc3d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:11.229211 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad13224-64dc-460e-97e9-3aa02ccc3d10 admin admin] PATH_INFO: `/v3/projects/5816d04fa54140b6a87ff1af81956f93` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:11.230370 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad13224-64dc-460e-97e9-3aa02ccc3d10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5816d04fa54140b6a87ff1af81956f93)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:11.232438 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad13224-64dc-460e-97e9-3aa02ccc3d10 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:11.277387 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-1ad13224-64dc-460e-97e9-3aa02ccc3d10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5816d04fa54140b6a87ff1af81956f93', 'request_id': 'req-1ad13224-64dc-460e-97e9-3aa02ccc3d10'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:11.285054 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-1ad13224-64dc-460e-97e9-3aa02ccc3d10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5816d04fa54140b6a87ff1af81956f93', 'request_id': 'req-1ad13224-64dc-460e-97e9-3aa02ccc3d10'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:11.291367 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-1ad13224-64dc-460e-97e9-3aa02ccc3d10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5816d04fa54140b6a87ff1af81956f93', 'request_id': 'req-1ad13224-64dc-460e-97e9-3aa02ccc3d10'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:11.301986 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-1ad13224-64dc-460e-97e9-3aa02ccc3d10 admin admin] The token cache is being invalidate because project 5816d04fa54140b6a87ff1af81956f93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:10:11.302277 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-1ad13224-64dc-460e-97e9-3aa02ccc3d10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:11.302920 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-1ad13224-64dc-460e-97e9-3aa02ccc3d10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:11.304383 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1354/2666] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:10:11 2022] DELETE /identity/v3/projects/5816d04fa54140b6a87ff1af81956f93 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:10:11.310781 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950a1341-8093-421e-bd99-a2b4fbe9c0f0 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:11.311249 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950a1341-8093-421e-bd99-a2b4fbe9c0f0 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:11.311360 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950a1341-8093-421e-bd99-a2b4fbe9c0f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:11.331998 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-950a1341-8093-421e-bd99-a2b4fbe9c0f0 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:10:11.333266 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-950a1341-8093-421e-bd99-a2b4fbe9c0f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:11.398481 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1313/2667] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:10:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:10:11.407615 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12224c26-eac7-437e-aa0e-850cb3e91912 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:11.407920 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12224c26-eac7-437e-aa0e-850cb3e91912 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:11.408192 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12224c26-eac7-437e-aa0e-850cb3e91912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:11.429182 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-12224c26-eac7-437e-aa0e-850cb3e91912 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:10:11.430442 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-12224c26-eac7-437e-aa0e-850cb3e91912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:11.439284 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1355/2668] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:10:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:10:11.443600 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950a1341-8093-421e-bd99-a2b4fbe9c0f0 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:11.454498 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950a1341-8093-421e-bd99-a2b4fbe9c0f0 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:11.459125 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be13c09-dc86-4e11-993f-a46f35f95158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:11.459728 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be13c09-dc86-4e11-993f-a46f35f95158 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:11.460008 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be13c09-dc86-4e11-993f-a46f35f95158 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:11.460284 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be13c09-dc86-4e11-993f-a46f35f95158 admin admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:11.460932 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be13c09-dc86-4e11-993f-a46f35f95158 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:11.461237 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be13c09-dc86-4e11-993f-a46f35f95158 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:11.462969 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be13c09-dc86-4e11-993f-a46f35f95158 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:11.477450 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1314/2669] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Aug 18 11:10:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:11.481643 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12224c26-eac7-437e-aa0e-850cb3e91912 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:11.493302 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12224c26-eac7-437e-aa0e-850cb3e91912 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:11.499019 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae123b41-a07a-41bd-8e5b-3bd28170f145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:11.499639 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae123b41-a07a-41bd-8e5b-3bd28170f145 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:11.499918 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae123b41-a07a-41bd-8e5b-3bd28170f145 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:11.500190 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae123b41-a07a-41bd-8e5b-3bd28170f145 admin admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:11.500843 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae123b41-a07a-41bd-8e5b-3bd28170f145 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:11.502926 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae123b41-a07a-41bd-8e5b-3bd28170f145 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:11.532926 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1356/2670] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:10:11 2022] POST /identity/v3/projects => generated 399 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:10:11.537209 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be13c09-dc86-4e11-993f-a46f35f95158 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:11.550032 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be13c09-dc86-4e11-993f-a46f35f95158 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:11.555105 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:11.611948 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3589851-2fbe-4ec9-b282-40e2434bab4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:11.612446 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3589851-2fbe-4ec9-b282-40e2434bab4e admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:11.612723 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3589851-2fbe-4ec9-b282-40e2434bab4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:11.612991 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3589851-2fbe-4ec9-b282-40e2434bab4e admin admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:11.613648 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3589851-2fbe-4ec9-b282-40e2434bab4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:11.615553 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3589851-2fbe-4ec9-b282-40e2434bab4e admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:11.638885 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1315/2671] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:10:11 2022] POST /identity/v3/users => generated 300 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:10:11.643405 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae123b41-a07a-41bd-8e5b-3bd28170f145 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:11.654875 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae123b41-a07a-41bd-8e5b-3bd28170f145 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:11.659720 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb41da-cb0f-4423-9d91-cdb3a1115a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:11.660316 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb41da-cb0f-4423-9d91-cdb3a1115a6f admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:11.660595 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb41da-cb0f-4423-9d91-cdb3a1115a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:11.660890 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb41da-cb0f-4423-9d91-cdb3a1115a6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:11.661541 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfb41da-cb0f-4423-9d91-cdb3a1115a6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:11.663183 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfb41da-cb0f-4423-9d91-cdb3a1115a6f admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:11.673883 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1357/2672] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:10:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:10:11.678094 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3589851-2fbe-4ec9-b282-40e2434bab4e admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:11.689094 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3589851-2fbe-4ec9-b282-40e2434bab4e admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:11.693730 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7f8f04-7b1e-42d7-931b-c25ada97bb31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:11.694319 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f8f04-7b1e-42d7-931b-c25ada97bb31 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:11.694604 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f8f04-7b1e-42d7-931b-c25ada97bb31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:11.694871 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f8f04-7b1e-42d7-931b-c25ada97bb31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:11.695503 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7f8f04-7b1e-42d7-931b-c25ada97bb31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:11.697082 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7f8f04-7b1e-42d7-931b-c25ada97bb31 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:11.708597 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1316/2673] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:10:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:10:11.712672 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb41da-cb0f-4423-9d91-cdb3a1115a6f admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:11.723021 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb41da-cb0f-4423-9d91-cdb3a1115a6f admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:11.727564 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11eb470-fba8-43ec-8728-3ca0efb75276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:11.728257 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11eb470-fba8-43ec-8728-3ca0efb75276 admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:11.728532 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11eb470-fba8-43ec-8728-3ca0efb75276 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:11.728799 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11eb470-fba8-43ec-8728-3ca0efb75276 admin admin] PATH_INFO: `/v3/projects/34c62d1a1eef4e08b2399a53ae3f0e10/users/5866cdf1f7904a4092238ac1be0d6c22/roles/719e5c62188d4f8a838987d6e72ca8f7` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:11.743001 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11eb470-fba8-43ec-8728-3ca0efb75276 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34c62d1a1eef4e08b2399a53ae3f0e10, user_id=5866cdf1f7904a4092238ac1be0d6c22, role_id=719e5c62188d4f8a838987d6e72ca8f7)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:11.745631 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11eb470-fba8-43ec-8728-3ca0efb75276 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:11.759374 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1358/2674] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:10:11 2022] PUT /identity/v3/projects/34c62d1a1eef4e08b2399a53ae3f0e10/users/5866cdf1f7904a4092238ac1be0d6c22/roles/719e5c62188d4f8a838987d6e72ca8f7 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:10:11.771417 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d647bd4c-dde4-4e1e-9672-def330825a22 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:11.771705 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d647bd4c-dde4-4e1e-9672-def330825a22 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:11.771982 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d647bd4c-dde4-4e1e-9672-def330825a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:11.801363 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-d647bd4c-dde4-4e1e-9672-def330825a22 None None] MFA Rules not processed for user `5866cdf1f7904a4092238ac1be0d6c22`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:10:11.802627 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-d647bd4c-dde4-4e1e-9672-def330825a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:11.873127 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1317/2675] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:10:11 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:10:11.877506 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11eb470-fba8-43ec-8728-3ca0efb75276 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:11.936950 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:11.940622 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11eb470-fba8-43ec-8728-3ca0efb75276 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:11.947260 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd40909-d50f-4f7d-8a5b-9c512d522597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:11.948063 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd40909-d50f-4f7d-8a5b-9c512d522597 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:11.948531 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd40909-d50f-4f7d-8a5b-9c512d522597 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:11.948868 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd40909-d50f-4f7d-8a5b-9c512d522597 admin admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:11.949728 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd40909-d50f-4f7d-8a5b-9c512d522597 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:11.952014 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd40909-d50f-4f7d-8a5b-9c512d522597 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:11.986105 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1359/2676] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:10:11 2022] POST /identity/v3/projects => generated 399 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 11:10:11.987535 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d647bd4c-dde4-4e1e-9672-def330825a22 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:11.999351 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d647bd4c-dde4-4e1e-9672-def330825a22 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:12.059954 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f345a2e-82e5-42da-97ae-bcbdb390be84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:12.060652 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f345a2e-82e5-42da-97ae-bcbdb390be84 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:12.060933 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f345a2e-82e5-42da-97ae-bcbdb390be84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:12.061202 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f345a2e-82e5-42da-97ae-bcbdb390be84 admin admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:12.061871 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f345a2e-82e5-42da-97ae-bcbdb390be84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:12.063810 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f345a2e-82e5-42da-97ae-bcbdb390be84 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:12.088576 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1318/2677] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:10:11 2022] POST /identity/v3/users => generated 306 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:10:12.089963 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd40909-d50f-4f7d-8a5b-9c512d522597 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:12.101055 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd40909-d50f-4f7d-8a5b-9c512d522597 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:12.107022 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787a9e40-e935-4896-a81d-f9e5037fa104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:12.107781 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a9e40-e935-4896-a81d-f9e5037fa104 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:12.108064 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a9e40-e935-4896-a81d-f9e5037fa104 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:12.108339 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a9e40-e935-4896-a81d-f9e5037fa104 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:12.108995 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787a9e40-e935-4896-a81d-f9e5037fa104 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:12.110668 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787a9e40-e935-4896-a81d-f9e5037fa104 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:12.125630 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1360/2678] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:10:12.128588 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f345a2e-82e5-42da-97ae-bcbdb390be84 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:12.139720 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f345a2e-82e5-42da-97ae-bcbdb390be84 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:12.144753 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331b825f-cf0d-418f-bde8-87794e331b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:12.145490 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b825f-cf0d-418f-bde8-87794e331b37 admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:12.145871 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b825f-cf0d-418f-bde8-87794e331b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:12.146161 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b825f-cf0d-418f-bde8-87794e331b37 admin admin] PATH_INFO: `/v3/projects/1f1576ec8f404f66887952ef281961f0/users/2f491df361a848bfbe8b90eb82f21e3e/roles/127fdc7ef05b4e0b98a940b334e5fcab` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:12.148650 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:12.163680 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331b825f-cf0d-418f-bde8-87794e331b37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f1576ec8f404f66887952ef281961f0, user_id=2f491df361a848bfbe8b90eb82f21e3e, role_id=127fdc7ef05b4e0b98a940b334e5fcab)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:12.166561 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331b825f-cf0d-418f-bde8-87794e331b37 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:12.182200 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1319/2679] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:10:12 2022] PUT /identity/v3/projects/1f1576ec8f404f66887952ef281961f0/users/2f491df361a848bfbe8b90eb82f21e3e/roles/127fdc7ef05b4e0b98a940b334e5fcab => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:10:12.187689 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787a9e40-e935-4896-a81d-f9e5037fa104 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:12.197867 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787a9e40-e935-4896-a81d-f9e5037fa104 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:12.275149 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfba4be4-6fae-48e3-8ab4-32527f16650c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:12.275860 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfba4be4-6fae-48e3-8ab4-32527f16650c admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:12.276884 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfba4be4-6fae-48e3-8ab4-32527f16650c admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:12.277238 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfba4be4-6fae-48e3-8ab4-32527f16650c admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:12.278788 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfba4be4-6fae-48e3-8ab4-32527f16650c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:12.280463 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfba4be4-6fae-48e3-8ab4-32527f16650c admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:12.296213 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1361/2680] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:10:12.297583 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331b825f-cf0d-418f-bde8-87794e331b37 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:12.308553 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331b825f-cf0d-418f-bde8-87794e331b37 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:12.314303 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf5c3fb-86b2-4567-a51c-c6df6b41d35f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:12.314984 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf5c3fb-86b2-4567-a51c-c6df6b41d35f admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:12.315269 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf5c3fb-86b2-4567-a51c-c6df6b41d35f admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:12.315544 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf5c3fb-86b2-4567-a51c-c6df6b41d35f admin admin] PATH_INFO: `/v3/projects/1f1576ec8f404f66887952ef281961f0/users/2f491df361a848bfbe8b90eb82f21e3e/roles/127fdc7ef05b4e0b98a940b334e5fcab` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:12.318865 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf5c3fb-86b2-4567-a51c-c6df6b41d35f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f1576ec8f404f66887952ef281961f0, user_id=2f491df361a848bfbe8b90eb82f21e3e, role_id=127fdc7ef05b4e0b98a940b334e5fcab)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:12.321603 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf5c3fb-86b2-4567-a51c-c6df6b41d35f admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:12.332966 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1320/2681] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:10:12 2022] PUT /identity/v3/projects/1f1576ec8f404f66887952ef281961f0/users/2f491df361a848bfbe8b90eb82f21e3e/roles/127fdc7ef05b4e0b98a940b334e5fcab => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:10:12.343956 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa338a-a97f-4b57-b064-c030f8b746b2 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:12.344270 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa338a-a97f-4b57-b064-c030f8b746b2 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:12.344572 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa338a-a97f-4b57-b064-c030f8b746b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:12.375010 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-f5aa338a-a97f-4b57-b064-c030f8b746b2 None None] MFA Rules not processed for user `2f491df361a848bfbe8b90eb82f21e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:10:12.376310 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-f5aa338a-a97f-4b57-b064-c030f8b746b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:12.447331 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1362/2682] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:10:12 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:10:12.458786 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf5c3fb-86b2-4567-a51c-c6df6b41d35f admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:12.460653 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-ebf5c3fb-86b2-4567-a51c-c6df6b41d35f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:12.520695 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf5c3fb-86b2-4567-a51c-c6df6b41d35f admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:12.524319 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173e8ef5-301d-4991-80c3-54eebcc43cab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b8a09704b9b4ab2bffb813796ec6e77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:12.524919 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e8ef5-301d-4991-80c3-54eebcc43cab service cinder] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:12.525193 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e8ef5-301d-4991-80c3-54eebcc43cab service cinder] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:12.525461 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e8ef5-301d-4991-80c3-54eebcc43cab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:12.535088 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173e8ef5-301d-4991-80c3-54eebcc43cab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:12.536504 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173e8ef5-301d-4991-80c3-54eebcc43cab service cinder] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:12.546798 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1321/2683] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:10:12 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:10:12.625077 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aa338a-a97f-4b57-b064-c030f8b746b2 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:12.635365 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aa338a-a97f-4b57-b064-c030f8b746b2 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:12.639567 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b974f288-0758-49f1-9d68-c57a52ffd205 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b8a09704b9b4ab2bffb813796ec6e77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:12.640254 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b974f288-0758-49f1-9d68-c57a52ffd205 service cinder] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:12.640534 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b974f288-0758-49f1-9d68-c57a52ffd205 service cinder] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:12.640811 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b974f288-0758-49f1-9d68-c57a52ffd205 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:12.690152 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:12.700689 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b974f288-0758-49f1-9d68-c57a52ffd205 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:12.702295 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b974f288-0758-49f1-9d68-c57a52ffd205 service cinder] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:12.711321 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1363/2684] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:10:12 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:10:13.678978 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173e8ef5-301d-4991-80c3-54eebcc43cab service cinder] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:13.680606 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-173e8ef5-301d-4991-80c3-54eebcc43cab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:13.742381 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173e8ef5-301d-4991-80c3-54eebcc43cab service cinder] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:13.746029 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db77d989-e971-4957-991b-3f41b2b10ddb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:13.746694 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db77d989-e971-4957-991b-3f41b2b10ddb service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:13.746976 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db77d989-e971-4957-991b-3f41b2b10ddb service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:13.747333 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db77d989-e971-4957-991b-3f41b2b10ddb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:13.749104 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-db77d989-e971-4957-991b-3f41b2b10ddb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:13.808753 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db77d989-e971-4957-991b-3f41b2b10ddb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:13.810252 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db77d989-e971-4957-991b-3f41b2b10ddb service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:13.819900 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1322/2685] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:10:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:10:16.017845 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bb8da5-09f5-4bed-9785-ea2dc06f76f0 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:16.018326 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bb8da5-09f5-4bed-9785-ea2dc06f76f0 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:16.018536 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bb8da5-09f5-4bed-9785-ea2dc06f76f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:16.039696 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-87bb8da5-09f5-4bed-9785-ea2dc06f76f0 None None] MFA Rules not processed for user `bcacf809f13043ab90716607160a70db`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:10:16.040586 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-87bb8da5-09f5-4bed-9785-ea2dc06f76f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:16.101772 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1364/2686] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Aug 18 11:10:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:10:16.151856 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db77d989-e971-4957-991b-3f41b2b10ddb service neutron] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:16.154074 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-db77d989-e971-4957-991b-3f41b2b10ddb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:16.187196 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:16.230695 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db77d989-e971-4957-991b-3f41b2b10ddb service neutron] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:16.236140 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3822e5a8-5650-4a7c-8f9b-8c07b1f2698e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f97e906b1922419d8511ab1c8b9c86e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:16.236743 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3822e5a8-5650-4a7c-8f9b-8c07b1f2698e service swift] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:16.237038 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3822e5a8-5650-4a7c-8f9b-8c07b1f2698e service swift] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:16.237287 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3822e5a8-5650-4a7c-8f9b-8c07b1f2698e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:16.245596 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3822e5a8-5650-4a7c-8f9b-8c07b1f2698e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:16.247216 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3822e5a8-5650-4a7c-8f9b-8c07b1f2698e service swift] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:16.256079 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1323/2687] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Aug 18 11:10:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 11:10:16.815889 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f14fa-9a6d-4569-a5bf-4059ee16d023 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:16.816178 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f14fa-9a6d-4569-a5bf-4059ee16d023 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:16.816478 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f14fa-9a6d-4569-a5bf-4059ee16d023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:16.837266 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-8b6f14fa-9a6d-4569-a5bf-4059ee16d023 None None] MFA Rules not processed for user `bcacf809f13043ab90716607160a70db`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:10:16.838519 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-8b6f14fa-9a6d-4569-a5bf-4059ee16d023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:16.846204 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1365/2688] 10.222.0.15 () {58 vars in 967 bytes} [Thu Aug 18 11:10:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:10:16.859776 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3822e5a8-5650-4a7c-8f9b-8c07b1f2698e service swift] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:16.874921 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3822e5a8-5650-4a7c-8f9b-8c07b1f2698e service swift] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:16.882291 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b0e0ae-3e16-4f30-8fb6-2182f34a7e0f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f97e906b1922419d8511ab1c8b9c86e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:16.883244 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0e0ae-3e16-4f30-8fb6-2182f34a7e0f service swift] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:16.883522 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0e0ae-3e16-4f30-8fb6-2182f34a7e0f service swift] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:16.883799 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0e0ae-3e16-4f30-8fb6-2182f34a7e0f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:16.895724 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b0e0ae-3e16-4f30-8fb6-2182f34a7e0f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:16.897436 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b0e0ae-3e16-4f30-8fb6-2182f34a7e0f service swift] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:16.908114 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1324/2689] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Aug 18 11:10:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 11:10:16.921620 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6f14fa-9a6d-4569-a5bf-4059ee16d023 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:17.003186 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6f14fa-9a6d-4569-a5bf-4059ee16d023 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:17.014475 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3dc420-0392-4911-ab76-478247086375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:17.015350 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3dc420-0392-4911-ab76-478247086375 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:17.015764 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3dc420-0392-4911-ab76-478247086375 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:17.016261 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3dc420-0392-4911-ab76-478247086375 admin admin] PATH_INFO: `/v3/users/5866cdf1f7904a4092238ac1be0d6c22` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:17.017630 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3dc420-0392-4911-ab76-478247086375 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5866cdf1f7904a4092238ac1be0d6c22)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:17.019809 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3dc420-0392-4911-ab76-478247086375 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:17.090150 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-0c3dc420-0392-4911-ab76-478247086375 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5866cdf1f7904a4092238ac1be0d6c22'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:17.090907 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-0c3dc420-0392-4911-ab76-478247086375 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5866cdf1f7904a4092238ac1be0d6c22'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:17.097862 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-0c3dc420-0392-4911-ab76-478247086375 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5866cdf1f7904a4092238ac1be0d6c22'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:17.110636 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-0c3dc420-0392-4911-ab76-478247086375 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5866cdf1f7904a4092238ac1be0d6c22'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:17.118797 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-0c3dc420-0392-4911-ab76-478247086375 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5866cdf1f7904a4092238ac1be0d6c22'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:17.126693 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1366/2690] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:10:16 2022] DELETE /identity/v3/users/5866cdf1f7904a4092238ac1be0d6c22 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:10:17.130926 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd808f-53a7-427b-a17d-6d1aec9ba6b1 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:17.131206 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd808f-53a7-427b-a17d-6d1aec9ba6b1 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:17.131476 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd808f-53a7-427b-a17d-6d1aec9ba6b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:17.146495 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ba193-40c4-4050-b534-c0d1b0ba6e50 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:17.146786 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ba193-40c4-4050-b534-c0d1b0ba6e50 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:17.147095 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ba193-40c4-4050-b534-c0d1b0ba6e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:17.150251 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-e0fd808f-53a7-427b-a17d-6d1aec9ba6b1 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:10:17.151444 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-e0fd808f-53a7-427b-a17d-6d1aec9ba6b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:17.167056 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-191ba193-40c4-4050-b534-c0d1b0ba6e50 None None] MFA Rules not processed for user `bcacf809f13043ab90716607160a70db`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:10:17.168776 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-191ba193-40c4-4050-b534-c0d1b0ba6e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:17.173888 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:17.214664 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1325/2691] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:10:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:10:17.226464 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fd808f-53a7-427b-a17d-6d1aec9ba6b1 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:17.227976 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-e0fd808f-53a7-427b-a17d-6d1aec9ba6b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:17.247966 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1367/2692] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Aug 18 11:10:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:10:17.259851 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191ba193-40c4-4050-b534-c0d1b0ba6e50 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:17.261258 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-191ba193-40c4-4050-b534-c0d1b0ba6e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:17.312456 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fd808f-53a7-427b-a17d-6d1aec9ba6b1 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:17.316290 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abd9e7e-0c05-463f-8058-851f7219d185 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:17.316905 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd9e7e-0c05-463f-8058-851f7219d185 service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:17.317186 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd9e7e-0c05-463f-8058-851f7219d185 service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:17.317459 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd9e7e-0c05-463f-8058-851f7219d185 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:17.330170 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abd9e7e-0c05-463f-8058-851f7219d185 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:17.331625 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abd9e7e-0c05-463f-8058-851f7219d185 service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:17.341926 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1326/2693] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:10:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 11:10:17.347057 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191ba193-40c4-4050-b534-c0d1b0ba6e50 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:17.352562 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5192efc-b4eb-440e-9be7-a3c6e46e3e62 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f97e906b1922419d8511ab1c8b9c86e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:17.353209 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5192efc-b4eb-440e-9be7-a3c6e46e3e62 service swift] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:17.355300 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5192efc-b4eb-440e-9be7-a3c6e46e3e62 service swift] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:17.356626 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5192efc-b4eb-440e-9be7-a3c6e46e3e62 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:17.366282 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5192efc-b4eb-440e-9be7-a3c6e46e3e62 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:17.367872 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5192efc-b4eb-440e-9be7-a3c6e46e3e62 service swift] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:17.377272 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1368/2694] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Aug 18 11:10:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 18 11:10:17.782177 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba0cef-0f15-45f1-80fe-18195e03641e None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:17.782424 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba0cef-0f15-45f1-80fe-18195e03641e None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:17.782700 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba0cef-0f15-45f1-80fe-18195e03641e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:17.803297 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-ffba0cef-0f15-45f1-80fe-18195e03641e None None] MFA Rules not processed for user `bcacf809f13043ab90716607160a70db`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:10:17.804512 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-ffba0cef-0f15-45f1-80fe-18195e03641e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:17.813414 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1327/2695] 10.222.0.15 () {58 vars in 967 bytes} [Thu Aug 18 11:10:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:10:17.825132 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5192efc-b4eb-440e-9be7-a3c6e46e3e62 service swift] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:17.835977 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5192efc-b4eb-440e-9be7-a3c6e46e3e62 service swift] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:17.841273 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e25c6-a92e-4269-869e-305660cfd918 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f97e906b1922419d8511ab1c8b9c86e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:17.841942 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e25c6-a92e-4269-869e-305660cfd918 service swift] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:17.842223 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e25c6-a92e-4269-869e-305660cfd918 service swift] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:17.842493 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e25c6-a92e-4269-869e-305660cfd918 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:17.851186 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347e25c6-a92e-4269-869e-305660cfd918 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:17.852916 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347e25c6-a92e-4269-869e-305660cfd918 service swift] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:17.862792 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1369/2696] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Aug 18 11:10:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 18 11:10:18.024423 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffba0cef-0f15-45f1-80fe-18195e03641e None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:18.026232 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-ffba0cef-0f15-45f1-80fe-18195e03641e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:18.043922 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffba0cef-0f15-45f1-80fe-18195e03641e None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:18.056848 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e902d3-4b64-4051-a003-b57caff63fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:18.057623 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e902d3-4b64-4051-a003-b57caff63fc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:18.058649 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e902d3-4b64-4051-a003-b57caff63fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:18.058988 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e902d3-4b64-4051-a003-b57caff63fc4 admin admin] PATH_INFO: `/v3/projects/34c62d1a1eef4e08b2399a53ae3f0e10` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:18.060717 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e902d3-4b64-4051-a003-b57caff63fc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34c62d1a1eef4e08b2399a53ae3f0e10)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:18.062733 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e902d3-4b64-4051-a003-b57caff63fc4 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:18.117188 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:18.131882 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-53e902d3-4b64-4051-a003-b57caff63fc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34c62d1a1eef4e08b2399a53ae3f0e10', 'request_id': 'req-53e902d3-4b64-4051-a003-b57caff63fc4'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:18.142276 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-53e902d3-4b64-4051-a003-b57caff63fc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34c62d1a1eef4e08b2399a53ae3f0e10', 'request_id': 'req-53e902d3-4b64-4051-a003-b57caff63fc4'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:18.154886 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-53e902d3-4b64-4051-a003-b57caff63fc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34c62d1a1eef4e08b2399a53ae3f0e10', 'request_id': 'req-53e902d3-4b64-4051-a003-b57caff63fc4'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:18.170949 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-53e902d3-4b64-4051-a003-b57caff63fc4 admin admin] The token cache is being invalidate because project 34c62d1a1eef4e08b2399a53ae3f0e10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:10:18.171251 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-53e902d3-4b64-4051-a003-b57caff63fc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:18.172154 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-53e902d3-4b64-4051-a003-b57caff63fc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:18.174095 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1328/2697] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:10:18 2022] DELETE /identity/v3/projects/34c62d1a1eef4e08b2399a53ae3f0e10 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:10:18.178036 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e25c6-a92e-4269-869e-305660cfd918 service swift] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:18.189494 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e25c6-a92e-4269-869e-305660cfd918 service swift] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:18.306308 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717d1195-b107-495a-a52a-fd307fe7bf39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:18.307105 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d1195-b107-495a-a52a-fd307fe7bf39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:18.307476 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d1195-b107-495a-a52a-fd307fe7bf39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:18.307844 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d1195-b107-495a-a52a-fd307fe7bf39 admin admin] PATH_INFO: `/v3/users/2f491df361a848bfbe8b90eb82f21e3e` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:18.309246 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717d1195-b107-495a-a52a-fd307fe7bf39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f491df361a848bfbe8b90eb82f21e3e)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:18.312240 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717d1195-b107-495a-a52a-fd307fe7bf39 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:18.368454 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:18.388271 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-717d1195-b107-495a-a52a-fd307fe7bf39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f491df361a848bfbe8b90eb82f21e3e'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:18.389434 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-717d1195-b107-495a-a52a-fd307fe7bf39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f491df361a848bfbe8b90eb82f21e3e'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:18.399765 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-717d1195-b107-495a-a52a-fd307fe7bf39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f491df361a848bfbe8b90eb82f21e3e'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:18.414444 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-717d1195-b107-495a-a52a-fd307fe7bf39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f491df361a848bfbe8b90eb82f21e3e'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:18.423845 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-717d1195-b107-495a-a52a-fd307fe7bf39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f491df361a848bfbe8b90eb82f21e3e'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:18.433432 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1370/2698] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:10:18 2022] DELETE /identity/v3/users/2f491df361a848bfbe8b90eb82f21e3e => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:10:18.771916 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e902d3-4b64-4051-a003-b57caff63fc4 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:18.773628 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-53e902d3-4b64-4051-a003-b57caff63fc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:18.794543 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e902d3-4b64-4051-a003-b57caff63fc4 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:18.883500 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfce5567-2c67-47cd-a1d4-51959ba30f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:18.884279 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfce5567-2c67-47cd-a1d4-51959ba30f8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:18.884571 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfce5567-2c67-47cd-a1d4-51959ba30f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:18.884846 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfce5567-2c67-47cd-a1d4-51959ba30f8c admin admin] PATH_INFO: `/v3/projects/1f1576ec8f404f66887952ef281961f0` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:18.886844 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfce5567-2c67-47cd-a1d4-51959ba30f8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f1576ec8f404f66887952ef281961f0)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:18.889571 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfce5567-2c67-47cd-a1d4-51959ba30f8c admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:18.956899 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-cfce5567-2c67-47cd-a1d4-51959ba30f8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f1576ec8f404f66887952ef281961f0', 'request_id': 'req-cfce5567-2c67-47cd-a1d4-51959ba30f8c'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:18.967348 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-cfce5567-2c67-47cd-a1d4-51959ba30f8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f1576ec8f404f66887952ef281961f0', 'request_id': 'req-cfce5567-2c67-47cd-a1d4-51959ba30f8c'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:18.977389 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-cfce5567-2c67-47cd-a1d4-51959ba30f8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f1576ec8f404f66887952ef281961f0', 'request_id': 'req-cfce5567-2c67-47cd-a1d4-51959ba30f8c'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:18.987760 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-cfce5567-2c67-47cd-a1d4-51959ba30f8c admin admin] The token cache is being invalidate because project 1f1576ec8f404f66887952ef281961f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:10:18.988056 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-cfce5567-2c67-47cd-a1d4-51959ba30f8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:18.988725 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-cfce5567-2c67-47cd-a1d4-51959ba30f8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:18.990571 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1329/2699] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:10:18 2022] DELETE /identity/v3/projects/1f1576ec8f404f66887952ef281961f0 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:10:18.995488 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3552e3e-98b1-4eef-ae67-4b2a61f8e07e None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:18.995808 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3552e3e-98b1-4eef-ae67-4b2a61f8e07e None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:18.996084 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3552e3e-98b1-4eef-ae67-4b2a61f8e07e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:19.016714 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-c3552e3e-98b1-4eef-ae67-4b2a61f8e07e None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:10:19.017970 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-c3552e3e-98b1-4eef-ae67-4b2a61f8e07e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:19.088323 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1371/2700] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:10:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:10:19.097579 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5369b-c4c2-4702-b7f5-aeb95856716a None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:19.097880 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5369b-c4c2-4702-b7f5-aeb95856716a None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:19.098502 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5369b-c4c2-4702-b7f5-aeb95856716a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:19.122175 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-8cd5369b-c4c2-4702-b7f5-aeb95856716a None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:10:19.123607 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-8cd5369b-c4c2-4702-b7f5-aeb95856716a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:19.137937 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1330/2701] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:10:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:10:19.140696 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3552e3e-98b1-4eef-ae67-4b2a61f8e07e None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:19.156572 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3552e3e-98b1-4eef-ae67-4b2a61f8e07e None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:19.163539 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf9f48c-01dd-4510-9aa2-d2adf8898fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:19.164437 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf9f48c-01dd-4510-9aa2-d2adf8898fa5 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:19.165007 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf9f48c-01dd-4510-9aa2-d2adf8898fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:19.165154 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf9f48c-01dd-4510-9aa2-d2adf8898fa5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:19.165766 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf9f48c-01dd-4510-9aa2-d2adf8898fa5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:19.166169 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf9f48c-01dd-4510-9aa2-d2adf8898fa5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:19.167964 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf9f48c-01dd-4510-9aa2-d2adf8898fa5 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:19.191328 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1372/2702] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Aug 18 11:10:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:19.193002 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd5369b-c4c2-4702-b7f5-aeb95856716a None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:19.208338 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd5369b-c4c2-4702-b7f5-aeb95856716a None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:19.213404 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebeac65-c1df-4e1c-a350-c89d88239498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:19.214161 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebeac65-c1df-4e1c-a350-c89d88239498 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:19.214447 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebeac65-c1df-4e1c-a350-c89d88239498 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:19.214724 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebeac65-c1df-4e1c-a350-c89d88239498 admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:19.216075 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebeac65-c1df-4e1c-a350-c89d88239498 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:19.218061 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebeac65-c1df-4e1c-a350-c89d88239498 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:19.248030 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1331/2703] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:10:19 2022] POST /identity/v3/projects => generated 371 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:10:19.252636 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf9f48c-01dd-4510-9aa2-d2adf8898fa5 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:19.264134 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf9f48c-01dd-4510-9aa2-d2adf8898fa5 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:19.327988 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc01774f-e02a-46aa-8f37-eeb0af91405e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:19.328503 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01774f-e02a-46aa-8f37-eeb0af91405e admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:19.328803 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01774f-e02a-46aa-8f37-eeb0af91405e admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:19.329073 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01774f-e02a-46aa-8f37-eeb0af91405e admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:19.329729 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc01774f-e02a-46aa-8f37-eeb0af91405e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:19.331782 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc01774f-e02a-46aa-8f37-eeb0af91405e admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:19.358981 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1373/2704] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:10:19 2022] POST /identity/v3/users => generated 286 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:10:19.360261 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebeac65-c1df-4e1c-a350-c89d88239498 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:19.372198 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebeac65-c1df-4e1c-a350-c89d88239498 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:19.376791 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ee9d19-d0ae-477d-b8ba-d4fa03931a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:19.377409 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee9d19-d0ae-477d-b8ba-d4fa03931a01 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:19.377728 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee9d19-d0ae-477d-b8ba-d4fa03931a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:19.377997 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee9d19-d0ae-477d-b8ba-d4fa03931a01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:19.378631 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ee9d19-d0ae-477d-b8ba-d4fa03931a01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:19.380223 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ee9d19-d0ae-477d-b8ba-d4fa03931a01 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:19.390227 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1332/2705] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:10:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:10:19.394492 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc01774f-e02a-46aa-8f37-eeb0af91405e admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:19.405203 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc01774f-e02a-46aa-8f37-eeb0af91405e admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:19.410161 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f475ca-9ecb-4d29-8fa0-71d51785541a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:19.410776 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f475ca-9ecb-4d29-8fa0-71d51785541a admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:19.411075 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f475ca-9ecb-4d29-8fa0-71d51785541a admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:19.411373 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f475ca-9ecb-4d29-8fa0-71d51785541a admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:19.412036 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f475ca-9ecb-4d29-8fa0-71d51785541a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:19.413764 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f475ca-9ecb-4d29-8fa0-71d51785541a admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:19.426879 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1374/2706] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:10:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:10:19.431176 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ee9d19-d0ae-477d-b8ba-d4fa03931a01 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:19.442024 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ee9d19-d0ae-477d-b8ba-d4fa03931a01 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:19.446683 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ab6c98-d40a-414d-97f4-4f224eba72d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:19.447339 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ab6c98-d40a-414d-97f4-4f224eba72d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:19.447619 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ab6c98-d40a-414d-97f4-4f224eba72d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:19.447892 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ab6c98-d40a-414d-97f4-4f224eba72d4 admin admin] PATH_INFO: `/v3/projects/d619a140f5434551805af02575c7692a/users/36dab1b57c904949b521fe8f5a96bf42/roles/719e5c62188d4f8a838987d6e72ca8f7` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:19.467254 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:19.474127 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ab6c98-d40a-414d-97f4-4f224eba72d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d619a140f5434551805af02575c7692a, user_id=36dab1b57c904949b521fe8f5a96bf42, role_id=719e5c62188d4f8a838987d6e72ca8f7)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:19.477109 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ab6c98-d40a-414d-97f4-4f224eba72d4 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:19.494578 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1333/2707] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:10:19 2022] PUT /identity/v3/projects/d619a140f5434551805af02575c7692a/users/36dab1b57c904949b521fe8f5a96bf42/roles/719e5c62188d4f8a838987d6e72ca8f7 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:10:19.507045 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df77e8b-3ee6-47d0-871c-63407b7de676 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:19.507932 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df77e8b-3ee6-47d0-871c-63407b7de676 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:19.508221 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df77e8b-3ee6-47d0-871c-63407b7de676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:19.540353 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-8df77e8b-3ee6-47d0-871c-63407b7de676 None None] MFA Rules not processed for user `36dab1b57c904949b521fe8f5a96bf42`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:10:19.541916 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-8df77e8b-3ee6-47d0-871c-63407b7de676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:19.548414 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:19.629561 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1375/2708] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:10:19 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:10:19.638634 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ab6c98-d40a-414d-97f4-4f224eba72d4 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:19.640519 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-e6ab6c98-d40a-414d-97f4-4f224eba72d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:19.688246 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df77e8b-3ee6-47d0-871c-63407b7de676 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:19.689805 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-8df77e8b-3ee6-47d0-871c-63407b7de676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:19.707189 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ab6c98-d40a-414d-97f4-4f224eba72d4 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:19.711504 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c836fb96-0899-4990-8d61-00fd6e1c09be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b8a09704b9b4ab2bffb813796ec6e77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:19.712120 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836fb96-0899-4990-8d61-00fd6e1c09be service cinder] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:19.712443 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836fb96-0899-4990-8d61-00fd6e1c09be service cinder] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:19.712711 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836fb96-0899-4990-8d61-00fd6e1c09be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:19.722492 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c836fb96-0899-4990-8d61-00fd6e1c09be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:19.723958 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c836fb96-0899-4990-8d61-00fd6e1c09be service cinder] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:19.735377 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1334/2709] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:10:19 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:10:19.749842 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df77e8b-3ee6-47d0-871c-63407b7de676 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:19.751794 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f4754-b6da-4199-bea0-bccab7bd7b89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:19.752392 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f4754-b6da-4199-bea0-bccab7bd7b89 service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:19.752667 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f4754-b6da-4199-bea0-bccab7bd7b89 service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:19.752935 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f4754-b6da-4199-bea0-bccab7bd7b89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:19.755356 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-909f4754-b6da-4199-bea0-bccab7bd7b89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:19.758554 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c836fb96-0899-4990-8d61-00fd6e1c09be service cinder] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:19.824995 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909f4754-b6da-4199-bea0-bccab7bd7b89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:19.826467 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c836fb96-0899-4990-8d61-00fd6e1c09be service cinder] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:19.826932 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909f4754-b6da-4199-bea0-bccab7bd7b89 service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:19.831304 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844fd0a4-e9db-425b-8e94-8a0499dd9a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:19.831929 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844fd0a4-e9db-425b-8e94-8a0499dd9a20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:19.832200 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844fd0a4-e9db-425b-8e94-8a0499dd9a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:19.832475 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844fd0a4-e9db-425b-8e94-8a0499dd9a20 admin admin] PATH_INFO: `/v3/users/36dab1b57c904949b521fe8f5a96bf42` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:19.833635 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844fd0a4-e9db-425b-8e94-8a0499dd9a20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36dab1b57c904949b521fe8f5a96bf42)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:19.835568 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844fd0a4-e9db-425b-8e94-8a0499dd9a20 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:19.837447 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1376/2710] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:10:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 11:10:19.885985 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-844fd0a4-e9db-425b-8e94-8a0499dd9a20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36dab1b57c904949b521fe8f5a96bf42'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:19.893977 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-844fd0a4-e9db-425b-8e94-8a0499dd9a20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36dab1b57c904949b521fe8f5a96bf42'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:19.894658 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-844fd0a4-e9db-425b-8e94-8a0499dd9a20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36dab1b57c904949b521fe8f5a96bf42'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:19.895488 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-844fd0a4-e9db-425b-8e94-8a0499dd9a20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36dab1b57c904949b521fe8f5a96bf42'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:19.906829 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-844fd0a4-e9db-425b-8e94-8a0499dd9a20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36dab1b57c904949b521fe8f5a96bf42'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:19.926122 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1335/2711] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:10:19 2022] DELETE /identity/v3/users/36dab1b57c904949b521fe8f5a96bf42 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:10:19.930892 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eca16b-a003-4226-be6f-a4967000072b None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:19.931176 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eca16b-a003-4226-be6f-a4967000072b None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:19.931456 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eca16b-a003-4226-be6f-a4967000072b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:19.952022 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-e1eca16b-a003-4226-be6f-a4967000072b None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:10:19.953237 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-e1eca16b-a003-4226-be6f-a4967000072b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:20.005087 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:20.017582 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1377/2712] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:10:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:10:20.027436 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844fd0a4-e9db-425b-8e94-8a0499dd9a20 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:20.029583 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-844fd0a4-e9db-425b-8e94-8a0499dd9a20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:20.043170 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:20.092329 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844fd0a4-e9db-425b-8e94-8a0499dd9a20 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:20.095988 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a8995d-397f-40e8-a7aa-5a9daeb01158 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:20.096595 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a8995d-397f-40e8-a7aa-5a9daeb01158 service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:20.096866 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a8995d-397f-40e8-a7aa-5a9daeb01158 service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:20.097137 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a8995d-397f-40e8-a7aa-5a9daeb01158 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:20.107673 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a8995d-397f-40e8-a7aa-5a9daeb01158 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:20.109125 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a8995d-397f-40e8-a7aa-5a9daeb01158 service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:20.121585 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1336/2713] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:10:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:10:20.243903 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eca16b-a003-4226-be6f-a4967000072b None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:20.245575 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-e1eca16b-a003-4226-be6f-a4967000072b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:20.258710 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eca16b-a003-4226-be6f-a4967000072b None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:20.265493 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e55a5-ae9c-4ddd-803e-31f299382fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:20.266059 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e55a5-ae9c-4ddd-803e-31f299382fb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:20.266404 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e55a5-ae9c-4ddd-803e-31f299382fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:20.266742 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e55a5-ae9c-4ddd-803e-31f299382fb0 admin admin] PATH_INFO: `/v3/users/cf7572ed57244428ae3db89b3b408791` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:20.268806 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4e55a5-ae9c-4ddd-803e-31f299382fb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf7572ed57244428ae3db89b3b408791)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:20.270922 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4e55a5-ae9c-4ddd-803e-31f299382fb0 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:20.341182 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-ff4e55a5-ae9c-4ddd-803e-31f299382fb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf7572ed57244428ae3db89b3b408791'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:20.342274 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-ff4e55a5-ae9c-4ddd-803e-31f299382fb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf7572ed57244428ae3db89b3b408791'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:20.351311 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-ff4e55a5-ae9c-4ddd-803e-31f299382fb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf7572ed57244428ae3db89b3b408791'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:20.367086 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-ff4e55a5-ae9c-4ddd-803e-31f299382fb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf7572ed57244428ae3db89b3b408791'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:20.377911 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-ff4e55a5-ae9c-4ddd-803e-31f299382fb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf7572ed57244428ae3db89b3b408791'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:20.388464 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1378/2714] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:10:20 2022] DELETE /identity/v3/users/cf7572ed57244428ae3db89b3b408791 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:10:20.394867 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf2a5d-e406-4561-851d-bdf9e11393c7 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:20.395743 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf2a5d-e406-4561-851d-bdf9e11393c7 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:20.396388 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf2a5d-e406-4561-851d-bdf9e11393c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:20.423748 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-c7bf2a5d-e406-4561-851d-bdf9e11393c7 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:10:20.425140 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-c7bf2a5d-e406-4561-851d-bdf9e11393c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:20.453505 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e55a5-ae9c-4ddd-803e-31f299382fb0 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:20.455545 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-ff4e55a5-ae9c-4ddd-803e-31f299382fb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:20.517345 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1337/2715] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:10:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:10:20.529977 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bf2a5d-e406-4561-851d-bdf9e11393c7 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:20.532008 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-c7bf2a5d-e406-4561-851d-bdf9e11393c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:20.567140 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e55a5-ae9c-4ddd-803e-31f299382fb0 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:20.578908 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1a2f5e-aba4-42c5-9126-e588456e66a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:20.579608 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a2f5e-aba4-42c5-9126-e588456e66a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:20.579932 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a2f5e-aba4-42c5-9126-e588456e66a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:20.580230 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a2f5e-aba4-42c5-9126-e588456e66a0 admin admin] PATH_INFO: `/v3/projects/d619a140f5434551805af02575c7692a` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:20.581481 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1a2f5e-aba4-42c5-9126-e588456e66a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d619a140f5434551805af02575c7692a)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:20.583538 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1a2f5e-aba4-42c5-9126-e588456e66a0 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:20.609929 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bf2a5d-e406-4561-851d-bdf9e11393c7 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:20.614618 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb497c82-e2b2-409a-9d27-188972c432c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:20.616182 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb497c82-e2b2-409a-9d27-188972c432c2 service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:20.616576 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb497c82-e2b2-409a-9d27-188972c432c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:20.617024 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb497c82-e2b2-409a-9d27-188972c432c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:20.629769 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb497c82-e2b2-409a-9d27-188972c432c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:20.631262 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb497c82-e2b2-409a-9d27-188972c432c2 service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:20.644374 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1338/2716] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:10:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:10:20.662192 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-ba1a2f5e-aba4-42c5-9126-e588456e66a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd619a140f5434551805af02575c7692a', 'request_id': 'req-ba1a2f5e-aba4-42c5-9126-e588456e66a0'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:20.673236 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-ba1a2f5e-aba4-42c5-9126-e588456e66a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd619a140f5434551805af02575c7692a', 'request_id': 'req-ba1a2f5e-aba4-42c5-9126-e588456e66a0'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:20.683308 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-ba1a2f5e-aba4-42c5-9126-e588456e66a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd619a140f5434551805af02575c7692a', 'request_id': 'req-ba1a2f5e-aba4-42c5-9126-e588456e66a0'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:20.693769 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:20.703627 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-ba1a2f5e-aba4-42c5-9126-e588456e66a0 admin admin] The token cache is being invalidate because project d619a140f5434551805af02575c7692a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:10:20.704027 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-ba1a2f5e-aba4-42c5-9126-e588456e66a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:20.704861 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-ba1a2f5e-aba4-42c5-9126-e588456e66a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:20.708929 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1379/2717] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:10:20 2022] DELETE /identity/v3/projects/d619a140f5434551805af02575c7692a => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:10:20.927516 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb497c82-e2b2-409a-9d27-188972c432c2 service neutron] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:20.929155 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-cb497c82-e2b2-409a-9d27-188972c432c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:20.948697 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb497c82-e2b2-409a-9d27-188972c432c2 service neutron] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:21.019911 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:21.026306 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a0a5b1-5f2a-4c63-9f0b-7c21bd7056b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:21.026940 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a0a5b1-5f2a-4c63-9f0b-7c21bd7056b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:21.027217 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a0a5b1-5f2a-4c63-9f0b-7c21bd7056b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:21.027593 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a0a5b1-5f2a-4c63-9f0b-7c21bd7056b1 admin admin] PATH_INFO: `/v3/projects/94bd8c87d54641678bb4f0136a354acc` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:21.028693 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a0a5b1-5f2a-4c63-9f0b-7c21bd7056b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94bd8c87d54641678bb4f0136a354acc)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:21.030623 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a0a5b1-5f2a-4c63-9f0b-7c21bd7056b1 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:21.081987 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-f4a0a5b1-5f2a-4c63-9f0b-7c21bd7056b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94bd8c87d54641678bb4f0136a354acc', 'request_id': 'req-f4a0a5b1-5f2a-4c63-9f0b-7c21bd7056b1'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:21.090440 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-f4a0a5b1-5f2a-4c63-9f0b-7c21bd7056b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94bd8c87d54641678bb4f0136a354acc', 'request_id': 'req-f4a0a5b1-5f2a-4c63-9f0b-7c21bd7056b1'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:21.097349 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-f4a0a5b1-5f2a-4c63-9f0b-7c21bd7056b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94bd8c87d54641678bb4f0136a354acc', 'request_id': 'req-f4a0a5b1-5f2a-4c63-9f0b-7c21bd7056b1'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:21.108654 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-f4a0a5b1-5f2a-4c63-9f0b-7c21bd7056b1 admin admin] The token cache is being invalidate because project 94bd8c87d54641678bb4f0136a354acc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:10:21.108942 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-f4a0a5b1-5f2a-4c63-9f0b-7c21bd7056b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:21.109635 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-f4a0a5b1-5f2a-4c63-9f0b-7c21bd7056b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:21.111130 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1339/2718] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:10:20 2022] DELETE /identity/v3/projects/94bd8c87d54641678bb4f0136a354acc => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:10:21.116172 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e67462c-c387-4a06-a9d7-23eeabd627d3 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:21.116453 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e67462c-c387-4a06-a9d7-23eeabd627d3 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:21.116751 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e67462c-c387-4a06-a9d7-23eeabd627d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:21.136926 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-8e67462c-c387-4a06-a9d7-23eeabd627d3 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:10:21.138203 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-8e67462c-c387-4a06-a9d7-23eeabd627d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:21.223821 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c927e5fe-5192-4ff4-ace1-7722223d6ba7 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:21.224118 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c927e5fe-5192-4ff4-ace1-7722223d6ba7 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:21.224404 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c927e5fe-5192-4ff4-ace1-7722223d6ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:21.224804 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1380/2719] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:10:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:10:21.247939 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-c927e5fe-5192-4ff4-ace1-7722223d6ba7 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:10:21.249265 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-c927e5fe-5192-4ff4-ace1-7722223d6ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:21.258428 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1340/2720] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:10:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:10:21.263179 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e67462c-c387-4a06-a9d7-23eeabd627d3 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:21.274046 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e67462c-c387-4a06-a9d7-23eeabd627d3 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:21.279805 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9469ec04-49dc-4e74-9c47-6381bfda4280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:21.280425 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9469ec04-49dc-4e74-9c47-6381bfda4280 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:21.280708 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9469ec04-49dc-4e74-9c47-6381bfda4280 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:21.280985 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9469ec04-49dc-4e74-9c47-6381bfda4280 admin admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:21.281671 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9469ec04-49dc-4e74-9c47-6381bfda4280 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:21.281983 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9469ec04-49dc-4e74-9c47-6381bfda4280 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:21.283607 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9469ec04-49dc-4e74-9c47-6381bfda4280 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:21.297569 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1381/2721] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Aug 18 11:10:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:21.302079 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c927e5fe-5192-4ff4-ace1-7722223d6ba7 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:21.312593 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c927e5fe-5192-4ff4-ace1-7722223d6ba7 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:21.317754 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3267517-008b-416e-90dc-02fa5de96a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:21.318455 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3267517-008b-416e-90dc-02fa5de96a5c admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:21.318924 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3267517-008b-416e-90dc-02fa5de96a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:21.319279 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3267517-008b-416e-90dc-02fa5de96a5c admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:21.319997 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3267517-008b-416e-90dc-02fa5de96a5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:21.322051 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3267517-008b-416e-90dc-02fa5de96a5c admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:21.364055 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1341/2722] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:10:21 2022] POST /identity/v3/projects => generated 383 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:10:21.368164 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9469ec04-49dc-4e74-9c47-6381bfda4280 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:21.380969 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9469ec04-49dc-4e74-9c47-6381bfda4280 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:21.462801 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42af6e77-c67e-44c8-8358-a218c57f9831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:21.463873 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af6e77-c67e-44c8-8358-a218c57f9831 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:21.463873 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af6e77-c67e-44c8-8358-a218c57f9831 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:21.463873 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af6e77-c67e-44c8-8358-a218c57f9831 admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:21.464504 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42af6e77-c67e-44c8-8358-a218c57f9831 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:21.467004 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42af6e77-c67e-44c8-8358-a218c57f9831 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:21.493147 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1382/2723] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:10:21 2022] POST /identity/v3/users => generated 292 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 11:10:21.499738 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3267517-008b-416e-90dc-02fa5de96a5c admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:21.511079 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3267517-008b-416e-90dc-02fa5de96a5c admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:21.516849 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402ddb70-0469-49ab-b178-58655e2a8249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:21.517596 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ddb70-0469-49ab-b178-58655e2a8249 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:21.517946 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ddb70-0469-49ab-b178-58655e2a8249 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:21.518431 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ddb70-0469-49ab-b178-58655e2a8249 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:21.519130 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402ddb70-0469-49ab-b178-58655e2a8249 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:21.520847 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402ddb70-0469-49ab-b178-58655e2a8249 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:21.534941 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1342/2724] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:10:21 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 11:10:21.539263 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42af6e77-c67e-44c8-8358-a218c57f9831 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:21.559138 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42af6e77-c67e-44c8-8358-a218c57f9831 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:21.565175 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175423f6-1f87-402f-a76f-2770e46b0d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:21.566045 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175423f6-1f87-402f-a76f-2770e46b0d84 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:21.566323 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175423f6-1f87-402f-a76f-2770e46b0d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:21.566597 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175423f6-1f87-402f-a76f-2770e46b0d84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:21.567718 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175423f6-1f87-402f-a76f-2770e46b0d84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:21.568983 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175423f6-1f87-402f-a76f-2770e46b0d84 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:21.583515 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1383/2725] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:10:21 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:10:21.588128 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402ddb70-0469-49ab-b178-58655e2a8249 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:21.599523 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402ddb70-0469-49ab-b178-58655e2a8249 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:21.604216 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0d4db0-9a64-42f9-a21c-b4b466f3d3ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:21.604961 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d4db0-9a64-42f9-a21c-b4b466f3d3ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:21.605235 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d4db0-9a64-42f9-a21c-b4b466f3d3ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:21.605508 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d4db0-9a64-42f9-a21c-b4b466f3d3ef admin admin] PATH_INFO: `/v3/projects/2b0506e20fb94a929cf6703c6a52f8d2/users/937b232bfc72467c96829aff438cdecb/roles/719e5c62188d4f8a838987d6e72ca8f7` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:21.620877 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0d4db0-9a64-42f9-a21c-b4b466f3d3ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b0506e20fb94a929cf6703c6a52f8d2, user_id=937b232bfc72467c96829aff438cdecb, role_id=719e5c62188d4f8a838987d6e72ca8f7)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:21.623986 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0d4db0-9a64-42f9-a21c-b4b466f3d3ef admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:21.638141 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1343/2726] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:10:21 2022] PUT /identity/v3/projects/2b0506e20fb94a929cf6703c6a52f8d2/users/937b232bfc72467c96829aff438cdecb/roles/719e5c62188d4f8a838987d6e72ca8f7 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:10:21.643052 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f5819-a12f-496f-8f01-992f51770416 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:21.643407 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f5819-a12f-496f-8f01-992f51770416 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:21.643820 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f5819-a12f-496f-8f01-992f51770416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:21.663254 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-2f9f5819-a12f-496f-8f01-992f51770416 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:10:21.664469 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-2f9f5819-a12f-496f-8f01-992f51770416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:21.731432 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1384/2727] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:10:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:10:21.742135 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0d4db0-9a64-42f9-a21c-b4b466f3d3ef admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:21.743965 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-bc0d4db0-9a64-42f9-a21c-b4b466f3d3ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:21.812280 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0d4db0-9a64-42f9-a21c-b4b466f3d3ef admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:21.816207 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40195370-3eb5-4340-8e66-edf742095ab4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:21.816818 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40195370-3eb5-4340-8e66-edf742095ab4 service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:21.817093 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40195370-3eb5-4340-8e66-edf742095ab4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:21.817361 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40195370-3eb5-4340-8e66-edf742095ab4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:21.831158 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40195370-3eb5-4340-8e66-edf742095ab4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:21.833321 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40195370-3eb5-4340-8e66-edf742095ab4 service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:21.844989 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1344/2728] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:10:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:10:27.495199 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d502e50-4b53-4d6d-8e43-f5730d05fa60 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:27.495847 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d502e50-4b53-4d6d-8e43-f5730d05fa60 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:27.496028 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d502e50-4b53-4d6d-8e43-f5730d05fa60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:27.504947 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:27.528522 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-6d502e50-4b53-4d6d-8e43-f5730d05fa60 None None] MFA Rules not processed for user `937b232bfc72467c96829aff438cdecb`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:10:27.529799 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-6d502e50-4b53-4d6d-8e43-f5730d05fa60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:27.623200 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1385/2729] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:10:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:10:27.629027 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40195370-3eb5-4340-8e66-edf742095ab4 service neutron] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:27.641063 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40195370-3eb5-4340-8e66-edf742095ab4 service neutron] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:27.646878 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc1ebda-09c9-4f78-b770-9cea2c7b5c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:27.647762 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc1ebda-09c9-4f78-b770-9cea2c7b5c9c admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:27.648229 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc1ebda-09c9-4f78-b770-9cea2c7b5c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:27.648709 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc1ebda-09c9-4f78-b770-9cea2c7b5c9c admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:27.649586 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc1ebda-09c9-4f78-b770-9cea2c7b5c9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:27.654851 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc1ebda-09c9-4f78-b770-9cea2c7b5c9c admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:27.763623 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d502e50-4b53-4d6d-8e43-f5730d05fa60 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:27.766032 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1345/2730] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:10:27 2022] POST /identity/v3/projects => generated 383 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 11:10:27.780688 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d502e50-4b53-4d6d-8e43-f5730d05fa60 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:27.873259 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a07682-435f-4db4-a3b6-ebe15e0b112b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:27.874227 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a07682-435f-4db4-a3b6-ebe15e0b112b admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:27.874509 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a07682-435f-4db4-a3b6-ebe15e0b112b admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:27.874781 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a07682-435f-4db4-a3b6-ebe15e0b112b admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:27.875426 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a07682-435f-4db4-a3b6-ebe15e0b112b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:27.878071 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a07682-435f-4db4-a3b6-ebe15e0b112b admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:27.913706 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1386/2731] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:10:27 2022] POST /identity/v3/users => generated 298 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:10:27.915020 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc1ebda-09c9-4f78-b770-9cea2c7b5c9c admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:27.924212 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:27.936204 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc1ebda-09c9-4f78-b770-9cea2c7b5c9c admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:27.952059 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fae59b-1541-4256-836e-bc1986bf1c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:27.953308 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fae59b-1541-4256-836e-bc1986bf1c5a admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:27.953725 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fae59b-1541-4256-836e-bc1986bf1c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:27.954095 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fae59b-1541-4256-836e-bc1986bf1c5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:27.955285 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fae59b-1541-4256-836e-bc1986bf1c5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:27.957334 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fae59b-1541-4256-836e-bc1986bf1c5a admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:27.977985 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1346/2732] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:10:27 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:10:27.983320 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a07682-435f-4db4-a3b6-ebe15e0b112b admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:27.995966 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a07682-435f-4db4-a3b6-ebe15e0b112b admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:28.008214 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5750a90-c934-45b2-bde3-ae82beb719b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:28.009122 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5750a90-c934-45b2-bde3-ae82beb719b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:28.009484 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5750a90-c934-45b2-bde3-ae82beb719b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:28.009870 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5750a90-c934-45b2-bde3-ae82beb719b2 admin admin] PATH_INFO: `/v3/projects/eb34c4e8e6a34da1ba4c6b2ed1383089/users/f31fc74d85274f05acb325b3d5a7f0bd/roles/127fdc7ef05b4e0b98a940b334e5fcab` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:28.033348 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5750a90-c934-45b2-bde3-ae82beb719b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb34c4e8e6a34da1ba4c6b2ed1383089, user_id=f31fc74d85274f05acb325b3d5a7f0bd, role_id=127fdc7ef05b4e0b98a940b334e5fcab)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:28.037017 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5750a90-c934-45b2-bde3-ae82beb719b2 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:28.057446 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1387/2733] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:10:27 2022] PUT /identity/v3/projects/eb34c4e8e6a34da1ba4c6b2ed1383089/users/f31fc74d85274f05acb325b3d5a7f0bd/roles/127fdc7ef05b4e0b98a940b334e5fcab => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:10:28.062415 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fae59b-1541-4256-836e-bc1986bf1c5a admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:28.077298 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fae59b-1541-4256-836e-bc1986bf1c5a admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:28.157599 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a652fc1-d340-4680-ac8c-8fa0e0102765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:28.158102 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a652fc1-d340-4680-ac8c-8fa0e0102765 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:28.158832 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a652fc1-d340-4680-ac8c-8fa0e0102765 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:28.158832 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a652fc1-d340-4680-ac8c-8fa0e0102765 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:28.159439 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a652fc1-d340-4680-ac8c-8fa0e0102765 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:28.161075 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a652fc1-d340-4680-ac8c-8fa0e0102765 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:28.176434 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1347/2734] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:10:28 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:10:28.180501 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5750a90-c934-45b2-bde3-ae82beb719b2 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:28.193845 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5750a90-c934-45b2-bde3-ae82beb719b2 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:28.200410 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0abf47-d7db-4dec-a8df-60aa74f40a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:28.201136 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0abf47-d7db-4dec-a8df-60aa74f40a97 admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:28.201421 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0abf47-d7db-4dec-a8df-60aa74f40a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:28.201747 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0abf47-d7db-4dec-a8df-60aa74f40a97 admin admin] PATH_INFO: `/v3/projects/eb34c4e8e6a34da1ba4c6b2ed1383089/users/f31fc74d85274f05acb325b3d5a7f0bd/roles/127fdc7ef05b4e0b98a940b334e5fcab` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:28.204732 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0abf47-d7db-4dec-a8df-60aa74f40a97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb34c4e8e6a34da1ba4c6b2ed1383089, user_id=f31fc74d85274f05acb325b3d5a7f0bd, role_id=127fdc7ef05b4e0b98a940b334e5fcab)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:28.220167 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0abf47-d7db-4dec-a8df-60aa74f40a97 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:28.245614 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1388/2735] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:10:28 2022] PUT /identity/v3/projects/eb34c4e8e6a34da1ba4c6b2ed1383089/users/f31fc74d85274f05acb325b3d5a7f0bd/roles/127fdc7ef05b4e0b98a940b334e5fcab => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:10:28.642966 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a652fc1-d340-4680-ac8c-8fa0e0102765 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:28.644978 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-0a652fc1-d340-4680-ac8c-8fa0e0102765 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:28.722224 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0abf47-d7db-4dec-a8df-60aa74f40a97 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:28.724190 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-ca0abf47-d7db-4dec-a8df-60aa74f40a97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:28.739966 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a652fc1-d340-4680-ac8c-8fa0e0102765 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:28.794842 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:28.815650 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0abf47-d7db-4dec-a8df-60aa74f40a97 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:28.820699 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22dbdf7-f375-4c32-bc70-788fba7b2991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:28.821339 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22dbdf7-f375-4c32-bc70-788fba7b2991 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:28.821764 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22dbdf7-f375-4c32-bc70-788fba7b2991 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:28.822042 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22dbdf7-f375-4c32-bc70-788fba7b2991 admin admin] PATH_INFO: `/v3/users/b6e7022d0e4c4b00b92f12a65963d9e9` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:28.823261 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22dbdf7-f375-4c32-bc70-788fba7b2991 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6e7022d0e4c4b00b92f12a65963d9e9)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:28.826459 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22dbdf7-f375-4c32-bc70-788fba7b2991 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:28.839405 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d60a8-29d7-4fbf-9c3e-22bf1c51fad6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f918bcdd83d4d48be3fff5a48c54929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:28.840464 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d60a8-29d7-4fbf-9c3e-22bf1c51fad6 service placement] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:28.840755 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d60a8-29d7-4fbf-9c3e-22bf1c51fad6 service placement] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:28.841667 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d60a8-29d7-4fbf-9c3e-22bf1c51fad6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:28.843976 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-2a1d60a8-29d7-4fbf-9c3e-22bf1c51fad6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:28.888649 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-a22dbdf7-f375-4c32-bc70-788fba7b2991 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6e7022d0e4c4b00b92f12a65963d9e9'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:28.888998 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1d60a8-29d7-4fbf-9c3e-22bf1c51fad6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:28.890649 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-a22dbdf7-f375-4c32-bc70-788fba7b2991 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6e7022d0e4c4b00b92f12a65963d9e9'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:28.891971 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1d60a8-29d7-4fbf-9c3e-22bf1c51fad6 service placement] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:28.900536 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-a22dbdf7-f375-4c32-bc70-788fba7b2991 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6e7022d0e4c4b00b92f12a65963d9e9'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:28.909075 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1348/2736] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:10:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:10:28.924732 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-a22dbdf7-f375-4c32-bc70-788fba7b2991 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6e7022d0e4c4b00b92f12a65963d9e9'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:28.937495 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-a22dbdf7-f375-4c32-bc70-788fba7b2991 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6e7022d0e4c4b00b92f12a65963d9e9'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:28.945557 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1389/2737] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:10:28 2022] DELETE /identity/v3/users/b6e7022d0e4c4b00b92f12a65963d9e9 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:10:29.186010 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d60a8-29d7-4fbf-9c3e-22bf1c51fad6 service placement] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:29.204585 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d60a8-29d7-4fbf-9c3e-22bf1c51fad6 service placement] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:29.266726 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=100 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:29.343357 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227fe10f-d4d1-4bfb-b37f-cb8d1e295c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:29.344141 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227fe10f-d4d1-4bfb-b37f-cb8d1e295c88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:29.344468 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227fe10f-d4d1-4bfb-b37f-cb8d1e295c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:29.344779 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227fe10f-d4d1-4bfb-b37f-cb8d1e295c88 admin admin] PATH_INFO: `/v3/projects/f20ffd1ca0c94a9285f1fad07e8ab39a` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:29.348282 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227fe10f-d4d1-4bfb-b37f-cb8d1e295c88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f20ffd1ca0c94a9285f1fad07e8ab39a)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:29.350640 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227fe10f-d4d1-4bfb-b37f-cb8d1e295c88 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:29.450004 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-227fe10f-d4d1-4bfb-b37f-cb8d1e295c88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f20ffd1ca0c94a9285f1fad07e8ab39a', 'request_id': 'req-227fe10f-d4d1-4bfb-b37f-cb8d1e295c88'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:29.460926 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-227fe10f-d4d1-4bfb-b37f-cb8d1e295c88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f20ffd1ca0c94a9285f1fad07e8ab39a', 'request_id': 'req-227fe10f-d4d1-4bfb-b37f-cb8d1e295c88'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:29.481891 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-227fe10f-d4d1-4bfb-b37f-cb8d1e295c88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f20ffd1ca0c94a9285f1fad07e8ab39a', 'request_id': 'req-227fe10f-d4d1-4bfb-b37f-cb8d1e295c88'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:29.502745 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-227fe10f-d4d1-4bfb-b37f-cb8d1e295c88 admin admin] The token cache is being invalidate because project f20ffd1ca0c94a9285f1fad07e8ab39a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:10:29.503036 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-227fe10f-d4d1-4bfb-b37f-cb8d1e295c88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:29.503920 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-227fe10f-d4d1-4bfb-b37f-cb8d1e295c88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:29.509492 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22dbdf7-f375-4c32-bc70-788fba7b2991 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:29.509702 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1349/2738] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:10:29 2022] DELETE /identity/v3/projects/f20ffd1ca0c94a9285f1fad07e8ab39a => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:10:29.514596 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-a22dbdf7-f375-4c32-bc70-788fba7b2991 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:29.541323 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22dbdf7-f375-4c32-bc70-788fba7b2991 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:29.645274 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b80040-e79f-403c-8f79-4956d8c6802f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:29.646277 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b80040-e79f-403c-8f79-4956d8c6802f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:29.646724 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b80040-e79f-403c-8f79-4956d8c6802f admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:29.647504 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b80040-e79f-403c-8f79-4956d8c6802f admin admin] PATH_INFO: `/v3/users/d67b6b603ba545bea43921012cf08278` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:29.649085 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b80040-e79f-403c-8f79-4956d8c6802f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d67b6b603ba545bea43921012cf08278)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:29.653133 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b80040-e79f-403c-8f79-4956d8c6802f admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:29.720180 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-92b80040-e79f-403c-8f79-4956d8c6802f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd67b6b603ba545bea43921012cf08278'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:29.721075 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-92b80040-e79f-403c-8f79-4956d8c6802f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd67b6b603ba545bea43921012cf08278'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:29.732978 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-92b80040-e79f-403c-8f79-4956d8c6802f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd67b6b603ba545bea43921012cf08278'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:29.750786 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:29.758346 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-92b80040-e79f-403c-8f79-4956d8c6802f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd67b6b603ba545bea43921012cf08278'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:29.771262 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-92b80040-e79f-403c-8f79-4956d8c6802f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd67b6b603ba545bea43921012cf08278'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:29.780214 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1390/2739] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:10:29 2022] DELETE /identity/v3/users/d67b6b603ba545bea43921012cf08278 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:10:30.063565 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227fe10f-d4d1-4bfb-b37f-cb8d1e295c88 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:30.065114 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-227fe10f-d4d1-4bfb-b37f-cb8d1e295c88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:30.091455 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227fe10f-d4d1-4bfb-b37f-cb8d1e295c88 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:30.182008 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bcd64d-4109-4714-81af-8d7e1585532d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:30.182898 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bcd64d-4109-4714-81af-8d7e1585532d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:30.182898 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bcd64d-4109-4714-81af-8d7e1585532d admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:30.183133 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bcd64d-4109-4714-81af-8d7e1585532d admin admin] PATH_INFO: `/v3/projects/686b7ea14bde4ccd9b9d88e8b930e1ac` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:30.186102 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bcd64d-4109-4714-81af-8d7e1585532d admin admin] RBAC: Authorizing `identity:delete_project(project_id=686b7ea14bde4ccd9b9d88e8b930e1ac)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:30.188331 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bcd64d-4109-4714-81af-8d7e1585532d admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:30.258997 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-05bcd64d-4109-4714-81af-8d7e1585532d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '686b7ea14bde4ccd9b9d88e8b930e1ac', 'request_id': 'req-05bcd64d-4109-4714-81af-8d7e1585532d'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:30.264577 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:30.277043 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-05bcd64d-4109-4714-81af-8d7e1585532d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '686b7ea14bde4ccd9b9d88e8b930e1ac', 'request_id': 'req-05bcd64d-4109-4714-81af-8d7e1585532d'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:30.296050 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-05bcd64d-4109-4714-81af-8d7e1585532d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '686b7ea14bde4ccd9b9d88e8b930e1ac', 'request_id': 'req-05bcd64d-4109-4714-81af-8d7e1585532d'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:30.326518 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-05bcd64d-4109-4714-81af-8d7e1585532d admin admin] The token cache is being invalidate because project 686b7ea14bde4ccd9b9d88e8b930e1ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:10:30.327410 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-05bcd64d-4109-4714-81af-8d7e1585532d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:30.328514 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-05bcd64d-4109-4714-81af-8d7e1585532d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:10:30.333776 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1350/2740] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:10:30 2022] DELETE /identity/v3/projects/686b7ea14bde4ccd9b9d88e8b930e1ac => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:10:33.548137 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d91f21-e9d4-4248-8630-322cf584d37b None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:33.549035 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d91f21-e9d4-4248-8630-322cf584d37b None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:33.549797 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d91f21-e9d4-4248-8630-322cf584d37b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:33.589815 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-58d91f21-e9d4-4248-8630-322cf584d37b None None] MFA Rules not processed for user `f31fc74d85274f05acb325b3d5a7f0bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:10:33.591480 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-58d91f21-e9d4-4248-8630-322cf584d37b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:33.718887 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1391/2741] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:10:33 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:10:33.732463 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bcd64d-4109-4714-81af-8d7e1585532d admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:33.734671 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-05bcd64d-4109-4714-81af-8d7e1585532d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:33.849404 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bcd64d-4109-4714-81af-8d7e1585532d admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:33.855220 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda0b05a-9276-4010-8a41-b8ffb11e9d02 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77211d2dcef242c4a7fe2198556d5efc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:33.856838 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda0b05a-9276-4010-8a41-b8ffb11e9d02 service glance] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:33.859114 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda0b05a-9276-4010-8a41-b8ffb11e9d02 service glance] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:33.859593 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda0b05a-9276-4010-8a41-b8ffb11e9d02 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:33.863396 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-fda0b05a-9276-4010-8a41-b8ffb11e9d02 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:33.936794 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda0b05a-9276-4010-8a41-b8ffb11e9d02 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:33.938316 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda0b05a-9276-4010-8a41-b8ffb11e9d02 service glance] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:33.950501 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1351/2742] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:10:33 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:10:34.092934 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccb015e-c468-4c7e-a76a-85b8de65c0da None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:34.093251 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccb015e-c468-4c7e-a76a-85b8de65c0da None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:34.093589 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccb015e-c468-4c7e-a76a-85b8de65c0da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:34.117336 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-dccb015e-c468-4c7e-a76a-85b8de65c0da None None] MFA Rules not processed for user `bcacf809f13043ab90716607160a70db`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:10:34.119243 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-dccb015e-c468-4c7e-a76a-85b8de65c0da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:34.197168 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1392/2743] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Aug 18 11:10:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:10:34.213232 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda0b05a-9276-4010-8a41-b8ffb11e9d02 service glance] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:34.217896 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-fda0b05a-9276-4010-8a41-b8ffb11e9d02 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:34.328278 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda0b05a-9276-4010-8a41-b8ffb11e9d02 service glance] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:34.333433 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2b99e4-da44-46df-97e3-ea6ad230acd5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f97e906b1922419d8511ab1c8b9c86e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:34.334083 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b99e4-da44-46df-97e3-ea6ad230acd5 service swift] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:34.334366 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b99e4-da44-46df-97e3-ea6ad230acd5 service swift] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:34.334642 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b99e4-da44-46df-97e3-ea6ad230acd5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:34.343489 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2b99e4-da44-46df-97e3-ea6ad230acd5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:34.345557 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2b99e4-da44-46df-97e3-ea6ad230acd5 service swift] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:34.363382 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1352/2744] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Aug 18 11:10:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 18 11:10:43.116531 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7963a08-2738-445f-aada-5bb49f08b37a None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:43.117070 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7963a08-2738-445f-aada-5bb49f08b37a None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:43.117070 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7963a08-2738-445f-aada-5bb49f08b37a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:43.149236 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-a7963a08-2738-445f-aada-5bb49f08b37a None None] MFA Rules not processed for user `937b232bfc72467c96829aff438cdecb`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:10:43.150506 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-a7963a08-2738-445f-aada-5bb49f08b37a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:43.178433 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1393/2745] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:10:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:10:44.356791 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=86,keystone:DELETE=2 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:44.963332 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6543e0-a662-444e-82b6-bd1f7f34478b None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:44.963605 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6543e0-a662-444e-82b6-bd1f7f34478b None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:44.963877 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6543e0-a662-444e-82b6-bd1f7f34478b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:44.995808 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-0d6543e0-a662-444e-82b6-bd1f7f34478b None None] MFA Rules not processed for user `bcacf809f13043ab90716607160a70db`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:10:44.997195 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-0d6543e0-a662-444e-82b6-bd1f7f34478b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:45.030874 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1353/2746] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Aug 18 11:10:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:10:45.044520 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7963a08-2738-445f-aada-5bb49f08b37a None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:45.064863 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7963a08-2738-445f-aada-5bb49f08b37a None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:45.070124 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc53eecb-08f0-48c4-a86f-7399fc9cbb3d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f97e906b1922419d8511ab1c8b9c86e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:45.070828 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc53eecb-08f0-48c4-a86f-7399fc9cbb3d service swift] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:45.071113 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc53eecb-08f0-48c4-a86f-7399fc9cbb3d service swift] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:45.071412 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc53eecb-08f0-48c4-a86f-7399fc9cbb3d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:45.080419 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc53eecb-08f0-48c4-a86f-7399fc9cbb3d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:45.082043 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc53eecb-08f0-48c4-a86f-7399fc9cbb3d service swift] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:45.091218 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1394/2747] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Aug 18 11:10:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 18 11:10:53.677192 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6543e0-a662-444e-82b6-bd1f7f34478b None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:53.678747 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-0d6543e0-a662-444e-82b6-bd1f7f34478b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:53.780337 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6543e0-a662-444e-82b6-bd1f7f34478b None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:53.785456 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85517436-cedd-43ea-bed3-e81aa9158b8f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f918bcdd83d4d48be3fff5a48c54929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:53.786090 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85517436-cedd-43ea-bed3-e81aa9158b8f service placement] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:53.786393 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85517436-cedd-43ea-bed3-e81aa9158b8f service placement] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:53.786721 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85517436-cedd-43ea-bed3-e81aa9158b8f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:53.788487 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-85517436-cedd-43ea-bed3-e81aa9158b8f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:53.801025 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85517436-cedd-43ea-bed3-e81aa9158b8f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:53.802687 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85517436-cedd-43ea-bed3-e81aa9158b8f service placement] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:53.813787 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1354/2748] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:10:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:10:55.087021 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=87,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:03.809186 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=58 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:12.906695 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc53eecb-08f0-48c4-a86f-7399fc9cbb3d service swift] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:12.908978 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-fc53eecb-08f0-48c4-a86f-7399fc9cbb3d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:11:12.998442 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc53eecb-08f0-48c4-a86f-7399fc9cbb3d service swift] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:13.002452 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77baa75-e6fa-48f2-8cd2-98924efd6e11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:13.003087 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77baa75-e6fa-48f2-8cd2-98924efd6e11 service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:13.003473 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77baa75-e6fa-48f2-8cd2-98924efd6e11 service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:13.003690 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77baa75-e6fa-48f2-8cd2-98924efd6e11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:13.014122 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77baa75-e6fa-48f2-8cd2-98924efd6e11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:13.015579 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77baa75-e6fa-48f2-8cd2-98924efd6e11 service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:13.026369 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1395/2749] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:11:12 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 11:11:14.751716 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85517436-cedd-43ea-bed3-e81aa9158b8f service placement] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:14.753908 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-85517436-cedd-43ea-bed3-e81aa9158b8f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:11:14.877401 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85517436-cedd-43ea-bed3-e81aa9158b8f service placement] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:14.884744 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a6c646-d285-427f-8afc-fc28cfc7d8ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a005d8f0c46d44c7b6f2201a54717b12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:14.885372 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6c646-d285-427f-8afc-fc28cfc7d8ec service nova] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:14.885689 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6c646-d285-427f-8afc-fc28cfc7d8ec service nova] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:14.885967 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6c646-d285-427f-8afc-fc28cfc7d8ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:14.889280 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-42a6c646-d285-427f-8afc-fc28cfc7d8ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:11:14.920739 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a6c646-d285-427f-8afc-fc28cfc7d8ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:14.923414 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a6c646-d285-427f-8afc-fc28cfc7d8ec service nova] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:14.937837 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1355/2750] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:11:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:11:17.415100 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cde3ef-0ea4-4572-b9c4-07b1984f0b4c None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:17.415612 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cde3ef-0ea4-4572-b9c4-07b1984f0b4c None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:17.415701 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cde3ef-0ea4-4572-b9c4-07b1984f0b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:17.436069 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-11cde3ef-0ea4-4572-b9c4-07b1984f0b4c None None] MFA Rules not processed for user `932e75ccffec4118b9de434cc59564f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:11:17.437291 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-11cde3ef-0ea4-4572-b9c4-07b1984f0b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:11:17.494799 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1396/2751] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:11:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:11:24.930276 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=43 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:27.487820 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=60 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:12:33.672191 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8bff00-4d4b-479f-aff7-8c26795b99cf None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:33.672960 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8bff00-4d4b-479f-aff7-8c26795b99cf None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:33.672960 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8bff00-4d4b-479f-aff7-8c26795b99cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:33.692869 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-6b8bff00-4d4b-479f-aff7-8c26795b99cf None None] MFA Rules not processed for user `bcacf809f13043ab90716607160a70db`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:12:33.694094 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-6b8bff00-4d4b-479f-aff7-8c26795b99cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:12:33.702803 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1356/2752] 10.222.0.15 () {58 vars in 967 bytes} [Thu Aug 18 11:12:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:12:33.742620 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cde3ef-0ea4-4572-b9c4-07b1984f0b4c None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:12:33.754952 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cde3ef-0ea4-4572-b9c4-07b1984f0b4c None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:12:33.759869 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94022304-3aa9-47c5-b0e0-b1c83f7a3a1b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f97e906b1922419d8511ab1c8b9c86e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:12:33.760464 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94022304-3aa9-47c5-b0e0-b1c83f7a3a1b service swift] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:33.760746 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94022304-3aa9-47c5-b0e0-b1c83f7a3a1b service swift] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:33.761020 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94022304-3aa9-47c5-b0e0-b1c83f7a3a1b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:33.770638 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94022304-3aa9-47c5-b0e0-b1c83f7a3a1b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:12:33.772593 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94022304-3aa9-47c5-b0e0-b1c83f7a3a1b service swift] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:12:33.782689 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1397/2753] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Aug 18 11:12:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 11:12:41.034680 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8bff00-4d4b-479f-aff7-8c26795b99cf None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:12:41.037338 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-6b8bff00-4d4b-479f-aff7-8c26795b99cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:12:41.153547 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8bff00-4d4b-479f-aff7-8c26795b99cf None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:12:41.160095 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22292c99-bb53-4d7d-b7f4-56ae93709cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:12:41.160829 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22292c99-bb53-4d7d-b7f4-56ae93709cbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:41.161172 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22292c99-bb53-4d7d-b7f4-56ae93709cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:41.161788 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22292c99-bb53-4d7d-b7f4-56ae93709cbe admin admin] PATH_INFO: `/v3/users/932e75ccffec4118b9de434cc59564f7` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:41.162864 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22292c99-bb53-4d7d-b7f4-56ae93709cbe admin admin] RBAC: Authorizing `identity:delete_user(user_id=932e75ccffec4118b9de434cc59564f7)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:12:41.165548 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22292c99-bb53-4d7d-b7f4-56ae93709cbe admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:12:41.240129 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-22292c99-bb53-4d7d-b7f4-56ae93709cbe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '932e75ccffec4118b9de434cc59564f7'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:12:41.250988 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-22292c99-bb53-4d7d-b7f4-56ae93709cbe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '932e75ccffec4118b9de434cc59564f7'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:12:41.251761 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-22292c99-bb53-4d7d-b7f4-56ae93709cbe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '932e75ccffec4118b9de434cc59564f7'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:12:41.252442 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-22292c99-bb53-4d7d-b7f4-56ae93709cbe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '932e75ccffec4118b9de434cc59564f7'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:12:41.260288 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-22292c99-bb53-4d7d-b7f4-56ae93709cbe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '932e75ccffec4118b9de434cc59564f7'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:12:41.285065 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1357/2754] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:12:41 2022] DELETE /identity/v3/users/932e75ccffec4118b9de434cc59564f7 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:12:41.483554 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94022304-3aa9-47c5-b0e0-b1c83f7a3a1b service swift] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:12:41.503517 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94022304-3aa9-47c5-b0e0-b1c83f7a3a1b service swift] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:12:41.514532 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22292c99-bb53-4d7d-b7f4-56ae93709cbe admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:12:41.518338 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-22292c99-bb53-4d7d-b7f4-56ae93709cbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:12:41.572220 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:12:41.576943 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72219a65-59fe-4b18-9682-b0eaf4769ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:12:41.577677 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72219a65-59fe-4b18-9682-b0eaf4769ad1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:41.577956 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72219a65-59fe-4b18-9682-b0eaf4769ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:41.578284 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72219a65-59fe-4b18-9682-b0eaf4769ad1 admin admin] PATH_INFO: `/v3/projects/c2dd094c20324a7e8bfe6f3ea11dce38` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:41.579517 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72219a65-59fe-4b18-9682-b0eaf4769ad1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2dd094c20324a7e8bfe6f3ea11dce38)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:12:41.582003 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72219a65-59fe-4b18-9682-b0eaf4769ad1 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:12:41.594390 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22292c99-bb53-4d7d-b7f4-56ae93709cbe admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:12:41.601554 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd9d3ae-3db0-44c5-822f-1f2b6548456a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:12:41.602574 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd9d3ae-3db0-44c5-822f-1f2b6548456a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:41.603016 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd9d3ae-3db0-44c5-822f-1f2b6548456a admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:41.603517 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd9d3ae-3db0-44c5-822f-1f2b6548456a admin admin] PATH_INFO: `/v3/users/937b232bfc72467c96829aff438cdecb` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:41.604974 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd9d3ae-3db0-44c5-822f-1f2b6548456a admin admin] RBAC: Authorizing `identity:delete_user(user_id=937b232bfc72467c96829aff438cdecb)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:12:41.607877 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd9d3ae-3db0-44c5-822f-1f2b6548456a admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:12:41.633370 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-72219a65-59fe-4b18-9682-b0eaf4769ad1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2dd094c20324a7e8bfe6f3ea11dce38', 'request_id': 'req-72219a65-59fe-4b18-9682-b0eaf4769ad1'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:12:41.642244 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-72219a65-59fe-4b18-9682-b0eaf4769ad1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2dd094c20324a7e8bfe6f3ea11dce38', 'request_id': 'req-72219a65-59fe-4b18-9682-b0eaf4769ad1'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:12:41.649269 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-72219a65-59fe-4b18-9682-b0eaf4769ad1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2dd094c20324a7e8bfe6f3ea11dce38', 'request_id': 'req-72219a65-59fe-4b18-9682-b0eaf4769ad1'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:12:41.661105 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-72219a65-59fe-4b18-9682-b0eaf4769ad1 admin admin] The token cache is being invalidate because project c2dd094c20324a7e8bfe6f3ea11dce38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:12:41.661681 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-72219a65-59fe-4b18-9682-b0eaf4769ad1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:12:41.662318 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-72219a65-59fe-4b18-9682-b0eaf4769ad1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:12:41.663414 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-4bd9d3ae-3db0-44c5-822f-1f2b6548456a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '937b232bfc72467c96829aff438cdecb'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:12:41.663890 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1398/2755] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:12:41 2022] DELETE /identity/v3/projects/c2dd094c20324a7e8bfe6f3ea11dce38 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:12:41.669198 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17e285-44f4-48a3-9996-8791c32e800a None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:41.669667 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17e285-44f4-48a3-9996-8791c32e800a None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:41.670019 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17e285-44f4-48a3-9996-8791c32e800a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:41.672528 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-4bd9d3ae-3db0-44c5-822f-1f2b6548456a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '937b232bfc72467c96829aff438cdecb'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:12:41.673246 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-4bd9d3ae-3db0-44c5-822f-1f2b6548456a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '937b232bfc72467c96829aff438cdecb'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:12:41.673919 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-4bd9d3ae-3db0-44c5-822f-1f2b6548456a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '937b232bfc72467c96829aff438cdecb'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:12:41.681482 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-4bd9d3ae-3db0-44c5-822f-1f2b6548456a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '937b232bfc72467c96829aff438cdecb'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:12:41.701015 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1358/2756] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:12:41 2022] DELETE /identity/v3/users/937b232bfc72467c96829aff438cdecb => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:12:41.732891 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-8d17e285-44f4-48a3-9996-8791c32e800a None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:12:41.734187 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-8d17e285-44f4-48a3-9996-8791c32e800a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:12:41.777388 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:12:41.798260 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1399/2757] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:12:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:12:41.807066 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aceb32-de5a-4f20-b45b-ff85802b2676 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:41.807374 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aceb32-de5a-4f20-b45b-ff85802b2676 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:41.807648 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aceb32-de5a-4f20-b45b-ff85802b2676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:41.828127 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-32aceb32-de5a-4f20-b45b-ff85802b2676 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:12:41.829242 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-32aceb32-de5a-4f20-b45b-ff85802b2676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:12:41.837284 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1359/2758] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:12:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:12:41.842223 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d17e285-44f4-48a3-9996-8791c32e800a None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:12:41.855187 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d17e285-44f4-48a3-9996-8791c32e800a None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:12:41.862047 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da62d6d1-4ae3-4959-9bcb-5e83b90d483c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:12:41.862666 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da62d6d1-4ae3-4959-9bcb-5e83b90d483c admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:41.863133 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da62d6d1-4ae3-4959-9bcb-5e83b90d483c admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:41.863651 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da62d6d1-4ae3-4959-9bcb-5e83b90d483c admin admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:41.864439 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da62d6d1-4ae3-4959-9bcb-5e83b90d483c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:12:41.864944 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da62d6d1-4ae3-4959-9bcb-5e83b90d483c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:12:41.866858 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da62d6d1-4ae3-4959-9bcb-5e83b90d483c admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:12:41.885035 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1400/2759] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Aug 18 11:12:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:12:41.889255 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aceb32-de5a-4f20-b45b-ff85802b2676 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:12:41.893798 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da62d6d1-4ae3-4959-9bcb-5e83b90d483c admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:12:41.896201 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-da62d6d1-4ae3-4959-9bcb-5e83b90d483c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:12:41.901504 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aceb32-de5a-4f20-b45b-ff85802b2676 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:12:41.910508 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da62d6d1-4ae3-4959-9bcb-5e83b90d483c admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:12:41.912322 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf6eceb-4f75-45c8-8d5b-6e9e1d13c63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:12:41.912960 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf6eceb-4f75-45c8-8d5b-6e9e1d13c63b admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:41.913243 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf6eceb-4f75-45c8-8d5b-6e9e1d13c63b admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:41.913547 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf6eceb-4f75-45c8-8d5b-6e9e1d13c63b admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:41.914199 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf6eceb-4f75-45c8-8d5b-6e9e1d13c63b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:12:41.916113 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf6eceb-4f75-45c8-8d5b-6e9e1d13c63b admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:12:41.916235 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6262a0-02ab-4fdc-9b19-9900238e0a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:12:41.916821 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6262a0-02ab-4fdc-9b19-9900238e0a8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:41.917095 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6262a0-02ab-4fdc-9b19-9900238e0a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:41.917362 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6262a0-02ab-4fdc-9b19-9900238e0a8e admin admin] PATH_INFO: `/v3/projects/2b0506e20fb94a929cf6703c6a52f8d2` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:41.918561 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6262a0-02ab-4fdc-9b19-9900238e0a8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b0506e20fb94a929cf6703c6a52f8d2)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:12:41.920971 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6262a0-02ab-4fdc-9b19-9900238e0a8e admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:12:41.961550 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1360/2760] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:12:41 2022] POST /identity/v3/projects => generated 381 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 11:12:41.963729 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf6eceb-4f75-45c8-8d5b-6e9e1d13c63b admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:12:41.977767 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-2b6262a0-02ab-4fdc-9b19-9900238e0a8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b0506e20fb94a929cf6703c6a52f8d2', 'request_id': 'req-2b6262a0-02ab-4fdc-9b19-9900238e0a8e'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:12:41.987209 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-2b6262a0-02ab-4fdc-9b19-9900238e0a8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b0506e20fb94a929cf6703c6a52f8d2', 'request_id': 'req-2b6262a0-02ab-4fdc-9b19-9900238e0a8e'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:12:41.994201 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-2b6262a0-02ab-4fdc-9b19-9900238e0a8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b0506e20fb94a929cf6703c6a52f8d2', 'request_id': 'req-2b6262a0-02ab-4fdc-9b19-9900238e0a8e'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:12:42.006890 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-2b6262a0-02ab-4fdc-9b19-9900238e0a8e admin admin] The token cache is being invalidate because project 2b0506e20fb94a929cf6703c6a52f8d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:12:42.007177 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-2b6262a0-02ab-4fdc-9b19-9900238e0a8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:12:42.008182 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-2b6262a0-02ab-4fdc-9b19-9900238e0a8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:12:42.010114 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1401/2761] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:12:41 2022] DELETE /identity/v3/projects/2b0506e20fb94a929cf6703c6a52f8d2 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:12:42.014150 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6262a0-02ab-4fdc-9b19-9900238e0a8e admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:12:42.015613 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-2b6262a0-02ab-4fdc-9b19-9900238e0a8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:12:42.029711 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf6eceb-4f75-45c8-8d5b-6e9e1d13c63b admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:12:42.062522 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:12:42.084858 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6262a0-02ab-4fdc-9b19-9900238e0a8e admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:12:42.089495 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d3dcdb-2743-4438-95bc-656d536019be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:12:42.089872 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940084c9-8f85-4f01-a967-4e9f0d765fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:12:42.090149 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d3dcdb-2743-4438-95bc-656d536019be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:42.090424 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d3dcdb-2743-4438-95bc-656d536019be admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:42.090526 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940084c9-8f85-4f01-a967-4e9f0d765fb2 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:42.090930 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d3dcdb-2743-4438-95bc-656d536019be admin admin] PATH_INFO: `/v3/users/f31fc74d85274f05acb325b3d5a7f0bd` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:42.091050 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940084c9-8f85-4f01-a967-4e9f0d765fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:42.091050 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940084c9-8f85-4f01-a967-4e9f0d765fb2 admin admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:42.091644 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940084c9-8f85-4f01-a967-4e9f0d765fb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:12:42.091980 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d3dcdb-2743-4438-95bc-656d536019be admin admin] RBAC: Authorizing `identity:delete_user(user_id=f31fc74d85274f05acb325b3d5a7f0bd)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:12:42.093570 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940084c9-8f85-4f01-a967-4e9f0d765fb2 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:12:42.093944 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d3dcdb-2743-4438-95bc-656d536019be admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:12:42.117573 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1361/2762] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:12:41 2022] POST /identity/v3/users => generated 291 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 11:12:42.120261 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940084c9-8f85-4f01-a967-4e9f0d765fb2 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:12:42.122792 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-940084c9-8f85-4f01-a967-4e9f0d765fb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:12:42.135286 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940084c9-8f85-4f01-a967-4e9f0d765fb2 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:12:42.141037 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10aca0b-241f-4e8c-bafd-94baf5f9ebae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:12:42.141685 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10aca0b-241f-4e8c-bafd-94baf5f9ebae admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:42.141965 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10aca0b-241f-4e8c-bafd-94baf5f9ebae admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:42.142282 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10aca0b-241f-4e8c-bafd-94baf5f9ebae admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:42.142932 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10aca0b-241f-4e8c-bafd-94baf5f9ebae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:12:42.145484 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10aca0b-241f-4e8c-bafd-94baf5f9ebae admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:12:42.150793 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-f3d3dcdb-2743-4438-95bc-656d536019be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f31fc74d85274f05acb325b3d5a7f0bd'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:12:42.151479 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-f3d3dcdb-2743-4438-95bc-656d536019be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f31fc74d85274f05acb325b3d5a7f0bd'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:12:42.160612 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1362/2763] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:12:42 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 11:12:42.161657 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10aca0b-241f-4e8c-bafd-94baf5f9ebae admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:12:42.162875 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-f3d3dcdb-2743-4438-95bc-656d536019be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f31fc74d85274f05acb325b3d5a7f0bd'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:12:42.165074 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:12:42.172600 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10aca0b-241f-4e8c-bafd-94baf5f9ebae admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:12:42.177841 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6506eca0-a8a7-4b51-88da-c9257c236d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:12:42.178428 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506eca0-a8a7-4b51-88da-c9257c236d6c admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:42.178809 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506eca0-a8a7-4b51-88da-c9257c236d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:42.179237 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506eca0-a8a7-4b51-88da-c9257c236d6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:42.179633 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6506eca0-a8a7-4b51-88da-c9257c236d6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:12:42.180334 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-f3d3dcdb-2743-4438-95bc-656d536019be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f31fc74d85274f05acb325b3d5a7f0bd'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:12:42.181227 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6506eca0-a8a7-4b51-88da-c9257c236d6c admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:12:42.189063 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-f3d3dcdb-2743-4438-95bc-656d536019be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f31fc74d85274f05acb325b3d5a7f0bd'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:12:42.192152 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1363/2764] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:12:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 11:12:42.196535 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6506eca0-a8a7-4b51-88da-c9257c236d6c admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:12:42.196678 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1402/2765] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:12:42 2022] DELETE /identity/v3/users/f31fc74d85274f05acb325b3d5a7f0bd => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:12:42.199307 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-6506eca0-a8a7-4b51-88da-c9257c236d6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:12:42.212899 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6506eca0-a8a7-4b51-88da-c9257c236d6c admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:12:42.277188 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359582ea-e5cb-4842-8c00-6c94c299d4d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:12:42.277884 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359582ea-e5cb-4842-8c00-6c94c299d4d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:42.278687 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359582ea-e5cb-4842-8c00-6c94c299d4d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:42.278966 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359582ea-e5cb-4842-8c00-6c94c299d4d1 admin admin] PATH_INFO: `/v3/projects/3786ef3d535f4999afa8cb0385ba9c6b/users/3cc95721c8e24d2dbdbff5488e0d8ee2/roles/719e5c62188d4f8a838987d6e72ca8f7` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:42.293881 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359582ea-e5cb-4842-8c00-6c94c299d4d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3786ef3d535f4999afa8cb0385ba9c6b, user_id=3cc95721c8e24d2dbdbff5488e0d8ee2, role_id=719e5c62188d4f8a838987d6e72ca8f7)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:12:42.296998 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359582ea-e5cb-4842-8c00-6c94c299d4d1 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:12:42.312939 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1364/2766] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:12:42 2022] PUT /identity/v3/projects/3786ef3d535f4999afa8cb0385ba9c6b/users/3cc95721c8e24d2dbdbff5488e0d8ee2/roles/719e5c62188d4f8a838987d6e72ca8f7 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:12:42.323383 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebb3664-0f4a-472c-b2d7-adc4404770ac None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:42.323670 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebb3664-0f4a-472c-b2d7-adc4404770ac None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:42.323946 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebb3664-0f4a-472c-b2d7-adc4404770ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:42.352840 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-5ebb3664-0f4a-472c-b2d7-adc4404770ac None None] MFA Rules not processed for user `3cc95721c8e24d2dbdbff5488e0d8ee2`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:12:42.354029 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-5ebb3664-0f4a-472c-b2d7-adc4404770ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:12:42.382272 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359582ea-e5cb-4842-8c00-6c94c299d4d1 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:12:42.384317 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-359582ea-e5cb-4842-8c00-6c94c299d4d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:12:42.436028 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1403/2767] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:12:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:12:42.440499 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebb3664-0f4a-472c-b2d7-adc4404770ac None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:12:42.457444 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359582ea-e5cb-4842-8c00-6c94c299d4d1 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:12:42.462527 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19071dcf-89b7-4c03-9070-c68435ed0918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:12:42.463159 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19071dcf-89b7-4c03-9070-c68435ed0918 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:42.463439 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19071dcf-89b7-4c03-9070-c68435ed0918 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:42.463707 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19071dcf-89b7-4c03-9070-c68435ed0918 admin admin] PATH_INFO: `/v3/projects/eb34c4e8e6a34da1ba4c6b2ed1383089` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:42.464842 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19071dcf-89b7-4c03-9070-c68435ed0918 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb34c4e8e6a34da1ba4c6b2ed1383089)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:12:42.467002 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19071dcf-89b7-4c03-9070-c68435ed0918 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:12:42.499406 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:12:42.508871 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebb3664-0f4a-472c-b2d7-adc4404770ac None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:12:42.519753 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-19071dcf-89b7-4c03-9070-c68435ed0918 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb34c4e8e6a34da1ba4c6b2ed1383089', 'request_id': 'req-19071dcf-89b7-4c03-9070-c68435ed0918'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:12:42.530050 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-19071dcf-89b7-4c03-9070-c68435ed0918 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb34c4e8e6a34da1ba4c6b2ed1383089', 'request_id': 'req-19071dcf-89b7-4c03-9070-c68435ed0918'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:12:42.537690 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-19071dcf-89b7-4c03-9070-c68435ed0918 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb34c4e8e6a34da1ba4c6b2ed1383089', 'request_id': 'req-19071dcf-89b7-4c03-9070-c68435ed0918'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:12:42.550710 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-19071dcf-89b7-4c03-9070-c68435ed0918 admin admin] The token cache is being invalidate because project eb34c4e8e6a34da1ba4c6b2ed1383089 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:12:42.551128 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-19071dcf-89b7-4c03-9070-c68435ed0918 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:12:42.551805 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-19071dcf-89b7-4c03-9070-c68435ed0918 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:12:42.553341 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1365/2768] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:12:42 2022] DELETE /identity/v3/projects/eb34c4e8e6a34da1ba4c6b2ed1383089 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:12:42.558260 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d14b9cb-9281-4f16-990c-45ebe0a4f8f1 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:42.558546 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d14b9cb-9281-4f16-990c-45ebe0a4f8f1 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:42.558820 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d14b9cb-9281-4f16-990c-45ebe0a4f8f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:42.570946 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d6f427-ebae-4a4d-b70d-3cc2628e0602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:12:42.571561 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d6f427-ebae-4a4d-b70d-3cc2628e0602 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:42.571837 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d6f427-ebae-4a4d-b70d-3cc2628e0602 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:42.572110 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d6f427-ebae-4a4d-b70d-3cc2628e0602 admin admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:42.572744 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d6f427-ebae-4a4d-b70d-3cc2628e0602 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:12:42.574703 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d6f427-ebae-4a4d-b70d-3cc2628e0602 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:12:42.579165 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-5d14b9cb-9281-4f16-990c-45ebe0a4f8f1 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:12:42.580779 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-5d14b9cb-9281-4f16-990c-45ebe0a4f8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:12:42.590284 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1366/2769] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:12:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:12:42.595997 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:12:42.599268 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4e844-8c56-4651-9899-8c089e19eb37 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:42.599624 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4e844-8c56-4651-9899-8c089e19eb37 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:42.599905 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4e844-8c56-4651-9899-8c089e19eb37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:42.606076 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1404/2770] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:12:42 2022] POST /identity/v3/projects => generated 379 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 11:12:42.610274 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d6f427-ebae-4a4d-b70d-3cc2628e0602 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:12:42.611906 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-c4d6f427-ebae-4a4d-b70d-3cc2628e0602 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:12:42.621795 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-fde4e844-8c56-4651-9899-8c089e19eb37 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:12:42.623563 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-fde4e844-8c56-4651-9899-8c089e19eb37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:12:42.679008 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d6f427-ebae-4a4d-b70d-3cc2628e0602 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:12:42.683625 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ad244d-23f9-4968-854f-00c1e566e423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:12:42.684226 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad244d-23f9-4968-854f-00c1e566e423 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:42.685102 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad244d-23f9-4968-854f-00c1e566e423 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:42.685377 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1367/2771] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:12:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:12:42.685484 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad244d-23f9-4968-854f-00c1e566e423 admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:42.686087 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ad244d-23f9-4968-854f-00c1e566e423 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:12:42.688088 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ad244d-23f9-4968-854f-00c1e566e423 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:12:42.689731 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde4e844-8c56-4651-9899-8c089e19eb37 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:12:42.698922 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde4e844-8c56-4651-9899-8c089e19eb37 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:12:42.704159 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fba26cb-3d38-4a9b-83ed-1872f98acbf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:12:42.704805 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fba26cb-3d38-4a9b-83ed-1872f98acbf5 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:42.705185 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fba26cb-3d38-4a9b-83ed-1872f98acbf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:42.705460 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fba26cb-3d38-4a9b-83ed-1872f98acbf5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:42.706135 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fba26cb-3d38-4a9b-83ed-1872f98acbf5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:12:42.706434 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fba26cb-3d38-4a9b-83ed-1872f98acbf5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:12:42.708021 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fba26cb-3d38-4a9b-83ed-1872f98acbf5 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:12:42.709556 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1405/2772] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:12:42 2022] POST /identity/v3/users => generated 296 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 11:12:42.713375 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ad244d-23f9-4968-854f-00c1e566e423 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:12:42.721544 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1368/2773] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Aug 18 11:12:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:12:42.725564 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ad244d-23f9-4968-854f-00c1e566e423 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:12:42.725734 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fba26cb-3d38-4a9b-83ed-1872f98acbf5 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:12:42.730268 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53879069-c75f-46fe-bd3a-99d5af91d8ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:12:42.730878 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53879069-c75f-46fe-bd3a-99d5af91d8ea admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:42.731161 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53879069-c75f-46fe-bd3a-99d5af91d8ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:42.732126 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53879069-c75f-46fe-bd3a-99d5af91d8ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:42.732860 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53879069-c75f-46fe-bd3a-99d5af91d8ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:12:42.734603 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53879069-c75f-46fe-bd3a-99d5af91d8ea admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:12:42.736264 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fba26cb-3d38-4a9b-83ed-1872f98acbf5 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:12:42.740838 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6546b9fd-009a-42f0-b000-d67d1e47684e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:12:42.741429 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6546b9fd-009a-42f0-b000-d67d1e47684e admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:42.741735 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6546b9fd-009a-42f0-b000-d67d1e47684e admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:42.742008 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6546b9fd-009a-42f0-b000-d67d1e47684e admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:42.742631 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6546b9fd-009a-42f0-b000-d67d1e47684e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:12:42.744505 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6546b9fd-009a-42f0-b000-d67d1e47684e admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:12:42.745632 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1406/2774] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:12:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 11:12:42.750555 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53879069-c75f-46fe-bd3a-99d5af91d8ea admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:12:42.760299 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53879069-c75f-46fe-bd3a-99d5af91d8ea admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:12:42.766025 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f09ee3-9c51-414d-bcf2-8a07d56ec217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:12:42.766740 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f09ee3-9c51-414d-bcf2-8a07d56ec217 admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:42.767023 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f09ee3-9c51-414d-bcf2-8a07d56ec217 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:42.767295 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f09ee3-9c51-414d-bcf2-8a07d56ec217 admin admin] PATH_INFO: `/v3/projects/2dba0481c907445e80c42aff1e5835ed/users/2e653c1b47024eccafbd61b0c2bbafaf/roles/127fdc7ef05b4e0b98a940b334e5fcab` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:42.785453 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f09ee3-9c51-414d-bcf2-8a07d56ec217 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2dba0481c907445e80c42aff1e5835ed, user_id=2e653c1b47024eccafbd61b0c2bbafaf, role_id=127fdc7ef05b4e0b98a940b334e5fcab)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:12:42.788411 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f09ee3-9c51-414d-bcf2-8a07d56ec217 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:12:42.803171 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1407/2775] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:12:42 2022] PUT /identity/v3/projects/2dba0481c907445e80c42aff1e5835ed/users/2e653c1b47024eccafbd61b0c2bbafaf/roles/127fdc7ef05b4e0b98a940b334e5fcab => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:12:42.807474 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f09ee3-9c51-414d-bcf2-8a07d56ec217 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:12:42.874131 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f09ee3-9c51-414d-bcf2-8a07d56ec217 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:12:42.878794 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea9ed06-7510-4422-b286-92870bd594f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:12:42.879406 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea9ed06-7510-4422-b286-92870bd594f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:42.879681 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea9ed06-7510-4422-b286-92870bd594f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:42.879952 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea9ed06-7510-4422-b286-92870bd594f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:42.880599 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea9ed06-7510-4422-b286-92870bd594f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:12:42.882223 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea9ed06-7510-4422-b286-92870bd594f6 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:12:42.893197 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1408/2776] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:12:42 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 11:12:42.897489 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea9ed06-7510-4422-b286-92870bd594f6 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:12:42.911128 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea9ed06-7510-4422-b286-92870bd594f6 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:12:42.915240 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1369/2777] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:12:42 2022] POST /identity/v3/projects => generated 377 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 11:12:42.920476 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6546b9fd-009a-42f0-b000-d67d1e47684e admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:12:42.921626 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d071c1-88a7-4aeb-ac1e-7b7c557d34b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:12:42.922725 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d071c1-88a7-4aeb-ac1e-7b7c557d34b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:42.923021 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d071c1-88a7-4aeb-ac1e-7b7c557d34b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:42.923298 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d071c1-88a7-4aeb-ac1e-7b7c557d34b2 admin admin] PATH_INFO: `/v3/projects/2dba0481c907445e80c42aff1e5835ed/users/2e653c1b47024eccafbd61b0c2bbafaf/roles/127fdc7ef05b4e0b98a940b334e5fcab` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:42.925263 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d071c1-88a7-4aeb-ac1e-7b7c557d34b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2dba0481c907445e80c42aff1e5835ed, user_id=2e653c1b47024eccafbd61b0c2bbafaf, role_id=127fdc7ef05b4e0b98a940b334e5fcab)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:12:42.927928 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d071c1-88a7-4aeb-ac1e-7b7c557d34b2 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:12:42.939073 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1409/2778] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:12:42 2022] PUT /identity/v3/projects/2dba0481c907445e80c42aff1e5835ed/users/2e653c1b47024eccafbd61b0c2bbafaf/roles/127fdc7ef05b4e0b98a940b334e5fcab => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:12:42.949548 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6736e72f-4f2b-4ba1-8f26-8b06a2418cc2 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:42.949901 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6736e72f-4f2b-4ba1-8f26-8b06a2418cc2 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:42.950151 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6736e72f-4f2b-4ba1-8f26-8b06a2418cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:42.979937 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-6736e72f-4f2b-4ba1-8f26-8b06a2418cc2 None None] MFA Rules not processed for user `2e653c1b47024eccafbd61b0c2bbafaf`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:12:42.981156 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-6736e72f-4f2b-4ba1-8f26-8b06a2418cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:12:42.985885 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6546b9fd-009a-42f0-b000-d67d1e47684e admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:12:43.008875 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:12:43.011936 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:12:43.055195 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc836b6e-4a3a-4589-9aa6-18047da1875f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:12:43.055834 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc836b6e-4a3a-4589-9aa6-18047da1875f admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:43.056108 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc836b6e-4a3a-4589-9aa6-18047da1875f admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:43.056427 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc836b6e-4a3a-4589-9aa6-18047da1875f admin admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:43.056993 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc836b6e-4a3a-4589-9aa6-18047da1875f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:12:43.058941 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc836b6e-4a3a-4589-9aa6-18047da1875f admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:12:43.059480 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1410/2779] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:12:42 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:12:43.072144 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6736e72f-4f2b-4ba1-8f26-8b06a2418cc2 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:12:43.073690 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-6736e72f-4f2b-4ba1-8f26-8b06a2418cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:12:43.085710 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1370/2780] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:12:42 2022] POST /identity/v3/users => generated 289 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 11:12:43.087722 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc836b6e-4a3a-4589-9aa6-18047da1875f admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:12:43.098929 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc836b6e-4a3a-4589-9aa6-18047da1875f admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:12:43.103628 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fa9d26-9555-4659-babd-d9b89b7d8938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:12:43.104224 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa9d26-9555-4659-babd-d9b89b7d8938 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:43.104879 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa9d26-9555-4659-babd-d9b89b7d8938 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:43.104879 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa9d26-9555-4659-babd-d9b89b7d8938 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:43.105415 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fa9d26-9555-4659-babd-d9b89b7d8938 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:12:43.108256 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fa9d26-9555-4659-babd-d9b89b7d8938 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:12:43.118759 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1371/2781] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:12:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:12:43.123997 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fa9d26-9555-4659-babd-d9b89b7d8938 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:12:43.133724 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fa9d26-9555-4659-babd-d9b89b7d8938 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:12:43.139605 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06022114-e752-469d-abd7-961d5618d825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:12:43.140227 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06022114-e752-469d-abd7-961d5618d825 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:43.140513 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06022114-e752-469d-abd7-961d5618d825 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:43.140898 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06022114-e752-469d-abd7-961d5618d825 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:43.141429 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06022114-e752-469d-abd7-961d5618d825 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:12:43.143049 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06022114-e752-469d-abd7-961d5618d825 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:12:43.153195 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1372/2782] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:12:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 11:12:43.157418 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06022114-e752-469d-abd7-961d5618d825 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:12:43.162330 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6736e72f-4f2b-4ba1-8f26-8b06a2418cc2 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:12:43.166875 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91841ddf-1f1f-4ac0-b550-447c7eaf8906 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b8a09704b9b4ab2bffb813796ec6e77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:12:43.167502 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91841ddf-1f1f-4ac0-b550-447c7eaf8906 service cinder] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:43.168021 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91841ddf-1f1f-4ac0-b550-447c7eaf8906 service cinder] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:43.168305 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91841ddf-1f1f-4ac0-b550-447c7eaf8906 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:43.168881 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06022114-e752-469d-abd7-961d5618d825 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:12:43.175238 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57acf6e0-9f4a-4d00-ad9b-143e80238ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:12:43.175928 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57acf6e0-9f4a-4d00-ad9b-143e80238ccf admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:43.176209 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57acf6e0-9f4a-4d00-ad9b-143e80238ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:43.176483 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57acf6e0-9f4a-4d00-ad9b-143e80238ccf admin admin] PATH_INFO: `/v3/projects/4cd8f29717d84b5ebfa176b0040f5778/users/d4e3a8a1512c47a19cd3c23f171e24c6/roles/719e5c62188d4f8a838987d6e72ca8f7` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:43.179659 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91841ddf-1f1f-4ac0-b550-447c7eaf8906 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:12:43.181239 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91841ddf-1f1f-4ac0-b550-447c7eaf8906 service cinder] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:12:43.193120 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1411/2783] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:12:43 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 11:12:43.194878 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57acf6e0-9f4a-4d00-ad9b-143e80238ccf admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cd8f29717d84b5ebfa176b0040f5778, user_id=d4e3a8a1512c47a19cd3c23f171e24c6, role_id=719e5c62188d4f8a838987d6e72ca8f7)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:12:43.197509 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57acf6e0-9f4a-4d00-ad9b-143e80238ccf admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:12:43.212739 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1373/2784] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:12:43 2022] PUT /identity/v3/projects/4cd8f29717d84b5ebfa176b0040f5778/users/d4e3a8a1512c47a19cd3c23f171e24c6/roles/719e5c62188d4f8a838987d6e72ca8f7 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:12:43.219292 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ede9e-4af6-45ba-98fe-fc5333411f9a None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:43.219580 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ede9e-4af6-45ba-98fe-fc5333411f9a None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:43.219855 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ede9e-4af6-45ba-98fe-fc5333411f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:43.239794 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-dc6ede9e-4af6-45ba-98fe-fc5333411f9a None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:12:43.241246 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-dc6ede9e-4af6-45ba-98fe-fc5333411f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:12:43.313041 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1412/2785] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:12:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:12:43.319917 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57acf6e0-9f4a-4d00-ad9b-143e80238ccf admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:12:43.321858 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-57acf6e0-9f4a-4d00-ad9b-143e80238ccf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:12:43.379979 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57acf6e0-9f4a-4d00-ad9b-143e80238ccf admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:12:43.385040 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d47a955-fb6d-4cc7-8e80-0ae314e7a269 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:12:43.385599 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d47a955-fb6d-4cc7-8e80-0ae314e7a269 service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:43.385886 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d47a955-fb6d-4cc7-8e80-0ae314e7a269 service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:43.386162 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d47a955-fb6d-4cc7-8e80-0ae314e7a269 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:43.396946 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d47a955-fb6d-4cc7-8e80-0ae314e7a269 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:12:43.398429 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d47a955-fb6d-4cc7-8e80-0ae314e7a269 service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:12:43.409613 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1374/2786] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:12:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:12:43.529956 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6ede9e-4af6-45ba-98fe-fc5333411f9a None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:12:43.581178 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:12:43.599690 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6ede9e-4af6-45ba-98fe-fc5333411f9a None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:12:43.604443 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1612cafa-e925-4e49-9ac2-3291abe35cb8 tempest-VolumeQuotaClassesTest-915330781 tempest-VolumeQuotaClassesTest-915330781-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e653c1b47024eccafbd61b0c2bbafaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dba0481c907445e80c42aff1e5835ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:12:43.605388 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1612cafa-e925-4e49-9ac2-3291abe35cb8 tempest-VolumeQuotaClassesTest-915330781 tempest-VolumeQuotaClassesTest-915330781-project-admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:43.605388 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1612cafa-e925-4e49-9ac2-3291abe35cb8 tempest-VolumeQuotaClassesTest-915330781 tempest-VolumeQuotaClassesTest-915330781-project-admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:43.605691 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1612cafa-e925-4e49-9ac2-3291abe35cb8 tempest-VolumeQuotaClassesTest-915330781 tempest-VolumeQuotaClassesTest-915330781-project-admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:43.606826 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1612cafa-e925-4e49-9ac2-3291abe35cb8 tempest-VolumeQuotaClassesTest-915330781 tempest-VolumeQuotaClassesTest-915330781-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:12:43.607139 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1612cafa-e925-4e49-9ac2-3291abe35cb8 tempest-VolumeQuotaClassesTest-915330781 tempest-VolumeQuotaClassesTest-915330781-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:12:43.608808 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1612cafa-e925-4e49-9ac2-3291abe35cb8 tempest-VolumeQuotaClassesTest-915330781 tempest-VolumeQuotaClassesTest-915330781-project-admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:12:43.621906 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1413/2787] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Aug 18 11:12:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:12:43.626519 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d47a955-fb6d-4cc7-8e80-0ae314e7a269 service neutron] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:12:43.637538 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d47a955-fb6d-4cc7-8e80-0ae314e7a269 service neutron] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:12:43.642799 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18037abd-2c3c-47ba-b22f-605fb993d5c9 tempest-VolumeQuotaClassesTest-915330781 tempest-VolumeQuotaClassesTest-915330781-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e653c1b47024eccafbd61b0c2bbafaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dba0481c907445e80c42aff1e5835ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:12:43.643421 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18037abd-2c3c-47ba-b22f-605fb993d5c9 tempest-VolumeQuotaClassesTest-915330781 tempest-VolumeQuotaClassesTest-915330781-project-admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:43.643735 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18037abd-2c3c-47ba-b22f-605fb993d5c9 tempest-VolumeQuotaClassesTest-915330781 tempest-VolumeQuotaClassesTest-915330781-project-admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:43.644028 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18037abd-2c3c-47ba-b22f-605fb993d5c9 tempest-VolumeQuotaClassesTest-915330781 tempest-VolumeQuotaClassesTest-915330781-project-admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:43.644687 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18037abd-2c3c-47ba-b22f-605fb993d5c9 tempest-VolumeQuotaClassesTest-915330781 tempest-VolumeQuotaClassesTest-915330781-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:12:43.646624 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18037abd-2c3c-47ba-b22f-605fb993d5c9 tempest-VolumeQuotaClassesTest-915330781 tempest-VolumeQuotaClassesTest-915330781-project-admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:12:43.684406 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1375/2788] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:12:43 2022] POST /identity/v3/projects => generated 351 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:12:43.689393 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1612cafa-e925-4e49-9ac2-3291abe35cb8 tempest-VolumeQuotaClassesTest-915330781 tempest-VolumeQuotaClassesTest-915330781-project-admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:12:43.701328 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1612cafa-e925-4e49-9ac2-3291abe35cb8 tempest-VolumeQuotaClassesTest-915330781 tempest-VolumeQuotaClassesTest-915330781-project-admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:12:43.765267 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f6d519-c7c0-4759-be2e-b162fa495b70 tempest-VolumeQuotaClassesTest-915330781 tempest-VolumeQuotaClassesTest-915330781-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e653c1b47024eccafbd61b0c2bbafaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dba0481c907445e80c42aff1e5835ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:12:43.766004 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6d519-c7c0-4759-be2e-b162fa495b70 tempest-VolumeQuotaClassesTest-915330781 tempest-VolumeQuotaClassesTest-915330781-project-admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:43.766289 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6d519-c7c0-4759-be2e-b162fa495b70 tempest-VolumeQuotaClassesTest-915330781 tempest-VolumeQuotaClassesTest-915330781-project-admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:43.766572 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6d519-c7c0-4759-be2e-b162fa495b70 tempest-VolumeQuotaClassesTest-915330781 tempest-VolumeQuotaClassesTest-915330781-project-admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:43.767408 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f6d519-c7c0-4759-be2e-b162fa495b70 tempest-VolumeQuotaClassesTest-915330781 tempest-VolumeQuotaClassesTest-915330781-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:12:43.767721 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f6d519-c7c0-4759-be2e-b162fa495b70 tempest-VolumeQuotaClassesTest-915330781 tempest-VolumeQuotaClassesTest-915330781-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:12:43.769682 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f6d519-c7c0-4759-be2e-b162fa495b70 tempest-VolumeQuotaClassesTest-915330781 tempest-VolumeQuotaClassesTest-915330781-project-admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:12:43.787560 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1414/2789] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Aug 18 11:12:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:12:43.830195 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18037abd-2c3c-47ba-b22f-605fb993d5c9 tempest-VolumeQuotaClassesTest-915330781 tempest-VolumeQuotaClassesTest-915330781-project-admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:12:43.841748 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18037abd-2c3c-47ba-b22f-605fb993d5c9 tempest-VolumeQuotaClassesTest-915330781 tempest-VolumeQuotaClassesTest-915330781-project-admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:12:43.847837 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdc42aa-05b6-44af-b25a-2a70a7d10bab tempest-VolumeQuotaClassesTest-915330781 tempest-VolumeQuotaClassesTest-915330781-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e653c1b47024eccafbd61b0c2bbafaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dba0481c907445e80c42aff1e5835ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:12:43.848919 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc42aa-05b6-44af-b25a-2a70a7d10bab tempest-VolumeQuotaClassesTest-915330781 tempest-VolumeQuotaClassesTest-915330781-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:43.848919 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc42aa-05b6-44af-b25a-2a70a7d10bab tempest-VolumeQuotaClassesTest-915330781 tempest-VolumeQuotaClassesTest-915330781-project-admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:43.849116 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc42aa-05b6-44af-b25a-2a70a7d10bab tempest-VolumeQuotaClassesTest-915330781 tempest-VolumeQuotaClassesTest-915330781-project-admin] PATH_INFO: `/v3/projects/a6df4e9d98d34ce8a2a0d01e916185f9` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:43.850239 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdc42aa-05b6-44af-b25a-2a70a7d10bab tempest-VolumeQuotaClassesTest-915330781 tempest-VolumeQuotaClassesTest-915330781-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a6df4e9d98d34ce8a2a0d01e916185f9)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:12:43.852338 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdc42aa-05b6-44af-b25a-2a70a7d10bab tempest-VolumeQuotaClassesTest-915330781 tempest-VolumeQuotaClassesTest-915330781-project-admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:12:43.896433 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:12:43.907114 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-3fdc42aa-05b6-44af-b25a-2a70a7d10bab tempest-VolumeQuotaClassesTest-915330781 tempest-VolumeQuotaClassesTest-915330781-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6df4e9d98d34ce8a2a0d01e916185f9', 'request_id': 'req-3fdc42aa-05b6-44af-b25a-2a70a7d10bab'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:12:43.916907 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-3fdc42aa-05b6-44af-b25a-2a70a7d10bab tempest-VolumeQuotaClassesTest-915330781 tempest-VolumeQuotaClassesTest-915330781-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6df4e9d98d34ce8a2a0d01e916185f9', 'request_id': 'req-3fdc42aa-05b6-44af-b25a-2a70a7d10bab'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:12:43.925775 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-3fdc42aa-05b6-44af-b25a-2a70a7d10bab tempest-VolumeQuotaClassesTest-915330781 tempest-VolumeQuotaClassesTest-915330781-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6df4e9d98d34ce8a2a0d01e916185f9', 'request_id': 'req-3fdc42aa-05b6-44af-b25a-2a70a7d10bab'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:12:43.937976 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-3fdc42aa-05b6-44af-b25a-2a70a7d10bab tempest-VolumeQuotaClassesTest-915330781 tempest-VolumeQuotaClassesTest-915330781-project-admin] The token cache is being invalidate because project a6df4e9d98d34ce8a2a0d01e916185f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:12:43.938266 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-3fdc42aa-05b6-44af-b25a-2a70a7d10bab tempest-VolumeQuotaClassesTest-915330781 tempest-VolumeQuotaClassesTest-915330781-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:12:43.938951 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-3fdc42aa-05b6-44af-b25a-2a70a7d10bab tempest-VolumeQuotaClassesTest-915330781 tempest-VolumeQuotaClassesTest-915330781-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:12:43.940462 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1376/2790] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:12:43 2022] DELETE /identity/v3/projects/a6df4e9d98d34ce8a2a0d01e916185f9 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:12:44.164659 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f6d519-c7c0-4759-be2e-b162fa495b70 tempest-VolumeQuotaClassesTest-915330781 tempest-VolumeQuotaClassesTest-915330781-project-admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:12:44.166495 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-63f6d519-c7c0-4759-be2e-b162fa495b70 tempest-VolumeQuotaClassesTest-915330781 tempest-VolumeQuotaClassesTest-915330781-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:12:44.257320 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f6d519-c7c0-4759-be2e-b162fa495b70 tempest-VolumeQuotaClassesTest-915330781 tempest-VolumeQuotaClassesTest-915330781-project-admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:12:44.339443 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4378e50f-1949-48d0-865e-ad25cdc1b31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:12:44.340442 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4378e50f-1949-48d0-865e-ad25cdc1b31c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:44.341191 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4378e50f-1949-48d0-865e-ad25cdc1b31c admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:44.341712 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4378e50f-1949-48d0-865e-ad25cdc1b31c admin admin] PATH_INFO: `/v3/users/3cc95721c8e24d2dbdbff5488e0d8ee2` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:44.343129 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4378e50f-1949-48d0-865e-ad25cdc1b31c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cc95721c8e24d2dbdbff5488e0d8ee2)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:12:44.345262 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4378e50f-1949-48d0-865e-ad25cdc1b31c admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:12:44.373810 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:12:44.409883 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-4378e50f-1949-48d0-865e-ad25cdc1b31c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cc95721c8e24d2dbdbff5488e0d8ee2'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:12:44.411073 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-4378e50f-1949-48d0-865e-ad25cdc1b31c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cc95721c8e24d2dbdbff5488e0d8ee2'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:12:44.420862 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-4378e50f-1949-48d0-865e-ad25cdc1b31c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cc95721c8e24d2dbdbff5488e0d8ee2'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:12:44.436162 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-4378e50f-1949-48d0-865e-ad25cdc1b31c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cc95721c8e24d2dbdbff5488e0d8ee2'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:12:44.444375 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-4378e50f-1949-48d0-865e-ad25cdc1b31c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cc95721c8e24d2dbdbff5488e0d8ee2'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:12:44.451830 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1415/2791] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:12:44 2022] DELETE /identity/v3/users/3cc95721c8e24d2dbdbff5488e0d8ee2 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:12:44.456647 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e03f59-b3e7-44f8-953c-82fd6200b8a4 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:44.457167 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e03f59-b3e7-44f8-953c-82fd6200b8a4 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:44.457345 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e03f59-b3e7-44f8-953c-82fd6200b8a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:44.478327 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-06e03f59-b3e7-44f8-953c-82fd6200b8a4 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:12:44.479669 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-06e03f59-b3e7-44f8-953c-82fd6200b8a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:12:44.552658 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1377/2792] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:12:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:12:44.563885 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4378e50f-1949-48d0-865e-ad25cdc1b31c admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:12:44.565595 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-4378e50f-1949-48d0-865e-ad25cdc1b31c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:12:44.631481 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4378e50f-1949-48d0-865e-ad25cdc1b31c admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:12:44.636204 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab2b4a0-b633-416c-af6c-32fee8d47779 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:12:44.639084 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab2b4a0-b633-416c-af6c-32fee8d47779 service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:44.639084 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab2b4a0-b633-416c-af6c-32fee8d47779 service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:44.639084 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab2b4a0-b633-416c-af6c-32fee8d47779 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:44.648854 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab2b4a0-b633-416c-af6c-32fee8d47779 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:12:44.650196 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab2b4a0-b633-416c-af6c-32fee8d47779 service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:12:44.664516 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1416/2793] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:12:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:12:44.979970 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e03f59-b3e7-44f8-953c-82fd6200b8a4 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:12:44.982764 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-06e03f59-b3e7-44f8-953c-82fd6200b8a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:12:44.999830 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e03f59-b3e7-44f8-953c-82fd6200b8a4 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:12:45.030214 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe1843d-53a5-4e04-af8b-634e14345e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:12:45.032292 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe1843d-53a5-4e04-af8b-634e14345e68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:45.032292 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe1843d-53a5-4e04-af8b-634e14345e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:45.032515 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe1843d-53a5-4e04-af8b-634e14345e68 admin admin] PATH_INFO: `/v3/projects/3786ef3d535f4999afa8cb0385ba9c6b` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:45.036624 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe1843d-53a5-4e04-af8b-634e14345e68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3786ef3d535f4999afa8cb0385ba9c6b)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:12:45.040101 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe1843d-53a5-4e04-af8b-634e14345e68 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:12:45.098635 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-7fe1843d-53a5-4e04-af8b-634e14345e68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3786ef3d535f4999afa8cb0385ba9c6b', 'request_id': 'req-7fe1843d-53a5-4e04-af8b-634e14345e68'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:12:45.108894 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-7fe1843d-53a5-4e04-af8b-634e14345e68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3786ef3d535f4999afa8cb0385ba9c6b', 'request_id': 'req-7fe1843d-53a5-4e04-af8b-634e14345e68'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:12:45.117022 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-7fe1843d-53a5-4e04-af8b-634e14345e68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3786ef3d535f4999afa8cb0385ba9c6b', 'request_id': 'req-7fe1843d-53a5-4e04-af8b-634e14345e68'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:12:45.129906 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-7fe1843d-53a5-4e04-af8b-634e14345e68 admin admin] The token cache is being invalidate because project 3786ef3d535f4999afa8cb0385ba9c6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:12:45.130203 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-7fe1843d-53a5-4e04-af8b-634e14345e68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:12:45.130872 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-7fe1843d-53a5-4e04-af8b-634e14345e68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:12:45.134090 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1378/2794] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:12:44 2022] DELETE /identity/v3/projects/3786ef3d535f4999afa8cb0385ba9c6b => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:12:45.139129 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab2b4a0-b633-416c-af6c-32fee8d47779 service neutron] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:12:45.162358 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab2b4a0-b633-416c-af6c-32fee8d47779 service neutron] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:12:45.258689 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f27378-8fd5-4ba1-bd86-f3e835bdd9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:12:45.259502 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f27378-8fd5-4ba1-bd86-f3e835bdd9a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:45.259936 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f27378-8fd5-4ba1-bd86-f3e835bdd9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:45.260174 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f27378-8fd5-4ba1-bd86-f3e835bdd9a9 admin admin] PATH_INFO: `/v3/users/2e653c1b47024eccafbd61b0c2bbafaf` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:45.261431 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f27378-8fd5-4ba1-bd86-f3e835bdd9a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e653c1b47024eccafbd61b0c2bbafaf)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:12:45.263506 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f27378-8fd5-4ba1-bd86-f3e835bdd9a9 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:12:45.328552 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:12:45.333668 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-96f27378-8fd5-4ba1-bd86-f3e835bdd9a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e653c1b47024eccafbd61b0c2bbafaf'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:12:45.334960 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-96f27378-8fd5-4ba1-bd86-f3e835bdd9a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e653c1b47024eccafbd61b0c2bbafaf'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:12:45.348470 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-96f27378-8fd5-4ba1-bd86-f3e835bdd9a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e653c1b47024eccafbd61b0c2bbafaf'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:12:45.369586 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-96f27378-8fd5-4ba1-bd86-f3e835bdd9a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e653c1b47024eccafbd61b0c2bbafaf'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:12:45.379499 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-96f27378-8fd5-4ba1-bd86-f3e835bdd9a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e653c1b47024eccafbd61b0c2bbafaf'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:12:45.386988 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1417/2795] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:12:45 2022] DELETE /identity/v3/users/2e653c1b47024eccafbd61b0c2bbafaf => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:12:45.720348 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe1843d-53a5-4e04-af8b-634e14345e68 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:12:45.721953 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-7fe1843d-53a5-4e04-af8b-634e14345e68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:12:45.743656 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe1843d-53a5-4e04-af8b-634e14345e68 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:12:45.827791 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:12:45.844216 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cc6016-3247-4b7f-9d2a-8a376bb94876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:12:45.845236 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cc6016-3247-4b7f-9d2a-8a376bb94876 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:45.846282 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cc6016-3247-4b7f-9d2a-8a376bb94876 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:45.846907 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cc6016-3247-4b7f-9d2a-8a376bb94876 admin admin] PATH_INFO: `/v3/projects/2dba0481c907445e80c42aff1e5835ed` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:45.849547 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cc6016-3247-4b7f-9d2a-8a376bb94876 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2dba0481c907445e80c42aff1e5835ed)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:12:45.851639 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cc6016-3247-4b7f-9d2a-8a376bb94876 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:12:45.928801 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-93cc6016-3247-4b7f-9d2a-8a376bb94876 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2dba0481c907445e80c42aff1e5835ed', 'request_id': 'req-93cc6016-3247-4b7f-9d2a-8a376bb94876'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:12:45.940196 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-93cc6016-3247-4b7f-9d2a-8a376bb94876 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2dba0481c907445e80c42aff1e5835ed', 'request_id': 'req-93cc6016-3247-4b7f-9d2a-8a376bb94876'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:12:45.949683 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-93cc6016-3247-4b7f-9d2a-8a376bb94876 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2dba0481c907445e80c42aff1e5835ed', 'request_id': 'req-93cc6016-3247-4b7f-9d2a-8a376bb94876'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:12:45.970526 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-93cc6016-3247-4b7f-9d2a-8a376bb94876 admin admin] The token cache is being invalidate because project 2dba0481c907445e80c42aff1e5835ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:12:45.970841 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-93cc6016-3247-4b7f-9d2a-8a376bb94876 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:12:45.971741 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-93cc6016-3247-4b7f-9d2a-8a376bb94876 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:12:45.974661 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1379/2796] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:12:45 2022] DELETE /identity/v3/projects/2dba0481c907445e80c42aff1e5835ed => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:12:45.979449 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509ba56b-920c-45c4-be4e-ac74993252ab None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:45.979969 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509ba56b-920c-45c4-be4e-ac74993252ab None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:45.980125 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509ba56b-920c-45c4-be4e-ac74993252ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:46.005873 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-509ba56b-920c-45c4-be4e-ac74993252ab None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:12:46.007425 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-509ba56b-920c-45c4-be4e-ac74993252ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:12:46.086696 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1418/2797] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:12:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:12:46.088346 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab02e65-6d4c-447e-97f1-410e8b8d2123 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:46.088637 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab02e65-6d4c-447e-97f1-410e8b8d2123 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:46.088937 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab02e65-6d4c-447e-97f1-410e8b8d2123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:46.113235 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-6ab02e65-6d4c-447e-97f1-410e8b8d2123 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:12:46.115010 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-6ab02e65-6d4c-447e-97f1-410e8b8d2123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:12:46.125000 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1380/2798] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:12:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:12:46.129427 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509ba56b-920c-45c4-be4e-ac74993252ab None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:12:46.141561 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509ba56b-920c-45c4-be4e-ac74993252ab None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:12:46.147617 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6c1bc9-5201-4f47-8c79-f728bf6d4c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:12:46.148580 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c1bc9-5201-4f47-8c79-f728bf6d4c96 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:46.148919 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c1bc9-5201-4f47-8c79-f728bf6d4c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:46.149367 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c1bc9-5201-4f47-8c79-f728bf6d4c96 admin admin] PATH_INFO: `/v3/domains` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:46.150332 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6c1bc9-5201-4f47-8c79-f728bf6d4c96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:12:46.150785 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6c1bc9-5201-4f47-8c79-f728bf6d4c96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:12:46.154424 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6c1bc9-5201-4f47-8c79-f728bf6d4c96 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:12:46.174034 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab02e65-6d4c-447e-97f1-410e8b8d2123 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:12:46.179001 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1419/2799] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Aug 18 11:12:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:12:46.186062 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab02e65-6d4c-447e-97f1-410e8b8d2123 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:12:46.207072 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de04653d-0078-4294-aa7a-690c2a8cee7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:12:46.207314 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de04653d-0078-4294-aa7a-690c2a8cee7c admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:46.207503 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de04653d-0078-4294-aa7a-690c2a8cee7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:46.207780 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de04653d-0078-4294-aa7a-690c2a8cee7c admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:46.208423 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de04653d-0078-4294-aa7a-690c2a8cee7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:12:46.210747 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de04653d-0078-4294-aa7a-690c2a8cee7c admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:12:46.246215 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1381/2800] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:12:46 2022] POST /identity/v3/projects => generated 385 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 11:12:46.250670 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6c1bc9-5201-4f47-8c79-f728bf6d4c96 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:12:46.261720 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6c1bc9-5201-4f47-8c79-f728bf6d4c96 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:12:46.357375 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1085aa-c744-4f38-96a9-3524646424ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:12:46.358674 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1085aa-c744-4f38-96a9-3524646424ae admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:46.358951 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1085aa-c744-4f38-96a9-3524646424ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:46.359232 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1085aa-c744-4f38-96a9-3524646424ae admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:46.359972 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1085aa-c744-4f38-96a9-3524646424ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:12:46.362030 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1085aa-c744-4f38-96a9-3524646424ae admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:12:46.389194 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1420/2801] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:12:46 2022] POST /identity/v3/users => generated 293 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:12:46.393865 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de04653d-0078-4294-aa7a-690c2a8cee7c admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:12:46.406789 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de04653d-0078-4294-aa7a-690c2a8cee7c admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:12:46.421324 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143c99b9-1926-418c-9c27-7985ec8d1399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:12:46.422143 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143c99b9-1926-418c-9c27-7985ec8d1399 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:46.422509 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143c99b9-1926-418c-9c27-7985ec8d1399 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:46.422955 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143c99b9-1926-418c-9c27-7985ec8d1399 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:46.423583 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143c99b9-1926-418c-9c27-7985ec8d1399 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:12:46.425098 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143c99b9-1926-418c-9c27-7985ec8d1399 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:12:46.441143 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1382/2802] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:12:46 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:12:46.444887 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1085aa-c744-4f38-96a9-3524646424ae admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:12:46.463683 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1085aa-c744-4f38-96a9-3524646424ae admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:12:46.473424 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d56c2ab-a594-43e3-af9d-fcd3ed146489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:12:46.474093 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d56c2ab-a594-43e3-af9d-fcd3ed146489 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:46.474375 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d56c2ab-a594-43e3-af9d-fcd3ed146489 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:46.474665 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d56c2ab-a594-43e3-af9d-fcd3ed146489 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:46.475294 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d56c2ab-a594-43e3-af9d-fcd3ed146489 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:12:46.477571 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d56c2ab-a594-43e3-af9d-fcd3ed146489 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:12:46.496341 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1421/2803] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:12:46 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 11:12:46.498808 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143c99b9-1926-418c-9c27-7985ec8d1399 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:12:46.510612 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143c99b9-1926-418c-9c27-7985ec8d1399 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:12:46.519361 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab88e31d-0fc5-4582-b0d6-d213bc5467da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:12:46.520527 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88e31d-0fc5-4582-b0d6-d213bc5467da admin admin] REQUEST_METHOD: `PUT` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:46.521008 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88e31d-0fc5-4582-b0d6-d213bc5467da admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:46.522331 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88e31d-0fc5-4582-b0d6-d213bc5467da admin admin] PATH_INFO: `/v3/projects/d5a047fed94948ee899939c723fb6be6/users/c9db4a22849d44beb8f3879efab73d18/roles/719e5c62188d4f8a838987d6e72ca8f7` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:46.542104 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab88e31d-0fc5-4582-b0d6-d213bc5467da admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5a047fed94948ee899939c723fb6be6, user_id=c9db4a22849d44beb8f3879efab73d18, role_id=719e5c62188d4f8a838987d6e72ca8f7)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:12:46.546113 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab88e31d-0fc5-4582-b0d6-d213bc5467da admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:12:46.571769 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1383/2804] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:12:46 2022] PUT /identity/v3/projects/d5a047fed94948ee899939c723fb6be6/users/c9db4a22849d44beb8f3879efab73d18/roles/719e5c62188d4f8a838987d6e72ca8f7 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:12:46.583254 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22444315-0b02-4b64-827b-972f4c8ed6f7 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:46.583254 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22444315-0b02-4b64-827b-972f4c8ed6f7 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:46.583254 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22444315-0b02-4b64-827b-972f4c8ed6f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:46.622732 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-22444315-0b02-4b64-827b-972f4c8ed6f7 None None] MFA Rules not processed for user `c9db4a22849d44beb8f3879efab73d18`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:12:46.624538 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-22444315-0b02-4b64-827b-972f4c8ed6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:12:46.641992 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:12:46.718653 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1422/2805] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:12:46 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:12:46.726720 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab88e31d-0fc5-4582-b0d6-d213bc5467da admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:12:46.728502 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-ab88e31d-0fc5-4582-b0d6-d213bc5467da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:12:46.822528 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab88e31d-0fc5-4582-b0d6-d213bc5467da admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:12:46.827399 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c7713b-6d41-41e3-9972-1c7471dbbf05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b8a09704b9b4ab2bffb813796ec6e77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:12:46.828119 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c7713b-6d41-41e3-9972-1c7471dbbf05 service cinder] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:46.828432 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c7713b-6d41-41e3-9972-1c7471dbbf05 service cinder] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:46.828743 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c7713b-6d41-41e3-9972-1c7471dbbf05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:46.842542 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c7713b-6d41-41e3-9972-1c7471dbbf05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:12:46.845204 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c7713b-6d41-41e3-9972-1c7471dbbf05 service cinder] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:12:46.863082 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1384/2806] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:12:46 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:12:48.056924 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b413857-cebf-4a45-a931-aad22dc0d407 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:48.057496 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b413857-cebf-4a45-a931-aad22dc0d407 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:48.057496 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b413857-cebf-4a45-a931-aad22dc0d407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:48.088341 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-9b413857-cebf-4a45-a931-aad22dc0d407 None None] MFA Rules not processed for user `d4e3a8a1512c47a19cd3c23f171e24c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:12:48.089581 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-9b413857-cebf-4a45-a931-aad22dc0d407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:12:48.158120 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1423/2807] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:12:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:12:48.162560 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c7713b-6d41-41e3-9972-1c7471dbbf05 service cinder] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:12:48.163953 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-23c7713b-6d41-41e3-9972-1c7471dbbf05 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:12:48.187113 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:12:48.237061 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c7713b-6d41-41e3-9972-1c7471dbbf05 service cinder] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:12:48.241576 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97c74ce-7771-47bf-8f0d-03efc1e6a925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:12:48.242289 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c74ce-7771-47bf-8f0d-03efc1e6a925 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:48.242578 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c74ce-7771-47bf-8f0d-03efc1e6a925 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:48.242853 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c74ce-7771-47bf-8f0d-03efc1e6a925 admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:48.243479 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97c74ce-7771-47bf-8f0d-03efc1e6a925 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:12:48.245375 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97c74ce-7771-47bf-8f0d-03efc1e6a925 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:12:48.272236 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1385/2808] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:12:48 2022] POST /identity/v3/projects => generated 377 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:12:48.276457 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b413857-cebf-4a45-a931-aad22dc0d407 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:12:48.288200 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b413857-cebf-4a45-a931-aad22dc0d407 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:12:48.352972 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e1f257-d293-402e-a11b-299ec2665a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:12:48.353616 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e1f257-d293-402e-a11b-299ec2665a69 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:48.353895 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e1f257-d293-402e-a11b-299ec2665a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:48.354192 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e1f257-d293-402e-a11b-299ec2665a69 admin admin] PATH_INFO: `/v3/users` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:48.354818 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e1f257-d293-402e-a11b-299ec2665a69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:12:48.356818 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e1f257-d293-402e-a11b-299ec2665a69 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:12:48.380708 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1424/2809] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:12:48 2022] POST /identity/v3/users => generated 295 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:12:48.384716 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97c74ce-7771-47bf-8f0d-03efc1e6a925 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:12:48.398225 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97c74ce-7771-47bf-8f0d-03efc1e6a925 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:12:48.403794 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf77264-88f3-4de0-98c6-3eed0d9dde0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:12:48.404854 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf77264-88f3-4de0-98c6-3eed0d9dde0e admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:48.404854 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf77264-88f3-4de0-98c6-3eed0d9dde0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:48.405053 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf77264-88f3-4de0-98c6-3eed0d9dde0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:48.405670 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf77264-88f3-4de0-98c6-3eed0d9dde0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:12:48.407276 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf77264-88f3-4de0-98c6-3eed0d9dde0e admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:12:48.418716 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1386/2810] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:12:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 11:12:48.423641 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e1f257-d293-402e-a11b-299ec2665a69 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:12:48.434667 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e1f257-d293-402e-a11b-299ec2665a69 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:12:48.439589 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b3e116-b9ef-4c30-b8e5-bacecb444296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:12:48.440258 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b3e116-b9ef-4c30-b8e5-bacecb444296 admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:48.440539 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b3e116-b9ef-4c30-b8e5-bacecb444296 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:48.440813 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b3e116-b9ef-4c30-b8e5-bacecb444296 admin admin] PATH_INFO: `/v3/projects/aadcb499f7a0408682cc4d3304aef07e/users/be16774e197f4240a368bb4aa8592918/roles/127fdc7ef05b4e0b98a940b334e5fcab` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:48.457787 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b3e116-b9ef-4c30-b8e5-bacecb444296 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aadcb499f7a0408682cc4d3304aef07e, user_id=be16774e197f4240a368bb4aa8592918, role_id=127fdc7ef05b4e0b98a940b334e5fcab)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:12:48.460430 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b3e116-b9ef-4c30-b8e5-bacecb444296 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:12:48.474803 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1425/2811] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:12:48 2022] PUT /identity/v3/projects/aadcb499f7a0408682cc4d3304aef07e/users/be16774e197f4240a368bb4aa8592918/roles/127fdc7ef05b4e0b98a940b334e5fcab => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:12:48.479188 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf77264-88f3-4de0-98c6-3eed0d9dde0e admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:12:48.501932 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf77264-88f3-4de0-98c6-3eed0d9dde0e admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:12:48.569851 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2e9075-2ad0-4d0b-8e87-f3e20ba396e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:12:48.570613 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e9075-2ad0-4d0b-8e87-f3e20ba396e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:48.571008 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e9075-2ad0-4d0b-8e87-f3e20ba396e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:48.571344 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e9075-2ad0-4d0b-8e87-f3e20ba396e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:48.572209 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2e9075-2ad0-4d0b-8e87-f3e20ba396e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:12:48.574162 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2e9075-2ad0-4d0b-8e87-f3e20ba396e4 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:12:48.587567 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1387/2812] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:12:48 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 11:12:48.595204 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b3e116-b9ef-4c30-b8e5-bacecb444296 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:12:48.609708 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b3e116-b9ef-4c30-b8e5-bacecb444296 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:12:48.615230 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a520913-87c7-4dd7-8061-755b133e2745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:12:48.615916 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a520913-87c7-4dd7-8061-755b133e2745 admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:48.616196 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a520913-87c7-4dd7-8061-755b133e2745 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:48.616603 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a520913-87c7-4dd7-8061-755b133e2745 admin admin] PATH_INFO: `/v3/projects/aadcb499f7a0408682cc4d3304aef07e/users/be16774e197f4240a368bb4aa8592918/roles/127fdc7ef05b4e0b98a940b334e5fcab` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:48.619478 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a520913-87c7-4dd7-8061-755b133e2745 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aadcb499f7a0408682cc4d3304aef07e, user_id=be16774e197f4240a368bb4aa8592918, role_id=127fdc7ef05b4e0b98a940b334e5fcab)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:12:48.622340 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a520913-87c7-4dd7-8061-755b133e2745 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:12:48.636157 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:12:48.643776 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1426/2813] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:12:48 2022] PUT /identity/v3/projects/aadcb499f7a0408682cc4d3304aef07e/users/be16774e197f4240a368bb4aa8592918/roles/127fdc7ef05b4e0b98a940b334e5fcab => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:12:53.781204 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13072d8-21d9-45ab-be94-cc38f7db946d None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:53.782507 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13072d8-21d9-45ab-be94-cc38f7db946d None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:53.783298 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13072d8-21d9-45ab-be94-cc38f7db946d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:53.821765 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-c13072d8-21d9-45ab-be94-cc38f7db946d None None] MFA Rules not processed for user `be16774e197f4240a368bb4aa8592918`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:12:53.823353 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-c13072d8-21d9-45ab-be94-cc38f7db946d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:12:53.944464 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1388/2814] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:12:53 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:12:53.963038 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a520913-87c7-4dd7-8061-755b133e2745 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:12:53.966158 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-3a520913-87c7-4dd7-8061-755b133e2745 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:12:54.057813 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a520913-87c7-4dd7-8061-755b133e2745 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:12:54.064431 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e248aad8-3687-4e7b-bc00-4f1bbd0482cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a005d8f0c46d44c7b6f2201a54717b12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:12:54.065066 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248aad8-3687-4e7b-bc00-4f1bbd0482cb service nova] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:54.065350 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248aad8-3687-4e7b-bc00-4f1bbd0482cb service nova] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:54.065656 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248aad8-3687-4e7b-bc00-4f1bbd0482cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:54.131797 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e248aad8-3687-4e7b-bc00-4f1bbd0482cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:12:54.133452 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e248aad8-3687-4e7b-bc00-4f1bbd0482cb service nova] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:12:54.145487 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1427/2815] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:12:53 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:12:54.962774 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13072d8-21d9-45ab-be94-cc38f7db946d None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:12:54.982949 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:12:55.046964 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13072d8-21d9-45ab-be94-cc38f7db946d None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:12:55.052269 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119a12ac-a7dc-4705-b0ef-a72f6ace5a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:12:55.053352 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a12ac-a7dc-4705-b0ef-a72f6ace5a0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:55.053664 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a12ac-a7dc-4705-b0ef-a72f6ace5a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:55.053948 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a12ac-a7dc-4705-b0ef-a72f6ace5a0e admin admin] PATH_INFO: `/v3/users/c9db4a22849d44beb8f3879efab73d18` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:55.055234 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119a12ac-a7dc-4705-b0ef-a72f6ace5a0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9db4a22849d44beb8f3879efab73d18)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:12:55.057156 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119a12ac-a7dc-4705-b0ef-a72f6ace5a0e admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:12:55.121331 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-119a12ac-a7dc-4705-b0ef-a72f6ace5a0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9db4a22849d44beb8f3879efab73d18'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:12:55.131963 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-119a12ac-a7dc-4705-b0ef-a72f6ace5a0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9db4a22849d44beb8f3879efab73d18'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:12:55.132546 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-119a12ac-a7dc-4705-b0ef-a72f6ace5a0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9db4a22849d44beb8f3879efab73d18'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:12:55.133818 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-119a12ac-a7dc-4705-b0ef-a72f6ace5a0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9db4a22849d44beb8f3879efab73d18'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:12:55.143671 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-119a12ac-a7dc-4705-b0ef-a72f6ace5a0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9db4a22849d44beb8f3879efab73d18'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:12:55.172508 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1389/2816] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:12:54 2022] DELETE /identity/v3/users/c9db4a22849d44beb8f3879efab73d18 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:12:55.182071 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4954eed4-51c1-4c05-9e49-3892b73448ae None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:55.182557 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4954eed4-51c1-4c05-9e49-3892b73448ae None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:55.182689 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4954eed4-51c1-4c05-9e49-3892b73448ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:55.230357 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-4954eed4-51c1-4c05-9e49-3892b73448ae None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:12:55.232221 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-4954eed4-51c1-4c05-9e49-3892b73448ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:12:55.316384 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1428/2817] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:12:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:12:55.326674 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119a12ac-a7dc-4705-b0ef-a72f6ace5a0e admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:12:55.328381 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-119a12ac-a7dc-4705-b0ef-a72f6ace5a0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:12:55.425481 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119a12ac-a7dc-4705-b0ef-a72f6ace5a0e admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:12:55.429329 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844d5aab-38a4-4cd1-8a17-2dfccf0b1fcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:12:55.429976 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d5aab-38a4-4cd1-8a17-2dfccf0b1fcf service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:55.430256 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d5aab-38a4-4cd1-8a17-2dfccf0b1fcf service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:55.430584 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d5aab-38a4-4cd1-8a17-2dfccf0b1fcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:55.442777 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844d5aab-38a4-4cd1-8a17-2dfccf0b1fcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:12:55.444431 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844d5aab-38a4-4cd1-8a17-2dfccf0b1fcf service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:12:55.456740 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1390/2818] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:12:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 11:12:55.820451 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4954eed4-51c1-4c05-9e49-3892b73448ae None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:12:55.821922 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-4954eed4-51c1-4c05-9e49-3892b73448ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:12:55.843963 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4954eed4-51c1-4c05-9e49-3892b73448ae None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:12:55.862211 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eff006-9a9e-4273-8c91-d292a001b98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:12:55.863347 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eff006-9a9e-4273-8c91-d292a001b98a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:55.863701 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eff006-9a9e-4273-8c91-d292a001b98a admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:55.863972 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eff006-9a9e-4273-8c91-d292a001b98a admin admin] PATH_INFO: `/v3/projects/d5a047fed94948ee899939c723fb6be6` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:55.865351 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eff006-9a9e-4273-8c91-d292a001b98a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5a047fed94948ee899939c723fb6be6)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:12:55.867423 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eff006-9a9e-4273-8c91-d292a001b98a admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:12:55.911140 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:12:55.929855 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-08eff006-9a9e-4273-8c91-d292a001b98a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5a047fed94948ee899939c723fb6be6', 'request_id': 'req-08eff006-9a9e-4273-8c91-d292a001b98a'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:12:55.938513 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-08eff006-9a9e-4273-8c91-d292a001b98a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5a047fed94948ee899939c723fb6be6', 'request_id': 'req-08eff006-9a9e-4273-8c91-d292a001b98a'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:12:55.945056 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-08eff006-9a9e-4273-8c91-d292a001b98a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5a047fed94948ee899939c723fb6be6', 'request_id': 'req-08eff006-9a9e-4273-8c91-d292a001b98a'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:12:55.956793 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-08eff006-9a9e-4273-8c91-d292a001b98a admin admin] The token cache is being invalidate because project d5a047fed94948ee899939c723fb6be6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:12:55.957080 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-08eff006-9a9e-4273-8c91-d292a001b98a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:12:55.957754 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-08eff006-9a9e-4273-8c91-d292a001b98a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:12:55.959259 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1429/2819] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:12:55 2022] DELETE /identity/v3/projects/d5a047fed94948ee899939c723fb6be6 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:12:55.964092 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b564c98b-4af0-40af-addb-2646f1e42ed2 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:55.964577 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b564c98b-4af0-40af-addb-2646f1e42ed2 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:55.964706 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b564c98b-4af0-40af-addb-2646f1e42ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:55.989199 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-b564c98b-4af0-40af-addb-2646f1e42ed2 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:12:55.990236 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-b564c98b-4af0-40af-addb-2646f1e42ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:12:56.036304 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:12:56.080761 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1391/2820] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:12:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:12:56.089028 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed5a0a9-c19b-4e90-aded-c0c3578bbe66 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:56.089314 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed5a0a9-c19b-4e90-aded-c0c3578bbe66 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:56.089626 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed5a0a9-c19b-4e90-aded-c0c3578bbe66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:56.112276 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-6ed5a0a9-c19b-4e90-aded-c0c3578bbe66 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:12:56.113791 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-6ed5a0a9-c19b-4e90-aded-c0c3578bbe66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:12:56.122500 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1430/2821] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:12:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:12:56.126827 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b564c98b-4af0-40af-addb-2646f1e42ed2 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:12:56.137462 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b564c98b-4af0-40af-addb-2646f1e42ed2 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:12:56.144756 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead0b14a-764b-4e88-b3de-55592a574404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:12:56.145161 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead0b14a-764b-4e88-b3de-55592a574404 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:56.145449 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead0b14a-764b-4e88-b3de-55592a574404 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:56.145806 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead0b14a-764b-4e88-b3de-55592a574404 admin admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:56.146411 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead0b14a-764b-4e88-b3de-55592a574404 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:12:56.146717 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead0b14a-764b-4e88-b3de-55592a574404 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:12:56.148708 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead0b14a-764b-4e88-b3de-55592a574404 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:12:56.165594 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1392/2822] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Aug 18 11:12:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:12:56.167688 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed5a0a9-c19b-4e90-aded-c0c3578bbe66 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:12:56.178870 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed5a0a9-c19b-4e90-aded-c0c3578bbe66 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:12:56.184200 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa815e2b-54ac-488f-ba5d-208ac03bb0f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:12:56.184819 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa815e2b-54ac-488f-ba5d-208ac03bb0f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:56.185168 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa815e2b-54ac-488f-ba5d-208ac03bb0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:56.185804 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa815e2b-54ac-488f-ba5d-208ac03bb0f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:56.186459 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa815e2b-54ac-488f-ba5d-208ac03bb0f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:12:56.188523 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa815e2b-54ac-488f-ba5d-208ac03bb0f4 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:12:56.232780 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1431/2823] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:12:56 2022] POST /identity/v3/projects => generated 375 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:12:56.237055 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead0b14a-764b-4e88-b3de-55592a574404 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:12:56.249084 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead0b14a-764b-4e88-b3de-55592a574404 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:12:56.325712 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2339d0-11b9-415c-b86e-04c87436b956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:12:56.326322 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2339d0-11b9-415c-b86e-04c87436b956 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:56.326602 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2339d0-11b9-415c-b86e-04c87436b956 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:56.326870 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2339d0-11b9-415c-b86e-04c87436b956 admin admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:56.327528 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2339d0-11b9-415c-b86e-04c87436b956 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:12:56.329431 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2339d0-11b9-415c-b86e-04c87436b956 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:12:56.359944 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1393/2824] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:12:56 2022] POST /identity/v3/users => generated 288 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:12:56.364190 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa815e2b-54ac-488f-ba5d-208ac03bb0f4 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:12:56.376305 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa815e2b-54ac-488f-ba5d-208ac03bb0f4 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:12:56.381236 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827e1a51-ff70-4535-af01-31d52fbc629b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:12:56.381873 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e1a51-ff70-4535-af01-31d52fbc629b admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:56.382149 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e1a51-ff70-4535-af01-31d52fbc629b admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:56.382438 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e1a51-ff70-4535-af01-31d52fbc629b admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:56.383081 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827e1a51-ff70-4535-af01-31d52fbc629b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:12:56.384697 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827e1a51-ff70-4535-af01-31d52fbc629b admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:12:56.400625 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1432/2825] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:12:56 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:12:56.400876 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2339d0-11b9-415c-b86e-04c87436b956 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:12:56.412512 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2339d0-11b9-415c-b86e-04c87436b956 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:12:56.417668 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7707a5f-a233-47a7-8459-923f69ccdaae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:12:56.418989 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7707a5f-a233-47a7-8459-923f69ccdaae admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:56.419270 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7707a5f-a233-47a7-8459-923f69ccdaae admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:56.419567 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7707a5f-a233-47a7-8459-923f69ccdaae admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:56.420204 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7707a5f-a233-47a7-8459-923f69ccdaae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:12:56.421873 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7707a5f-a233-47a7-8459-923f69ccdaae admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:12:56.434620 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1394/2826] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:12:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:12:56.439010 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827e1a51-ff70-4535-af01-31d52fbc629b admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:12:56.455088 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827e1a51-ff70-4535-af01-31d52fbc629b admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:12:56.459997 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb66e64-ab90-4b0b-b94b-f81884dc99de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:12:56.460661 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb66e64-ab90-4b0b-b94b-f81884dc99de admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:56.460939 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb66e64-ab90-4b0b-b94b-f81884dc99de admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:56.461214 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb66e64-ab90-4b0b-b94b-f81884dc99de admin admin] PATH_INFO: `/v3/projects/9eb45c7eebb8497f899a6c188b911144/users/2f5e7888b57d4600a08de131fa735da6/roles/719e5c62188d4f8a838987d6e72ca8f7` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:56.476981 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb66e64-ab90-4b0b-b94b-f81884dc99de admin admin] RBAC: Authorizing `identity:create_grant(project_id=9eb45c7eebb8497f899a6c188b911144, user_id=2f5e7888b57d4600a08de131fa735da6, role_id=719e5c62188d4f8a838987d6e72ca8f7)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:12:56.479657 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb66e64-ab90-4b0b-b94b-f81884dc99de admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:12:56.498466 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1433/2827] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:12:56 2022] PUT /identity/v3/projects/9eb45c7eebb8497f899a6c188b911144/users/2f5e7888b57d4600a08de131fa735da6/roles/719e5c62188d4f8a838987d6e72ca8f7 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:12:56.509634 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a20a5e-5ea4-45a3-8433-2561e211d4ac None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:56.509971 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a20a5e-5ea4-45a3-8433-2561e211d4ac None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:56.510196 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a20a5e-5ea4-45a3-8433-2561e211d4ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:56.540075 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-e0a20a5e-5ea4-45a3-8433-2561e211d4ac None None] MFA Rules not processed for user `2f5e7888b57d4600a08de131fa735da6`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:12:56.541306 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-e0a20a5e-5ea4-45a3-8433-2561e211d4ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:12:56.620285 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1395/2828] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:12:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:12:56.632760 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb66e64-ab90-4b0b-b94b-f81884dc99de admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:12:56.634460 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-1bb66e64-ab90-4b0b-b94b-f81884dc99de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:12:56.696978 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb66e64-ab90-4b0b-b94b-f81884dc99de admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:12:56.701822 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab71ac58-2d61-4de6-bccf-e11637cab2a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b8a09704b9b4ab2bffb813796ec6e77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:12:56.702450 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71ac58-2d61-4de6-bccf-e11637cab2a4 service cinder] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:56.702728 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71ac58-2d61-4de6-bccf-e11637cab2a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:56.703002 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71ac58-2d61-4de6-bccf-e11637cab2a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:56.712811 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab71ac58-2d61-4de6-bccf-e11637cab2a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:12:56.714281 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab71ac58-2d61-4de6-bccf-e11637cab2a4 service cinder] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:12:56.736731 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1434/2829] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:12:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:13:06.618362 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=82,keystone:INSERT=3 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:13:06.724743 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=66,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:13:14.953060 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55af884-ffa6-4e4d-be55-07d3d5ff0d0b None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:14.953629 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55af884-ffa6-4e4d-be55-07d3d5ff0d0b None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:14.953745 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55af884-ffa6-4e4d-be55-07d3d5ff0d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:14.973199 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-c55af884-ffa6-4e4d-be55-07d3d5ff0d0b None None] MFA Rules not processed for user `d4e3a8a1512c47a19cd3c23f171e24c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:13:14.974439 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-c55af884-ffa6-4e4d-be55-07d3d5ff0d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:13:15.031170 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1396/2830] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:13:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:13:15.069821 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab71ac58-2d61-4de6-bccf-e11637cab2a4 service cinder] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:13:15.071265 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-ab71ac58-2d61-4de6-bccf-e11637cab2a4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:13:15.083024 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab71ac58-2d61-4de6-bccf-e11637cab2a4 service cinder] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:13:15.087368 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a97fcc-5501-4b1b-9da7-6015963d06ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b8a09704b9b4ab2bffb813796ec6e77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:13:15.088049 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a97fcc-5501-4b1b-9da7-6015963d06ef service cinder] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:15.088393 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a97fcc-5501-4b1b-9da7-6015963d06ef service cinder] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:15.088732 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a97fcc-5501-4b1b-9da7-6015963d06ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:15.091347 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-63a97fcc-5501-4b1b-9da7-6015963d06ef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:13:15.168098 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a97fcc-5501-4b1b-9da7-6015963d06ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:13:15.169586 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a97fcc-5501-4b1b-9da7-6015963d06ef service cinder] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:13:15.181882 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1435/2831] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:13:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:13:15.486158 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55af884-ffa6-4e4d-be55-07d3d5ff0d0b None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:13:15.487674 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-c55af884-ffa6-4e4d-be55-07d3d5ff0d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:13:15.547912 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55af884-ffa6-4e4d-be55-07d3d5ff0d0b None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:13:15.551503 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4c53a3-ffb3-4565-8d53-576d8bb22643 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:13:15.552156 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c53a3-ffb3-4565-8d53-576d8bb22643 service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:15.552444 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c53a3-ffb3-4565-8d53-576d8bb22643 service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:15.552713 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c53a3-ffb3-4565-8d53-576d8bb22643 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:15.554479 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-3a4c53a3-ffb3-4565-8d53-576d8bb22643 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:13:15.565194 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4c53a3-ffb3-4565-8d53-576d8bb22643 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:13:15.566657 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4c53a3-ffb3-4565-8d53-576d8bb22643 service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:13:15.575749 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1397/2832] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:13:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:13:16.039291 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a97fcc-5501-4b1b-9da7-6015963d06ef service cinder] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:13:16.040865 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-63a97fcc-5501-4b1b-9da7-6015963d06ef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:13:16.052835 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4c53a3-ffb3-4565-8d53-576d8bb22643 service neutron] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:13:16.053778 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-3a4c53a3-ffb3-4565-8d53-576d8bb22643 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:13:16.064608 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4c53a3-ffb3-4565-8d53-576d8bb22643 service neutron] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:13:16.068308 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94395bf-d7ca-4dcf-b84e-aac879aceb1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:13:16.068905 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94395bf-d7ca-4dcf-b84e-aac879aceb1f service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:16.069179 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94395bf-d7ca-4dcf-b84e-aac879aceb1f service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:16.069460 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94395bf-d7ca-4dcf-b84e-aac879aceb1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:16.071220 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-c94395bf-d7ca-4dcf-b84e-aac879aceb1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:13:16.085434 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94395bf-d7ca-4dcf-b84e-aac879aceb1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:13:16.086944 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94395bf-d7ca-4dcf-b84e-aac879aceb1f service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:13:16.098858 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1398/2833] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:13:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 11:13:16.115223 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a97fcc-5501-4b1b-9da7-6015963d06ef service cinder] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:13:16.120288 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a09f9fb-d502-402d-b179-04ef206fb396 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f918bcdd83d4d48be3fff5a48c54929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:13:16.120942 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a09f9fb-d502-402d-b179-04ef206fb396 service placement] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:16.121218 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a09f9fb-d502-402d-b179-04ef206fb396 service placement] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:16.121488 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a09f9fb-d502-402d-b179-04ef206fb396 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:16.123263 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-8a09f9fb-d502-402d-b179-04ef206fb396 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:13:16.135415 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a09f9fb-d502-402d-b179-04ef206fb396 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:13:16.137613 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a09f9fb-d502-402d-b179-04ef206fb396 service placement] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:13:16.148192 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1436/2834] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:13:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:13:17.671228 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94395bf-d7ca-4dcf-b84e-aac879aceb1f service neutron] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:13:17.743662 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94395bf-d7ca-4dcf-b84e-aac879aceb1f service neutron] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:13:17.748886 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ccb1b8-7122-4a07-ab3b-9a265889bc4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:13:17.749626 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ccb1b8-7122-4a07-ab3b-9a265889bc4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:17.749968 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ccb1b8-7122-4a07-ab3b-9a265889bc4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:17.750330 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ccb1b8-7122-4a07-ab3b-9a265889bc4b admin admin] PATH_INFO: `/v3/users/2f5e7888b57d4600a08de131fa735da6` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:17.751550 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ccb1b8-7122-4a07-ab3b-9a265889bc4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f5e7888b57d4600a08de131fa735da6)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:13:17.753541 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ccb1b8-7122-4a07-ab3b-9a265889bc4b admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:13:17.823241 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:13:17.837075 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-00ccb1b8-7122-4a07-ab3b-9a265889bc4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f5e7888b57d4600a08de131fa735da6'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:13:17.849972 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-00ccb1b8-7122-4a07-ab3b-9a265889bc4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f5e7888b57d4600a08de131fa735da6'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:13:17.850801 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-00ccb1b8-7122-4a07-ab3b-9a265889bc4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f5e7888b57d4600a08de131fa735da6'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:13:17.851451 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-00ccb1b8-7122-4a07-ab3b-9a265889bc4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f5e7888b57d4600a08de131fa735da6'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:13:17.864087 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-00ccb1b8-7122-4a07-ab3b-9a265889bc4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f5e7888b57d4600a08de131fa735da6'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:13:17.889740 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1399/2835] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:13:17 2022] DELETE /identity/v3/users/2f5e7888b57d4600a08de131fa735da6 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:13:17.891662 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da60a3fd-e6b4-4ede-b6b6-107fa3e900dd None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:17.892126 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da60a3fd-e6b4-4ede-b6b6-107fa3e900dd None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:17.892240 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da60a3fd-e6b4-4ede-b6b6-107fa3e900dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:17.919348 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-da60a3fd-e6b4-4ede-b6b6-107fa3e900dd None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:13:17.920585 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-da60a3fd-e6b4-4ede-b6b6-107fa3e900dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:13:17.939345 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ccb1b8-7122-4a07-ab3b-9a265889bc4b admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:13:17.940928 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-00ccb1b8-7122-4a07-ab3b-9a265889bc4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:13:17.999967 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1437/2836] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:13:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:13:18.009682 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ccb1b8-7122-4a07-ab3b-9a265889bc4b admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:13:18.010170 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da60a3fd-e6b4-4ede-b6b6-107fa3e900dd None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:13:18.014111 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de76a43-0b92-41ad-ab97-0d27938dc65a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:13:18.014735 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de76a43-0b92-41ad-ab97-0d27938dc65a service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:18.015015 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de76a43-0b92-41ad-ab97-0d27938dc65a service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:18.015292 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de76a43-0b92-41ad-ab97-0d27938dc65a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:18.017254 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-3de76a43-0b92-41ad-ab97-0d27938dc65a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:13:18.022206 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da60a3fd-e6b4-4ede-b6b6-107fa3e900dd None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:13:18.027967 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c568ef6-0e29-47ce-ae6c-fcd60f4e811f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:13:18.028925 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c568ef6-0e29-47ce-ae6c-fcd60f4e811f service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:18.029211 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c568ef6-0e29-47ce-ae6c-fcd60f4e811f service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:18.029490 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c568ef6-0e29-47ce-ae6c-fcd60f4e811f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:18.031014 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de76a43-0b92-41ad-ab97-0d27938dc65a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:13:18.032395 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de76a43-0b92-41ad-ab97-0d27938dc65a service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:13:18.039619 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c568ef6-0e29-47ce-ae6c-fcd60f4e811f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:13:18.041045 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c568ef6-0e29-47ce-ae6c-fcd60f4e811f service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:13:18.041474 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1400/2837] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:13:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 11:13:18.052155 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1438/2838] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:13:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 11:13:18.670170 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de76a43-0b92-41ad-ab97-0d27938dc65a service neutron] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:13:18.671670 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-3de76a43-0b92-41ad-ab97-0d27938dc65a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:13:18.686650 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de76a43-0b92-41ad-ab97-0d27938dc65a service neutron] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:13:18.692369 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8178597e-bd2e-4ff2-9ef1-4cf063e59ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:13:18.693381 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8178597e-bd2e-4ff2-9ef1-4cf063e59ec6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:18.693709 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8178597e-bd2e-4ff2-9ef1-4cf063e59ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:18.693986 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8178597e-bd2e-4ff2-9ef1-4cf063e59ec6 admin admin] PATH_INFO: `/v3/projects/9eb45c7eebb8497f899a6c188b911144` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:18.695192 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8178597e-bd2e-4ff2-9ef1-4cf063e59ec6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9eb45c7eebb8497f899a6c188b911144)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:13:18.697119 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8178597e-bd2e-4ff2-9ef1-4cf063e59ec6 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:13:18.755512 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-8178597e-bd2e-4ff2-9ef1-4cf063e59ec6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9eb45c7eebb8497f899a6c188b911144', 'request_id': 'req-8178597e-bd2e-4ff2-9ef1-4cf063e59ec6'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:13:18.763911 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-8178597e-bd2e-4ff2-9ef1-4cf063e59ec6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9eb45c7eebb8497f899a6c188b911144', 'request_id': 'req-8178597e-bd2e-4ff2-9ef1-4cf063e59ec6'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:13:18.770785 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-8178597e-bd2e-4ff2-9ef1-4cf063e59ec6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9eb45c7eebb8497f899a6c188b911144', 'request_id': 'req-8178597e-bd2e-4ff2-9ef1-4cf063e59ec6'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:13:18.781610 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-8178597e-bd2e-4ff2-9ef1-4cf063e59ec6 admin admin] The token cache is being invalidate because project 9eb45c7eebb8497f899a6c188b911144 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:13:18.782100 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-8178597e-bd2e-4ff2-9ef1-4cf063e59ec6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:13:18.783950 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-8178597e-bd2e-4ff2-9ef1-4cf063e59ec6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:13:18.785457 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1401/2839] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:13:18 2022] DELETE /identity/v3/projects/9eb45c7eebb8497f899a6c188b911144 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:13:18.791210 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb8fe52-9fdf-46b9-99a7-47681ccbd7af None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:18.791561 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb8fe52-9fdf-46b9-99a7-47681ccbd7af None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:18.791925 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb8fe52-9fdf-46b9-99a7-47681ccbd7af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:18.801145 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=100 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:13:18.815398 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-bfb8fe52-9fdf-46b9-99a7-47681ccbd7af None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:13:18.816627 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-bfb8fe52-9fdf-46b9-99a7-47681ccbd7af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:13:18.890049 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1439/2840] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:13:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:13:18.897805 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6896beda-9ff8-43e3-a0c8-d2736b62a7de None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:18.898079 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6896beda-9ff8-43e3-a0c8-d2736b62a7de None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:18.898369 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6896beda-9ff8-43e3-a0c8-d2736b62a7de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:18.906067 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb8fe52-9fdf-46b9-99a7-47681ccbd7af None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:13:18.910010 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-bfb8fe52-9fdf-46b9-99a7-47681ccbd7af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:13:18.920303 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-6896beda-9ff8-43e3-a0c8-d2736b62a7de None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:13:18.921544 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-6896beda-9ff8-43e3-a0c8-d2736b62a7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:13:18.933881 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1402/2841] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:13:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:13:18.938314 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6896beda-9ff8-43e3-a0c8-d2736b62a7de None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:13:18.948349 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6896beda-9ff8-43e3-a0c8-d2736b62a7de None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:13:18.953823 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff55b1b-0b3d-4978-84a9-0ec6503f9728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:13:18.954570 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff55b1b-0b3d-4978-84a9-0ec6503f9728 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:18.954952 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff55b1b-0b3d-4978-84a9-0ec6503f9728 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:18.955299 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff55b1b-0b3d-4978-84a9-0ec6503f9728 admin admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:18.956020 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff55b1b-0b3d-4978-84a9-0ec6503f9728 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:13:18.956764 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff55b1b-0b3d-4978-84a9-0ec6503f9728 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:13:18.958716 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff55b1b-0b3d-4978-84a9-0ec6503f9728 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:13:18.976546 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1403/2842] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Aug 18 11:13:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:13:18.978223 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff55b1b-0b3d-4978-84a9-0ec6503f9728 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:13:18.989951 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff55b1b-0b3d-4978-84a9-0ec6503f9728 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:13:18.995044 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c598acb-f01c-4924-8fb1-452a3d4aba09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:13:18.995817 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c598acb-f01c-4924-8fb1-452a3d4aba09 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:18.996187 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c598acb-f01c-4924-8fb1-452a3d4aba09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:18.996559 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c598acb-f01c-4924-8fb1-452a3d4aba09 admin admin] PATH_INFO: `/v3/projects` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:18.997253 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c598acb-f01c-4924-8fb1-452a3d4aba09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:13:18.999294 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c598acb-f01c-4924-8fb1-452a3d4aba09 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:13:19.011760 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb8fe52-9fdf-46b9-99a7-47681ccbd7af None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:13:19.018360 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ac656b-8f44-4b33-8120-f7b6219d4e0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a005d8f0c46d44c7b6f2201a54717b12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:13:19.019023 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ac656b-8f44-4b33-8120-f7b6219d4e0c service nova] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:19.019326 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ac656b-8f44-4b33-8120-f7b6219d4e0c service nova] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:19.019624 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ac656b-8f44-4b33-8120-f7b6219d4e0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:19.021724 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-27ac656b-8f44-4b33-8120-f7b6219d4e0c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:13:19.022375 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:13:19.033463 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1404/2843] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:13:18 2022] POST /identity/v3/projects => generated 365 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:13:19.037786 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c598acb-f01c-4924-8fb1-452a3d4aba09 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:13:19.040780 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ac656b-8f44-4b33-8120-f7b6219d4e0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:13:19.042550 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ac656b-8f44-4b33-8120-f7b6219d4e0c service nova] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:13:19.055037 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1440/2844] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:13:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 11:13:19.110034 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c598acb-f01c-4924-8fb1-452a3d4aba09 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:13:19.114778 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cda81f6-1963-4794-974f-bd6f88c1d601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:13:19.115392 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda81f6-1963-4794-974f-bd6f88c1d601 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:19.115669 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda81f6-1963-4794-974f-bd6f88c1d601 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:19.115946 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda81f6-1963-4794-974f-bd6f88c1d601 admin admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:19.116571 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cda81f6-1963-4794-974f-bd6f88c1d601 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:13:19.118638 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cda81f6-1963-4794-974f-bd6f88c1d601 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:13:19.145306 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1405/2845] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:13:19 2022] POST /identity/v3/users => generated 283 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:13:19.149339 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ac656b-8f44-4b33-8120-f7b6219d4e0c service nova] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:13:19.160728 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ac656b-8f44-4b33-8120-f7b6219d4e0c service nova] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:13:19.165440 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e507e1-f446-4776-b136-7974407f963e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:13:19.166062 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e507e1-f446-4776-b136-7974407f963e admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:19.166338 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e507e1-f446-4776-b136-7974407f963e admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:19.166636 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e507e1-f446-4776-b136-7974407f963e admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:19.167266 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e507e1-f446-4776-b136-7974407f963e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:13:19.169623 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e507e1-f446-4776-b136-7974407f963e admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:13:19.185533 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1441/2846] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:13:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:13:19.186954 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cda81f6-1963-4794-974f-bd6f88c1d601 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:13:19.197302 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cda81f6-1963-4794-974f-bd6f88c1d601 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:13:19.202744 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f575405e-df11-4567-976a-942440d832dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:13:19.203363 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f575405e-df11-4567-976a-942440d832dc admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:19.203643 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f575405e-df11-4567-976a-942440d832dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:19.203921 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f575405e-df11-4567-976a-942440d832dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:19.204572 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f575405e-df11-4567-976a-942440d832dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:13:19.206236 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f575405e-df11-4567-976a-942440d832dc admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:13:19.218123 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1406/2847] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:13:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:13:19.222296 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e507e1-f446-4776-b136-7974407f963e admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:13:19.233910 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e507e1-f446-4776-b136-7974407f963e admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:13:19.238769 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a032c0c6-3e08-4d6e-8d03-eee59a8ca777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:13:19.239525 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a032c0c6-3e08-4d6e-8d03-eee59a8ca777 admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:19.239874 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a032c0c6-3e08-4d6e-8d03-eee59a8ca777 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:19.240307 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a032c0c6-3e08-4d6e-8d03-eee59a8ca777 admin admin] PATH_INFO: `/v3/projects/5bf82a3e61024b83b1e2679dffc6294c/users/6967cb7968a94b6ca0aa763b8c057a64/roles/719e5c62188d4f8a838987d6e72ca8f7` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:19.255657 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a032c0c6-3e08-4d6e-8d03-eee59a8ca777 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bf82a3e61024b83b1e2679dffc6294c, user_id=6967cb7968a94b6ca0aa763b8c057a64, role_id=719e5c62188d4f8a838987d6e72ca8f7)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:13:19.258431 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a032c0c6-3e08-4d6e-8d03-eee59a8ca777 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:13:19.273568 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1442/2848] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:13:19 2022] PUT /identity/v3/projects/5bf82a3e61024b83b1e2679dffc6294c/users/6967cb7968a94b6ca0aa763b8c057a64/roles/719e5c62188d4f8a838987d6e72ca8f7 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:13:19.342260 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb30574-869a-4a08-b230-64f896f4e8a9 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:19.342555 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb30574-869a-4a08-b230-64f896f4e8a9 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:19.342829 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb30574-869a-4a08-b230-64f896f4e8a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:19.372319 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-7bb30574-869a-4a08-b230-64f896f4e8a9 None None] MFA Rules not processed for user `6967cb7968a94b6ca0aa763b8c057a64`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:13:19.373562 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-7bb30574-869a-4a08-b230-64f896f4e8a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:13:19.439799 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1407/2849] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:13:19 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:13:19.452133 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a032c0c6-3e08-4d6e-8d03-eee59a8ca777 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:13:19.453788 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-a032c0c6-3e08-4d6e-8d03-eee59a8ca777 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:13:19.520140 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a032c0c6-3e08-4d6e-8d03-eee59a8ca777 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:13:19.524063 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7501a70-f790-4604-ae10-ebd5d8c70a91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b8a09704b9b4ab2bffb813796ec6e77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:13:19.524666 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7501a70-f790-4604-ae10-ebd5d8c70a91 service cinder] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:19.524942 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7501a70-f790-4604-ae10-ebd5d8c70a91 service cinder] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:19.525239 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7501a70-f790-4604-ae10-ebd5d8c70a91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:19.532926 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:13:19.537099 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7501a70-f790-4604-ae10-ebd5d8c70a91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:13:19.538613 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7501a70-f790-4604-ae10-ebd5d8c70a91 service cinder] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:13:19.549925 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1443/2850] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:13:19 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:13:29.436987 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=67,keystone:INSERT=3 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:13:29.547208 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=2 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:13:30.567169 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb30574-869a-4a08-b230-64f896f4e8a9 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:13:30.568629 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-7bb30574-869a-4a08-b230-64f896f4e8a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:13:30.661637 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb30574-869a-4a08-b230-64f896f4e8a9 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:13:30.667468 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697e31ea-fabe-49bb-b175-b33164be0747 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a005d8f0c46d44c7b6f2201a54717b12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:13:30.668216 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697e31ea-fabe-49bb-b175-b33164be0747 service nova] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:30.668640 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697e31ea-fabe-49bb-b175-b33164be0747 service nova] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:30.668780 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697e31ea-fabe-49bb-b175-b33164be0747 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:30.670552 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-697e31ea-fabe-49bb-b175-b33164be0747 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:13:30.683341 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697e31ea-fabe-49bb-b175-b33164be0747 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:13:30.685027 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697e31ea-fabe-49bb-b175-b33164be0747 service nova] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:13:30.700886 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1408/2851] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:13:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:13:32.763592 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7501a70-f790-4604-ae10-ebd5d8c70a91 service cinder] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:13:32.765071 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-d7501a70-f790-4604-ae10-ebd5d8c70a91 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:13:32.821380 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7501a70-f790-4604-ae10-ebd5d8c70a91 service cinder] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:13:32.825570 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835d3ea0-80bc-4cb1-8e72-c2b371028b1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:13:32.826171 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d3ea0-80bc-4cb1-8e72-c2b371028b1c service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:32.826449 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d3ea0-80bc-4cb1-8e72-c2b371028b1c service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:32.826730 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d3ea0-80bc-4cb1-8e72-c2b371028b1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:32.828587 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-835d3ea0-80bc-4cb1-8e72-c2b371028b1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:13:32.890146 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835d3ea0-80bc-4cb1-8e72-c2b371028b1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:13:32.891569 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835d3ea0-80bc-4cb1-8e72-c2b371028b1c service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:13:32.902103 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1444/2852] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:13:32 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:13:40.691609 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=34 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:13:42.896954 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=50 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:13:54.829932 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697e31ea-fabe-49bb-b175-b33164be0747 service nova] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:13:54.894555 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697e31ea-fabe-49bb-b175-b33164be0747 service nova] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:13:54.899541 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740a0a9b-9678-4fa8-ba9b-856b9632d739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:13:54.900445 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a0a9b-9678-4fa8-ba9b-856b9632d739 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:54.900799 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a0a9b-9678-4fa8-ba9b-856b9632d739 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:54.901164 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a0a9b-9678-4fa8-ba9b-856b9632d739 admin admin] PATH_INFO: `/v3/users/6967cb7968a94b6ca0aa763b8c057a64` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:54.903148 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740a0a9b-9678-4fa8-ba9b-856b9632d739 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6967cb7968a94b6ca0aa763b8c057a64)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:13:54.906206 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740a0a9b-9678-4fa8-ba9b-856b9632d739 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:13:54.954360 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-740a0a9b-9678-4fa8-ba9b-856b9632d739 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6967cb7968a94b6ca0aa763b8c057a64'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:13:54.961540 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-740a0a9b-9678-4fa8-ba9b-856b9632d739 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6967cb7968a94b6ca0aa763b8c057a64'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:13:54.962182 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-740a0a9b-9678-4fa8-ba9b-856b9632d739 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6967cb7968a94b6ca0aa763b8c057a64'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:13:54.962793 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-740a0a9b-9678-4fa8-ba9b-856b9632d739 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6967cb7968a94b6ca0aa763b8c057a64'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:13:54.970851 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-740a0a9b-9678-4fa8-ba9b-856b9632d739 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6967cb7968a94b6ca0aa763b8c057a64'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:13:54.989150 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1409/2853] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:13:54 2022] DELETE /identity/v3/users/6967cb7968a94b6ca0aa763b8c057a64 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:13:54.993804 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7008d41d-3022-4dda-96f0-de709e05443e None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:54.994563 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7008d41d-3022-4dda-96f0-de709e05443e None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:54.994752 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7008d41d-3022-4dda-96f0-de709e05443e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:55.015417 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-7008d41d-3022-4dda-96f0-de709e05443e None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:13:55.016660 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-7008d41d-3022-4dda-96f0-de709e05443e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:13:55.076675 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1445/2854] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:13:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:13:55.086271 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740a0a9b-9678-4fa8-ba9b-856b9632d739 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:13:55.087705 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-740a0a9b-9678-4fa8-ba9b-856b9632d739 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:13:55.157091 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740a0a9b-9678-4fa8-ba9b-856b9632d739 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:13:55.160747 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8032e90-1f32-448d-af83-5c65031e095d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:13:55.161348 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8032e90-1f32-448d-af83-5c65031e095d service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:55.161671 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8032e90-1f32-448d-af83-5c65031e095d service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:55.161951 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8032e90-1f32-448d-af83-5c65031e095d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:55.172391 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8032e90-1f32-448d-af83-5c65031e095d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:13:55.173889 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8032e90-1f32-448d-af83-5c65031e095d service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:13:55.183243 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1410/2855] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:13:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:13:55.461121 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7008d41d-3022-4dda-96f0-de709e05443e None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:13:55.462628 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-7008d41d-3022-4dda-96f0-de709e05443e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:13:55.475921 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7008d41d-3022-4dda-96f0-de709e05443e None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:13:55.480705 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8401c167-3f8b-4cd3-b1d0-05560bff6d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:13:55.481459 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8401c167-3f8b-4cd3-b1d0-05560bff6d13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:55.481703 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8401c167-3f8b-4cd3-b1d0-05560bff6d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:55.481917 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8401c167-3f8b-4cd3-b1d0-05560bff6d13 admin admin] PATH_INFO: `/v3/projects/5bf82a3e61024b83b1e2679dffc6294c` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:55.483099 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8401c167-3f8b-4cd3-b1d0-05560bff6d13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bf82a3e61024b83b1e2679dffc6294c)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:13:55.485042 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8401c167-3f8b-4cd3-b1d0-05560bff6d13 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:13:55.535258 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-8401c167-3f8b-4cd3-b1d0-05560bff6d13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bf82a3e61024b83b1e2679dffc6294c', 'request_id': 'req-8401c167-3f8b-4cd3-b1d0-05560bff6d13'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:13:55.542824 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-8401c167-3f8b-4cd3-b1d0-05560bff6d13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bf82a3e61024b83b1e2679dffc6294c', 'request_id': 'req-8401c167-3f8b-4cd3-b1d0-05560bff6d13'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:13:55.549769 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-8401c167-3f8b-4cd3-b1d0-05560bff6d13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bf82a3e61024b83b1e2679dffc6294c', 'request_id': 'req-8401c167-3f8b-4cd3-b1d0-05560bff6d13'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:13:55.563601 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-8401c167-3f8b-4cd3-b1d0-05560bff6d13 admin admin] The token cache is being invalidate because project 5bf82a3e61024b83b1e2679dffc6294c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:13:55.563917 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-8401c167-3f8b-4cd3-b1d0-05560bff6d13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:13:55.564645 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-8401c167-3f8b-4cd3-b1d0-05560bff6d13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:13:55.566206 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1446/2856] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:13:55 2022] DELETE /identity/v3/projects/5bf82a3e61024b83b1e2679dffc6294c => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:13:55.571223 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf7f49-6c92-479d-a896-43864fee92ae None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:55.571499 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf7f49-6c92-479d-a896-43864fee92ae None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:55.571762 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf7f49-6c92-479d-a896-43864fee92ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:55.593746 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-feaf7f49-6c92-479d-a896-43864fee92ae None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:13:55.594867 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-feaf7f49-6c92-479d-a896-43864fee92ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:13:55.611815 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:13:55.683135 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1411/2857] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:13:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:13:55.691329 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7017587c-ce7d-4586-be5f-e5b14adbc2da None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:55.691612 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7017587c-ce7d-4586-be5f-e5b14adbc2da None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:55.691893 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7017587c-ce7d-4586-be5f-e5b14adbc2da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:55.713044 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-7017587c-ce7d-4586-be5f-e5b14adbc2da None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:13:55.714317 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-7017587c-ce7d-4586-be5f-e5b14adbc2da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:13:55.723018 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1447/2858] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:13:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:13:55.727288 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaf7f49-6c92-479d-a896-43864fee92ae None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:13:55.737238 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaf7f49-6c92-479d-a896-43864fee92ae None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:13:55.741772 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6e3b13-51c7-4747-bb73-23e97fa67ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:13:55.742367 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e3b13-51c7-4747-bb73-23e97fa67ca6 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:55.742647 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e3b13-51c7-4747-bb73-23e97fa67ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:55.742920 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e3b13-51c7-4747-bb73-23e97fa67ca6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:55.743562 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6e3b13-51c7-4747-bb73-23e97fa67ca6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:13:55.743867 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6e3b13-51c7-4747-bb73-23e97fa67ca6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:13:55.745451 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6e3b13-51c7-4747-bb73-23e97fa67ca6 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:13:55.757948 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1412/2859] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Aug 18 11:13:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:13:55.762896 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7017587c-ce7d-4586-be5f-e5b14adbc2da None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:13:55.772086 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7017587c-ce7d-4586-be5f-e5b14adbc2da None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:13:55.776639 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdfa3fc-7394-4a96-8798-1dfa6d675613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:13:55.777222 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdfa3fc-7394-4a96-8798-1dfa6d675613 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:55.777628 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdfa3fc-7394-4a96-8798-1dfa6d675613 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:55.777899 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdfa3fc-7394-4a96-8798-1dfa6d675613 admin admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:55.778533 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdfa3fc-7394-4a96-8798-1dfa6d675613 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:13:55.780427 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdfa3fc-7394-4a96-8798-1dfa6d675613 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:13:55.808180 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1448/2860] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:13:55 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 11:13:55.813065 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6e3b13-51c7-4747-bb73-23e97fa67ca6 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:13:55.823027 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6e3b13-51c7-4747-bb73-23e97fa67ca6 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:13:55.882321 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80ad95b-f30c-4342-9dc1-36c27c2920d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:13:55.882977 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ad95b-f30c-4342-9dc1-36c27c2920d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:55.883140 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ad95b-f30c-4342-9dc1-36c27c2920d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:55.883411 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ad95b-f30c-4342-9dc1-36c27c2920d9 admin admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:55.884030 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80ad95b-f30c-4342-9dc1-36c27c2920d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:13:55.886006 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80ad95b-f30c-4342-9dc1-36c27c2920d9 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:13:55.909159 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1413/2861] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:13:55 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:13:55.913363 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdfa3fc-7394-4a96-8798-1dfa6d675613 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:13:55.924384 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdfa3fc-7394-4a96-8798-1dfa6d675613 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:13:55.929148 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7017216-d324-4433-8243-d0ccab4bbc35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:13:55.929773 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7017216-d324-4433-8243-d0ccab4bbc35 admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:55.930051 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7017216-d324-4433-8243-d0ccab4bbc35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:55.930324 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7017216-d324-4433-8243-d0ccab4bbc35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:55.930959 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7017216-d324-4433-8243-d0ccab4bbc35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:13:55.932540 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7017216-d324-4433-8243-d0ccab4bbc35 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:13:55.943449 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1449/2862] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:13:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:13:55.948958 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80ad95b-f30c-4342-9dc1-36c27c2920d9 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:13:55.959297 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80ad95b-f30c-4342-9dc1-36c27c2920d9 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:13:55.963874 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fd9758-3909-46b7-9bcf-59b0574446b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:13:55.964470 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fd9758-3909-46b7-9bcf-59b0574446b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:55.964743 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fd9758-3909-46b7-9bcf-59b0574446b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:55.965080 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fd9758-3909-46b7-9bcf-59b0574446b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:55.965751 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fd9758-3909-46b7-9bcf-59b0574446b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:13:55.967366 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fd9758-3909-46b7-9bcf-59b0574446b3 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:13:55.985917 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1414/2863] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:13:55 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:13:55.990211 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7017216-d324-4433-8243-d0ccab4bbc35 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:13:56.001440 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7017216-d324-4433-8243-d0ccab4bbc35 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:13:56.006440 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b0044e-7564-4344-b8d8-533ee693daab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:13:56.007121 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b0044e-7564-4344-b8d8-533ee693daab admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:56.007394 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b0044e-7564-4344-b8d8-533ee693daab admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:56.007669 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b0044e-7564-4344-b8d8-533ee693daab admin admin] PATH_INFO: `/v3/projects/5a4187c38b3541fca84ffc6ecd8587ad/users/cbda37b587684f05a76b2dcc5fd59c19/roles/719e5c62188d4f8a838987d6e72ca8f7` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:56.024212 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b0044e-7564-4344-b8d8-533ee693daab admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a4187c38b3541fca84ffc6ecd8587ad, user_id=cbda37b587684f05a76b2dcc5fd59c19, role_id=719e5c62188d4f8a838987d6e72ca8f7)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:13:56.026908 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b0044e-7564-4344-b8d8-533ee693daab admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:13:56.040454 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1450/2864] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:13:55 2022] PUT /identity/v3/projects/5a4187c38b3541fca84ffc6ecd8587ad/users/cbda37b587684f05a76b2dcc5fd59c19/roles/719e5c62188d4f8a838987d6e72ca8f7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:13:56.052839 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d49d65-66e8-421f-ada3-ebded0021b48 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:56.053143 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d49d65-66e8-421f-ada3-ebded0021b48 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:56.053396 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d49d65-66e8-421f-ada3-ebded0021b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:56.081894 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-c6d49d65-66e8-421f-ada3-ebded0021b48 None None] MFA Rules not processed for user `cbda37b587684f05a76b2dcc5fd59c19`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:13:56.083102 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-c6d49d65-66e8-421f-ada3-ebded0021b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:13:56.148577 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1415/2865] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:13:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:13:56.159247 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b0044e-7564-4344-b8d8-533ee693daab admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:13:56.160936 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-78b0044e-7564-4344-b8d8-533ee693daab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:13:56.184627 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:13:56.222199 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b0044e-7564-4344-b8d8-533ee693daab admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:13:56.226071 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bc8692-6b87-4f39-bbc6-fc12787f71bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b8a09704b9b4ab2bffb813796ec6e77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:13:56.226701 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc8692-6b87-4f39-bbc6-fc12787f71bc service cinder] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:56.226971 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc8692-6b87-4f39-bbc6-fc12787f71bc service cinder] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:56.227239 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc8692-6b87-4f39-bbc6-fc12787f71bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:56.236067 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bc8692-6b87-4f39-bbc6-fc12787f71bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:13:56.237503 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bc8692-6b87-4f39-bbc6-fc12787f71bc service cinder] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:13:56.246097 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1451/2866] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:13:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:14:06.145579 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:14:06.190229 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d49d65-66e8-421f-ada3-ebded0021b48 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:14:06.242329 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=17 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:14:06.255457 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d49d65-66e8-421f-ada3-ebded0021b48 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:14:06.259913 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd85645-b73b-490e-9697-4f9dbc0aeeff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:14:06.260544 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd85645-b73b-490e-9697-4f9dbc0aeeff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:14:06.260826 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd85645-b73b-490e-9697-4f9dbc0aeeff admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:14:06.261101 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd85645-b73b-490e-9697-4f9dbc0aeeff admin admin] PATH_INFO: `/v3/users/cbda37b587684f05a76b2dcc5fd59c19` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:14:06.262272 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd85645-b73b-490e-9697-4f9dbc0aeeff admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbda37b587684f05a76b2dcc5fd59c19)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:14:06.265332 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd85645-b73b-490e-9697-4f9dbc0aeeff admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:14:06.313361 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-1dd85645-b73b-490e-9697-4f9dbc0aeeff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbda37b587684f05a76b2dcc5fd59c19'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:14:06.320840 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-1dd85645-b73b-490e-9697-4f9dbc0aeeff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbda37b587684f05a76b2dcc5fd59c19'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:14:06.321455 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-1dd85645-b73b-490e-9697-4f9dbc0aeeff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbda37b587684f05a76b2dcc5fd59c19'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:14:06.322108 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-1dd85645-b73b-490e-9697-4f9dbc0aeeff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbda37b587684f05a76b2dcc5fd59c19'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:14:06.329639 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-1dd85645-b73b-490e-9697-4f9dbc0aeeff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbda37b587684f05a76b2dcc5fd59c19'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:14:06.346582 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1416/2867] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:14:06 2022] DELETE /identity/v3/users/cbda37b587684f05a76b2dcc5fd59c19 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:14:06.351052 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1105de-098d-4e11-a15f-ad2325874894 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:14:06.351342 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1105de-098d-4e11-a15f-ad2325874894 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:14:06.351613 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1105de-098d-4e11-a15f-ad2325874894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:14:06.370000 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-ec1105de-098d-4e11-a15f-ad2325874894 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:14:06.371193 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-ec1105de-098d-4e11-a15f-ad2325874894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:14:06.430568 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1452/2868] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:14:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:14:06.440990 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd85645-b73b-490e-9697-4f9dbc0aeeff admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:14:06.442460 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-1dd85645-b73b-490e-9697-4f9dbc0aeeff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:14:06.501773 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd85645-b73b-490e-9697-4f9dbc0aeeff admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:14:06.505433 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8723d0a5-6325-4e45-85d7-7c8684a0b4d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:14:06.506074 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8723d0a5-6325-4e45-85d7-7c8684a0b4d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:14:06.506363 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8723d0a5-6325-4e45-85d7-7c8684a0b4d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:14:06.506637 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8723d0a5-6325-4e45-85d7-7c8684a0b4d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:14:06.516053 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8723d0a5-6325-4e45-85d7-7c8684a0b4d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:14:06.517504 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8723d0a5-6325-4e45-85d7-7c8684a0b4d2 service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:14:06.527305 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1417/2869] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:14:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:14:06.800311 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1105de-098d-4e11-a15f-ad2325874894 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:14:06.801801 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-ec1105de-098d-4e11-a15f-ad2325874894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:14:06.814084 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1105de-098d-4e11-a15f-ad2325874894 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:14:06.820112 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cef0831-b918-43d3-8ebf-d264e42ecfac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:14:06.820752 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cef0831-b918-43d3-8ebf-d264e42ecfac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:14:06.821029 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cef0831-b918-43d3-8ebf-d264e42ecfac admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:14:06.821303 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cef0831-b918-43d3-8ebf-d264e42ecfac admin admin] PATH_INFO: `/v3/projects/5a4187c38b3541fca84ffc6ecd8587ad` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:14:06.822685 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cef0831-b918-43d3-8ebf-d264e42ecfac admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a4187c38b3541fca84ffc6ecd8587ad)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:14:06.824737 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cef0831-b918-43d3-8ebf-d264e42ecfac admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:14:06.878509 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-6cef0831-b918-43d3-8ebf-d264e42ecfac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a4187c38b3541fca84ffc6ecd8587ad', 'request_id': 'req-6cef0831-b918-43d3-8ebf-d264e42ecfac'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:14:06.887233 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-6cef0831-b918-43d3-8ebf-d264e42ecfac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a4187c38b3541fca84ffc6ecd8587ad', 'request_id': 'req-6cef0831-b918-43d3-8ebf-d264e42ecfac'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:14:06.893940 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-6cef0831-b918-43d3-8ebf-d264e42ecfac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a4187c38b3541fca84ffc6ecd8587ad', 'request_id': 'req-6cef0831-b918-43d3-8ebf-d264e42ecfac'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:14:06.905463 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-6cef0831-b918-43d3-8ebf-d264e42ecfac admin admin] The token cache is being invalidate because project 5a4187c38b3541fca84ffc6ecd8587ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:14:06.905814 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-6cef0831-b918-43d3-8ebf-d264e42ecfac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:14:06.906499 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-6cef0831-b918-43d3-8ebf-d264e42ecfac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:14:06.908048 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1453/2870] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:14:06 2022] DELETE /identity/v3/projects/5a4187c38b3541fca84ffc6ecd8587ad => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:14:06.913378 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ab385-1d1f-44bb-8522-7e00e8656beb None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:14:06.913745 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ab385-1d1f-44bb-8522-7e00e8656beb None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:14:06.914052 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ab385-1d1f-44bb-8522-7e00e8656beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:14:06.936845 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-e20ab385-1d1f-44bb-8522-7e00e8656beb None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:14:06.938010 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-e20ab385-1d1f-44bb-8522-7e00e8656beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:14:06.955185 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:14:07.001028 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1418/2871] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:14:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:14:07.008987 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a742b9-f00b-4259-8646-c0192bcd1842 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:14:07.009272 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a742b9-f00b-4259-8646-c0192bcd1842 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:14:07.009579 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a742b9-f00b-4259-8646-c0192bcd1842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:14:07.029707 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-59a742b9-f00b-4259-8646-c0192bcd1842 None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:14:07.030928 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-59a742b9-f00b-4259-8646-c0192bcd1842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:14:07.038800 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1454/2872] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:14:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:14:07.043051 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20ab385-1d1f-44bb-8522-7e00e8656beb None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:14:07.053850 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20ab385-1d1f-44bb-8522-7e00e8656beb None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:14:07.058377 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aac743-e789-4184-a552-60bb902e0a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:14:07.058977 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aac743-e789-4184-a552-60bb902e0a8a admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:14:07.059246 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aac743-e789-4184-a552-60bb902e0a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:14:07.059549 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aac743-e789-4184-a552-60bb902e0a8a admin admin] PATH_INFO: `/v3/domains` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:14:07.060305 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aac743-e789-4184-a552-60bb902e0a8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:14:07.060601 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aac743-e789-4184-a552-60bb902e0a8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:14:07.062215 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aac743-e789-4184-a552-60bb902e0a8a admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:14:07.073587 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1419/2873] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Aug 18 11:14:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:14:07.077992 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a742b9-f00b-4259-8646-c0192bcd1842 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:14:07.087257 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a742b9-f00b-4259-8646-c0192bcd1842 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:14:07.092703 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c802c035-96bc-4a29-ae66-45eae1801844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:14:07.093326 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c802c035-96bc-4a29-ae66-45eae1801844 admin admin] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:14:07.093637 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c802c035-96bc-4a29-ae66-45eae1801844 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:14:07.093913 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c802c035-96bc-4a29-ae66-45eae1801844 admin admin] PATH_INFO: `/v3/projects` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:14:07.094553 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c802c035-96bc-4a29-ae66-45eae1801844 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:14:07.096454 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c802c035-96bc-4a29-ae66-45eae1801844 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:14:07.124626 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1455/2874] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 18 11:14:07 2022] POST /identity/v3/projects => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:14:07.129701 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aac743-e789-4184-a552-60bb902e0a8a admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:14:07.140305 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aac743-e789-4184-a552-60bb902e0a8a admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:14:07.197857 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9434ba37-05df-4261-b11d-2bae51ffb119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:14:07.198520 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9434ba37-05df-4261-b11d-2bae51ffb119 admin admin] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:14:07.198633 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9434ba37-05df-4261-b11d-2bae51ffb119 admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:14:07.198907 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9434ba37-05df-4261-b11d-2bae51ffb119 admin admin] PATH_INFO: `/v3/users` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:14:07.199557 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9434ba37-05df-4261-b11d-2bae51ffb119 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:14:07.201504 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9434ba37-05df-4261-b11d-2bae51ffb119 admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:14:07.224391 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1420/2875] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 18 11:14:07 2022] POST /identity/v3/users => generated 291 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 11:14:07.228466 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c802c035-96bc-4a29-ae66-45eae1801844 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:14:07.240091 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c802c035-96bc-4a29-ae66-45eae1801844 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:14:07.245037 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312f7389-4a88-4312-962f-4228c9359e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:14:07.245666 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312f7389-4a88-4312-962f-4228c9359e3c admin admin] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:14:07.245949 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312f7389-4a88-4312-962f-4228c9359e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:14:07.246220 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312f7389-4a88-4312-962f-4228c9359e3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:14:07.247517 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312f7389-4a88-4312-962f-4228c9359e3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:14:07.249550 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312f7389-4a88-4312-962f-4228c9359e3c admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:14:07.259967 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1456/2876] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:14:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:14:07.264431 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9434ba37-05df-4261-b11d-2bae51ffb119 admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:14:07.274543 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9434ba37-05df-4261-b11d-2bae51ffb119 admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:14:07.279971 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1d1c08-4e57-4ec0-a2ba-90302217fd5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:14:07.280561 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d1c08-4e57-4ec0-a2ba-90302217fd5c admin admin] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:14:07.280843 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d1c08-4e57-4ec0-a2ba-90302217fd5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:14:07.281117 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d1c08-4e57-4ec0-a2ba-90302217fd5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:14:07.281818 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1d1c08-4e57-4ec0-a2ba-90302217fd5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:14:07.283448 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1d1c08-4e57-4ec0-a2ba-90302217fd5c admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:14:07.296506 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1421/2877] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 18 11:14:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:14:07.301079 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312f7389-4a88-4312-962f-4228c9359e3c admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:14:07.311647 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312f7389-4a88-4312-962f-4228c9359e3c admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:14:07.316205 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9488647-1960-40c3-a341-0a2cb145e8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:14:07.316862 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9488647-1960-40c3-a341-0a2cb145e8aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:14:07.317135 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9488647-1960-40c3-a341-0a2cb145e8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:14:07.317407 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9488647-1960-40c3-a341-0a2cb145e8aa admin admin] PATH_INFO: `/v3/projects/dcfe3f8963494889a66d9264dc7d50cc/users/a534cf41cb884baea52d1021d2789e8f/roles/719e5c62188d4f8a838987d6e72ca8f7` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:14:07.331952 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9488647-1960-40c3-a341-0a2cb145e8aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcfe3f8963494889a66d9264dc7d50cc, user_id=a534cf41cb884baea52d1021d2789e8f, role_id=719e5c62188d4f8a838987d6e72ca8f7)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:14:07.334602 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9488647-1960-40c3-a341-0a2cb145e8aa admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:14:07.347767 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1457/2878] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 18 11:14:07 2022] PUT /identity/v3/projects/dcfe3f8963494889a66d9264dc7d50cc/users/a534cf41cb884baea52d1021d2789e8f/roles/719e5c62188d4f8a838987d6e72ca8f7 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:14:07.352974 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d9c1c5-a3e7-4bc1-aa80-a11d54001c8b None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:14:07.353304 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d9c1c5-a3e7-4bc1-aa80-a11d54001c8b None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:14:07.353610 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d9c1c5-a3e7-4bc1-aa80-a11d54001c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:14:07.372933 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-e8d9c1c5-a3e7-4bc1-aa80-a11d54001c8b None None] MFA Rules not processed for user `55b16d3a97d74b659d9af679ed207645`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:14:07.374165 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-e8d9c1c5-a3e7-4bc1-aa80-a11d54001c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:14:07.435045 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1422/2879] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:14:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:14:07.444637 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9488647-1960-40c3-a341-0a2cb145e8aa admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:14:07.446317 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-d9488647-1960-40c3-a341-0a2cb145e8aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:14:07.468336 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:14:07.505749 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9488647-1960-40c3-a341-0a2cb145e8aa admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:14:07.509311 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e880387-1b19-41d9-8f87-8eae04bb8bbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:14:07.509939 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e880387-1b19-41d9-8f87-8eae04bb8bbe service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:14:07.510214 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e880387-1b19-41d9-8f87-8eae04bb8bbe service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:14:07.510485 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e880387-1b19-41d9-8f87-8eae04bb8bbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:14:07.519853 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e880387-1b19-41d9-8f87-8eae04bb8bbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:14:07.521262 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e880387-1b19-41d9-8f87-8eae04bb8bbe service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:14:07.531102 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1458/2880] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:14:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:14:08.152629 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9160bc3-1372-46a3-829f-b3811ef1612a None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:14:08.152907 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9160bc3-1372-46a3-829f-b3811ef1612a None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:14:08.153228 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9160bc3-1372-46a3-829f-b3811ef1612a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:14:08.181369 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-f9160bc3-1372-46a3-829f-b3811ef1612a None None] MFA Rules not processed for user `a534cf41cb884baea52d1021d2789e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:14:08.182744 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-f9160bc3-1372-46a3-829f-b3811ef1612a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:14:08.203526 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:14:08.257618 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1423/2881] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:14:08 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:14:08.267929 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e880387-1b19-41d9-8f87-8eae04bb8bbe service neutron] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:14:08.269337 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-7e880387-1b19-41d9-8f87-8eae04bb8bbe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:14:08.330942 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e880387-1b19-41d9-8f87-8eae04bb8bbe service neutron] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:14:08.334540 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f7f048-14bc-4bdd-be99-1a5f06784742 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b8a09704b9b4ab2bffb813796ec6e77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:14:08.335136 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f7f048-14bc-4bdd-be99-1a5f06784742 service cinder] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:14:08.335412 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f7f048-14bc-4bdd-be99-1a5f06784742 service cinder] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:14:08.335801 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f7f048-14bc-4bdd-be99-1a5f06784742 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:14:08.344507 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f7f048-14bc-4bdd-be99-1a5f06784742 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:14:08.345981 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f7f048-14bc-4bdd-be99-1a5f06784742 service cinder] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:14:08.354644 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1459/2882] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:14:08 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:14:09.721876 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db500464-a2cb-4bee-adaf-12fb925b2623 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:14:09.722432 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db500464-a2cb-4bee-adaf-12fb925b2623 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:14:09.722432 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db500464-a2cb-4bee-adaf-12fb925b2623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:14:09.741374 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-db500464-a2cb-4bee-adaf-12fb925b2623 None None] MFA Rules not processed for user `a534cf41cb884baea52d1021d2789e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:14:09.742598 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-db500464-a2cb-4bee-adaf-12fb925b2623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:14:09.750320 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1424/2883] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:14:09 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:14:18.350702 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=43 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:14:19.736053 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=22 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:15:10.929768 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f0bf8-699b-444c-975d-f0583179326c None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:15:10.930566 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f0bf8-699b-444c-975d-f0583179326c None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:15:10.930566 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f0bf8-699b-444c-975d-f0583179326c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:15:10.951327 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-517f0bf8-699b-444c-975d-f0583179326c None None] MFA Rules not processed for user `a534cf41cb884baea52d1021d2789e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:15:10.952546 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-517f0bf8-699b-444c-975d-f0583179326c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:15:10.959618 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1460/2884] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:15:10 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:15:11.201192 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db500464-a2cb-4bee-adaf-12fb925b2623 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:15:11.211266 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db500464-a2cb-4bee-adaf-12fb925b2623 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:15:11.214737 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b78fbb-c2de-4c47-90ca-875feba03b51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:15:11.215336 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b78fbb-c2de-4c47-90ca-875feba03b51 service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:15:11.215619 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b78fbb-c2de-4c47-90ca-875feba03b51 service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:15:11.215894 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b78fbb-c2de-4c47-90ca-875feba03b51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:15:11.217829 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-42b78fbb-c2de-4c47-90ca-875feba03b51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:15:11.227681 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b78fbb-c2de-4c47-90ca-875feba03b51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:15:11.229100 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b78fbb-c2de-4c47-90ca-875feba03b51 service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:15:11.238860 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1425/2885] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:15:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:15:20.945190 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=3 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:15:21.235726 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=6 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:15:38.230677 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b7682-7d23-452c-b87c-3d20709e3580 None None] REQUEST_METHOD: `POST` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:15:38.231253 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b7682-7d23-452c-b87c-3d20709e3580 None None] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:15:38.231394 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b7682-7d23-452c-b87c-3d20709e3580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:15:38.251155 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.auth.core [None req-f98b7682-7d23-452c-b87c-3d20709e3580 None None] MFA Rules not processed for user `d4e3a8a1512c47a19cd3c23f171e24c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:15:38.252382 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-f98b7682-7d23-452c-b87c-3d20709e3580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:15:38.312480 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1461/2886] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:15:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:15:48.304734 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=25 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:15:56.633777 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b78fbb-c2de-4c47-90ca-875feba03b51 service neutron] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:15:56.635241 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-42b78fbb-c2de-4c47-90ca-875feba03b51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:15:56.708843 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b78fbb-c2de-4c47-90ca-875feba03b51 service neutron] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:15:56.713742 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e14f1b6-db8f-4781-9f1d-18137a77be18 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f918bcdd83d4d48be3fff5a48c54929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:15:56.714353 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e14f1b6-db8f-4781-9f1d-18137a77be18 service placement] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:15:56.715232 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e14f1b6-db8f-4781-9f1d-18137a77be18 service placement] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:15:56.715519 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e14f1b6-db8f-4781-9f1d-18137a77be18 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:15:56.717590 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-4e14f1b6-db8f-4781-9f1d-18137a77be18 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:15:56.732419 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e14f1b6-db8f-4781-9f1d-18137a77be18 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:15:56.733920 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e14f1b6-db8f-4781-9f1d-18137a77be18 service placement] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:15:56.744124 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1426/2887] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:15:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:16:04.822617 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98b7682-7d23-452c-b87c-3d20709e3580 None None] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:16:04.824527 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-f98b7682-7d23-452c-b87c-3d20709e3580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:16:04.844194 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98b7682-7d23-452c-b87c-3d20709e3580 None None] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:16:04.853230 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddab7c45-463e-475e-acdc-501f95d25534 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f918bcdd83d4d48be3fff5a48c54929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:16:04.854200 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab7c45-463e-475e-acdc-501f95d25534 service placement] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:16:04.854622 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab7c45-463e-475e-acdc-501f95d25534 service placement] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:16:04.855686 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab7c45-463e-475e-acdc-501f95d25534 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:16:04.858378 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-ddab7c45-463e-475e-acdc-501f95d25534 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:16:04.874845 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddab7c45-463e-475e-acdc-501f95d25534 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:16:04.877391 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddab7c45-463e-475e-acdc-501f95d25534 service placement] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:16:04.892761 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e14f1b6-db8f-4781-9f1d-18137a77be18 service placement] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:16:04.894787 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1462/2888] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:16:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:16:04.905131 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e14f1b6-db8f-4781-9f1d-18137a77be18 service placement] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:16:04.910981 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0813e441-94f8-44ac-9edb-4643b8b31d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:16:04.911809 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813e441-94f8-44ac-9edb-4643b8b31d8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:16:04.912173 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813e441-94f8-44ac-9edb-4643b8b31d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:16:04.912637 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813e441-94f8-44ac-9edb-4643b8b31d8f admin admin] PATH_INFO: `/v3/users/a534cf41cb884baea52d1021d2789e8f` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:16:04.913936 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0813e441-94f8-44ac-9edb-4643b8b31d8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a534cf41cb884baea52d1021d2789e8f)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:16:04.915956 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0813e441-94f8-44ac-9edb-4643b8b31d8f admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:16:04.975172 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-0813e441-94f8-44ac-9edb-4643b8b31d8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a534cf41cb884baea52d1021d2789e8f'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:16:04.983617 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-0813e441-94f8-44ac-9edb-4643b8b31d8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a534cf41cb884baea52d1021d2789e8f'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:16:04.984243 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-0813e441-94f8-44ac-9edb-4643b8b31d8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a534cf41cb884baea52d1021d2789e8f'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:16:04.984857 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-0813e441-94f8-44ac-9edb-4643b8b31d8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a534cf41cb884baea52d1021d2789e8f'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:16:04.991956 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-0813e441-94f8-44ac-9edb-4643b8b31d8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a534cf41cb884baea52d1021d2789e8f'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:16:05.009792 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1427/2889] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:16:04 2022] DELETE /identity/v3/users/a534cf41cb884baea52d1021d2789e8f => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:16:05.189873 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddab7c45-463e-475e-acdc-501f95d25534 service placement] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:16:05.204015 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddab7c45-463e-475e-acdc-501f95d25534 service placement] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:16:05.280819 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c1336c-c2e3-4389-8e90-df04a11cbd83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:16:05.281467 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c1336c-c2e3-4389-8e90-df04a11cbd83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:16:05.281795 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c1336c-c2e3-4389-8e90-df04a11cbd83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:16:05.282067 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c1336c-c2e3-4389-8e90-df04a11cbd83 admin admin] PATH_INFO: `/v3/projects/dcfe3f8963494889a66d9264dc7d50cc` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:16:05.283179 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c1336c-c2e3-4389-8e90-df04a11cbd83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcfe3f8963494889a66d9264dc7d50cc)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:16:05.285066 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c1336c-c2e3-4389-8e90-df04a11cbd83 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:16:05.330702 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-88c1336c-c2e3-4389-8e90-df04a11cbd83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcfe3f8963494889a66d9264dc7d50cc', 'request_id': 'req-88c1336c-c2e3-4389-8e90-df04a11cbd83'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:16:05.337986 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-88c1336c-c2e3-4389-8e90-df04a11cbd83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcfe3f8963494889a66d9264dc7d50cc', 'request_id': 'req-88c1336c-c2e3-4389-8e90-df04a11cbd83'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:16:05.344843 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-88c1336c-c2e3-4389-8e90-df04a11cbd83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcfe3f8963494889a66d9264dc7d50cc', 'request_id': 'req-88c1336c-c2e3-4389-8e90-df04a11cbd83'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:16:05.355640 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-88c1336c-c2e3-4389-8e90-df04a11cbd83 admin admin] The token cache is being invalidate because project dcfe3f8963494889a66d9264dc7d50cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:16:05.355972 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-88c1336c-c2e3-4389-8e90-df04a11cbd83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:16:05.356620 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-88c1336c-c2e3-4389-8e90-df04a11cbd83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:16:05.358173 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1463/2890] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:16:05 2022] DELETE /identity/v3/projects/dcfe3f8963494889a66d9264dc7d50cc => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:16:15.006086 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=61,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:16:15.351806 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=57,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:17:32.890926 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf9a913-ce9c-4c18-86f9-2376a89d7c40 None None] REQUEST_METHOD: `POST` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:17:32.891713 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf9a913-ce9c-4c18-86f9-2376a89d7c40 None None] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:17:32.891713 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf9a913-ce9c-4c18-86f9-2376a89d7c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:17:32.910415 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.auth.core [None req-ebf9a913-ce9c-4c18-86f9-2376a89d7c40 None None] MFA Rules not processed for user `d4e3a8a1512c47a19cd3c23f171e24c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:17:32.911609 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-ebf9a913-ce9c-4c18-86f9-2376a89d7c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:17:32.966953 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1428/2891] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 18 11:17:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:17:42.960168 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=25 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:18:58.128451 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c1336c-c2e3-4389-8e90-df04a11cbd83 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:18:58.131955 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-88c1336c-c2e3-4389-8e90-df04a11cbd83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:18:58.194462 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c1336c-c2e3-4389-8e90-df04a11cbd83 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:18:58.198206 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a4af9a-e4e3-4e6c-ae8f-bfdbbedefd0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:18:58.198811 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a4af9a-e4e3-4e6c-ae8f-bfdbbedefd0e service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:18:58.199091 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a4af9a-e4e3-4e6c-ae8f-bfdbbedefd0e service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:18:58.199367 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a4af9a-e4e3-4e6c-ae8f-bfdbbedefd0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:18:58.201186 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-16a4af9a-e4e3-4e6c-ae8f-bfdbbedefd0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:18:58.211639 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a4af9a-e4e3-4e6c-ae8f-bfdbbedefd0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:18:58.213074 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a4af9a-e4e3-4e6c-ae8f-bfdbbedefd0e service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:18:58.222644 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1464/2892] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:18:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:19:08.217534 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=26 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:19:18.274999 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf9a913-ce9c-4c18-86f9-2376a89d7c40 None None] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:19:18.276492 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-ebf9a913-ce9c-4c18-86f9-2376a89d7c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:19:18.289182 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf9a913-ce9c-4c18-86f9-2376a89d7c40 None None] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:19:18.292811 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36870bca-4ca3-4f48-8b75-d3d1ac9c2279 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:19:18.293413 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36870bca-4ca3-4f48-8b75-d3d1ac9c2279 service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:19:18.293726 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36870bca-4ca3-4f48-8b75-d3d1ac9c2279 service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:19:18.294003 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36870bca-4ca3-4f48-8b75-d3d1ac9c2279 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:19:18.295995 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-36870bca-4ca3-4f48-8b75-d3d1ac9c2279 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:19:18.307772 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36870bca-4ca3-4f48-8b75-d3d1ac9c2279 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:19:18.309198 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36870bca-4ca3-4f48-8b75-d3d1ac9c2279 service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:19:18.319073 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1429/2893] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:19:18 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:19:19.426865 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a4af9a-e4e3-4e6c-ae8f-bfdbbedefd0e service neutron] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:19:19.428731 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-16a4af9a-e4e3-4e6c-ae8f-bfdbbedefd0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:19:19.514288 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a4af9a-e4e3-4e6c-ae8f-bfdbbedefd0e service neutron] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:19:19.520985 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4280ab02-16f3-4b85-93e0-57e6b09555aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a005d8f0c46d44c7b6f2201a54717b12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:19:19.522077 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4280ab02-16f3-4b85-93e0-57e6b09555aa service nova] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:19:19.522424 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4280ab02-16f3-4b85-93e0-57e6b09555aa service nova] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:19:19.522764 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4280ab02-16f3-4b85-93e0-57e6b09555aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:19:19.524732 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-4280ab02-16f3-4b85-93e0-57e6b09555aa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:19:19.538998 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4280ab02-16f3-4b85-93e0-57e6b09555aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:19:19.540854 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4280ab02-16f3-4b85-93e0-57e6b09555aa service nova] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:19:19.559311 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1465/2894] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:19:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:19:19.617441 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36870bca-4ca3-4f48-8b75-d3d1ac9c2279 service neutron] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:19:19.627126 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36870bca-4ca3-4f48-8b75-d3d1ac9c2279 service neutron] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:19:19.631705 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0f80cb-20ed-4e4f-aee7-b1f3bca8d432 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:19:19.632325 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f80cb-20ed-4e4f-aee7-b1f3bca8d432 service neutron] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:19:19.632603 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f80cb-20ed-4e4f-aee7-b1f3bca8d432 service neutron] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:19:19.632875 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f80cb-20ed-4e4f-aee7-b1f3bca8d432 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:19:19.634693 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-ad0f80cb-20ed-4e4f-aee7-b1f3bca8d432 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:19:19.649131 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0f80cb-20ed-4e4f-aee7-b1f3bca8d432 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:19:19.650605 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0f80cb-20ed-4e4f-aee7-b1f3bca8d432 service neutron] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:19:19.663144 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1430/2895] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:19:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:19:20.884294 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4280ab02-16f3-4b85-93e0-57e6b09555aa service nova] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:19:20.894168 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4280ab02-16f3-4b85-93e0-57e6b09555aa service nova] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:19:20.897635 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75561106-8f28-42dc-b45b-14b41f9b6c60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:19:20.898242 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75561106-8f28-42dc-b45b-14b41f9b6c60 service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:19:20.898518 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75561106-8f28-42dc-b45b-14b41f9b6c60 service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:19:20.898785 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75561106-8f28-42dc-b45b-14b41f9b6c60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:19:20.900541 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-75561106-8f28-42dc-b45b-14b41f9b6c60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:19:20.914964 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75561106-8f28-42dc-b45b-14b41f9b6c60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:19:20.916464 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75561106-8f28-42dc-b45b-14b41f9b6c60 service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:19:20.928722 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1466/2896] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:19:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 11:19:21.832984 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0f80cb-20ed-4e4f-aee7-b1f3bca8d432 service neutron] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:19:21.834475 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-ad0f80cb-20ed-4e4f-aee7-b1f3bca8d432 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:19:21.848963 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0f80cb-20ed-4e4f-aee7-b1f3bca8d432 service neutron] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:19:21.856046 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bcee83-9ddf-45a7-b88f-f73ea073038b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a005d8f0c46d44c7b6f2201a54717b12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:19:21.856668 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bcee83-9ddf-45a7-b88f-f73ea073038b service nova] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:19:21.856957 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bcee83-9ddf-45a7-b88f-f73ea073038b service nova] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:19:21.857235 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bcee83-9ddf-45a7-b88f-f73ea073038b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:19:21.859025 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-b2bcee83-9ddf-45a7-b88f-f73ea073038b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:19:21.873865 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bcee83-9ddf-45a7-b88f-f73ea073038b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:19:21.875481 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bcee83-9ddf-45a7-b88f-f73ea073038b service nova] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:19:21.889811 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1431/2897] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:19:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:19:30.923013 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=40 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:19:31.884008 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=18 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:19:32.119406 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75561106-8f28-42dc-b45b-14b41f9b6c60 service neutron] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:19:32.128881 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75561106-8f28-42dc-b45b-14b41f9b6c60 service neutron] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:19:32.132994 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a582c4c8-2b27-48ab-a831-8c8821af97de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c2cd74178f443d9c2398ff8e00cccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:19:32.133689 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a582c4c8-2b27-48ab-a831-8c8821af97de service neutron] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:19:32.133899 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a582c4c8-2b27-48ab-a831-8c8821af97de service neutron] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:19:32.134172 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a582c4c8-2b27-48ab-a831-8c8821af97de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:19:32.136200 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-a582c4c8-2b27-48ab-a831-8c8821af97de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:19:32.200451 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a582c4c8-2b27-48ab-a831-8c8821af97de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:19:32.201864 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a582c4c8-2b27-48ab-a831-8c8821af97de service neutron] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:19:32.212665 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1467/2898] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:19:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:19:35.340416 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bcee83-9ddf-45a7-b88f-f73ea073038b service nova] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:19:35.341900 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-b2bcee83-9ddf-45a7-b88f-f73ea073038b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:19:35.425721 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bcee83-9ddf-45a7-b88f-f73ea073038b service nova] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:19:35.432599 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081c5d3a-a231-4a8c-a1c0-5a56acc2ee0e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f918bcdd83d4d48be3fff5a48c54929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:19:35.433169 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c5d3a-a231-4a8c-a1c0-5a56acc2ee0e service placement] REQUEST_METHOD: `GET` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:19:35.433450 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c5d3a-a231-4a8c-a1c0-5a56acc2ee0e service placement] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:19:35.433757 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c5d3a-a231-4a8c-a1c0-5a56acc2ee0e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:19:35.435689 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-081c5d3a-a231-4a8c-a1c0-5a56acc2ee0e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:19:35.449209 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081c5d3a-a231-4a8c-a1c0-5a56acc2ee0e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:19:35.450887 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081c5d3a-a231-4a8c-a1c0-5a56acc2ee0e service placement] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:19:35.463648 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1432/2899] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:19:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:19:38.626341 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a582c4c8-2b27-48ab-a831-8c8821af97de service neutron] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:19:38.628677 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-a582c4c8-2b27-48ab-a831-8c8821af97de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:19:38.646694 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a582c4c8-2b27-48ab-a831-8c8821af97de service neutron] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:19:38.652601 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c882b4e-4dbd-4573-afe1-e04cb1782143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:19:38.652601 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c882b4e-4dbd-4573-afe1-e04cb1782143 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:19:38.652601 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c882b4e-4dbd-4573-afe1-e04cb1782143 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:19:38.653001 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c882b4e-4dbd-4573-afe1-e04cb1782143 admin admin] PATH_INFO: `/v3/users/d4e3a8a1512c47a19cd3c23f171e24c6` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:19:38.658208 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c882b4e-4dbd-4573-afe1-e04cb1782143 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4e3a8a1512c47a19cd3c23f171e24c6)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:19:38.658208 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c882b4e-4dbd-4573-afe1-e04cb1782143 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:19:38.706673 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-5c882b4e-4dbd-4573-afe1-e04cb1782143 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4e3a8a1512c47a19cd3c23f171e24c6'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:19:38.707372 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-5c882b4e-4dbd-4573-afe1-e04cb1782143 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4e3a8a1512c47a19cd3c23f171e24c6'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:19:38.714124 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-5c882b4e-4dbd-4573-afe1-e04cb1782143 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4e3a8a1512c47a19cd3c23f171e24c6'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:19:38.726554 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-5c882b4e-4dbd-4573-afe1-e04cb1782143 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4e3a8a1512c47a19cd3c23f171e24c6'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:19:38.733931 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-5c882b4e-4dbd-4573-afe1-e04cb1782143 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4e3a8a1512c47a19cd3c23f171e24c6'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:19:38.740479 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1468/2900] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:19:38 2022] DELETE /identity/v3/users/d4e3a8a1512c47a19cd3c23f171e24c6 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:19:38.917826 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081c5d3a-a231-4a8c-a1c0-5a56acc2ee0e service placement] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:19:38.929366 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081c5d3a-a231-4a8c-a1c0-5a56acc2ee0e service placement] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:19:38.990325 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2769a77-a100-45b7-a181-e84a9b973deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:19:38.990983 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2769a77-a100-45b7-a181-e84a9b973deb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:19:38.991265 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2769a77-a100-45b7-a181-e84a9b973deb admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:19:38.991539 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2769a77-a100-45b7-a181-e84a9b973deb admin admin] PATH_INFO: `/v3/projects/4cd8f29717d84b5ebfa176b0040f5778` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:19:38.992681 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2769a77-a100-45b7-a181-e84a9b973deb admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cd8f29717d84b5ebfa176b0040f5778)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:19:38.994615 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2769a77-a100-45b7-a181-e84a9b973deb admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:19:39.042375 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-e2769a77-a100-45b7-a181-e84a9b973deb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cd8f29717d84b5ebfa176b0040f5778', 'request_id': 'req-e2769a77-a100-45b7-a181-e84a9b973deb'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:19:39.050383 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-e2769a77-a100-45b7-a181-e84a9b973deb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cd8f29717d84b5ebfa176b0040f5778', 'request_id': 'req-e2769a77-a100-45b7-a181-e84a9b973deb'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:19:39.056629 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-e2769a77-a100-45b7-a181-e84a9b973deb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cd8f29717d84b5ebfa176b0040f5778', 'request_id': 'req-e2769a77-a100-45b7-a181-e84a9b973deb'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:19:39.066834 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-e2769a77-a100-45b7-a181-e84a9b973deb admin admin] The token cache is being invalidate because project 4cd8f29717d84b5ebfa176b0040f5778 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:19:39.067130 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-e2769a77-a100-45b7-a181-e84a9b973deb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:19:39.067772 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-e2769a77-a100-45b7-a181-e84a9b973deb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:19:39.069268 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1433/2901] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:19:38 2022] DELETE /identity/v3/projects/4cd8f29717d84b5ebfa176b0040f5778 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:19:39.073353 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c882b4e-4dbd-4573-afe1-e04cb1782143 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:19:39.074783 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-5c882b4e-4dbd-4573-afe1-e04cb1782143 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:19:39.088195 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c882b4e-4dbd-4573-afe1-e04cb1782143 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:19:39.145059 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675a182a-5964-443b-9fbc-934b8e60fe96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:19:39.145748 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a182a-5964-443b-9fbc-934b8e60fe96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:19:39.146030 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a182a-5964-443b-9fbc-934b8e60fe96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:19:39.146323 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a182a-5964-443b-9fbc-934b8e60fe96 admin admin] PATH_INFO: `/v3/users/be16774e197f4240a368bb4aa8592918` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:19:39.147487 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675a182a-5964-443b-9fbc-934b8e60fe96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be16774e197f4240a368bb4aa8592918)` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:19:39.149401 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675a182a-5964-443b-9fbc-934b8e60fe96 admin admin] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:19:39.155075 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:19:39.197099 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-675a182a-5964-443b-9fbc-934b8e60fe96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be16774e197f4240a368bb4aa8592918'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:19:39.197692 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-675a182a-5964-443b-9fbc-934b8e60fe96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be16774e197f4240a368bb4aa8592918'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:19:39.204880 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-675a182a-5964-443b-9fbc-934b8e60fe96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be16774e197f4240a368bb4aa8592918'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:19:39.218017 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-675a182a-5964-443b-9fbc-934b8e60fe96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be16774e197f4240a368bb4aa8592918'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:19:39.226729 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.notifications [None req-675a182a-5964-443b-9fbc-934b8e60fe96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be16774e197f4240a368bb4aa8592918'} {{(pid=81433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:19:39.232772 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1469/2902] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 18 11:19:39 2022] DELETE /identity/v3/users/be16774e197f4240a368bb4aa8592918 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:19:39.414711 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2769a77-a100-45b7-a181-e84a9b973deb admin admin] Authenticating user token {{(pid=81432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:19:39.416275 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.fernet_utils [None req-e2769a77-a100-45b7-a181-e84a9b973deb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:19:39.440881 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2769a77-a100-45b7-a181-e84a9b973deb admin admin] Validating token access rules against request {{(pid=81432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:19:39.469311 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:19:39.514757 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b62ee87-a684-4a49-b652-7b0d88c436fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b16d3a97d74b659d9af679ed207645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5400fd95e746d7a23658c890ad84cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:19:39.515398 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b62ee87-a684-4a49-b652-7b0d88c436fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:19:39.515681 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b62ee87-a684-4a49-b652-7b0d88c436fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:19:39.515956 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b62ee87-a684-4a49-b652-7b0d88c436fa admin admin] PATH_INFO: `/v3/projects/aadcb499f7a0408682cc4d3304aef07e` {{(pid=81432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:19:39.517083 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b62ee87-a684-4a49-b652-7b0d88c436fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=aadcb499f7a0408682cc4d3304aef07e)` {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:19:39.520184 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b62ee87-a684-4a49-b652-7b0d88c436fa admin admin] RBAC: Authorization granted {{(pid=81432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:19:39.568335 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-0b62ee87-a684-4a49-b652-7b0d88c436fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aadcb499f7a0408682cc4d3304aef07e', 'request_id': 'req-0b62ee87-a684-4a49-b652-7b0d88c436fa'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:19:39.577259 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-0b62ee87-a684-4a49-b652-7b0d88c436fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aadcb499f7a0408682cc4d3304aef07e', 'request_id': 'req-0b62ee87-a684-4a49-b652-7b0d88c436fa'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:19:39.588484 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-0b62ee87-a684-4a49-b652-7b0d88c436fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aadcb499f7a0408682cc4d3304aef07e', 'request_id': 'req-0b62ee87-a684-4a49-b652-7b0d88c436fa'} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:19:39.600670 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-0b62ee87-a684-4a49-b652-7b0d88c436fa admin admin] The token cache is being invalidate because project aadcb499f7a0408682cc4d3304aef07e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:19:39.600961 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-0b62ee87-a684-4a49-b652-7b0d88c436fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:19:39.601658 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG keystone.notifications [None req-0b62ee87-a684-4a49-b652-7b0d88c436fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:19:39.603137 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: [pid: 81432|app: 0|req: 1434/2903] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 18 11:19:39 2022] DELETE /identity/v3/projects/aadcb499f7a0408682cc4d3304aef07e => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:19:49.229239 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=23,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:19:49.597469 dv-cinder-826608-10-iscsi devstack@keystone.service[81432]: DEBUG dbcounter [-] [81432] Writing DB stats keystone:SELECT=42,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:21:02.363178 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675a182a-5964-443b-9fbc-934b8e60fe96 admin admin] Authenticating user token {{(pid=81433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:21:02.364676 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-675a182a-5964-443b-9fbc-934b8e60fe96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:21:02.522333 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675a182a-5964-443b-9fbc-934b8e60fe96 admin admin] Validating token access rules against request {{(pid=81433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:21:02.583042 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc18a4d-ee28-4ddc-a08e-e41c93b87add service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f918bcdd83d4d48be3fff5a48c54929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1575e8ebaaab4650995841659b6e631b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:21:02.583650 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc18a4d-ee28-4ddc-a08e-e41c93b87add service placement] REQUEST_METHOD: `GET` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:21:02.583928 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc18a4d-ee28-4ddc-a08e-e41c93b87add service placement] SCRIPT_NAME: `/identity` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:21:02.584199 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc18a4d-ee28-4ddc-a08e-e41c93b87add service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:21:02.585964 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.fernet_utils [None req-dfc18a4d-ee28-4ddc-a08e-e41c93b87add service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:21:02.597760 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc18a4d-ee28-4ddc-a08e-e41c93b87add service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:21:02.599329 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc18a4d-ee28-4ddc-a08e-e41c93b87add service placement] RBAC: Authorization granted {{(pid=81433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:21:02.609297 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: [pid: 81433|app: 0|req: 1470/2904] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 18 11:21:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:21:12.605002 dv-cinder-826608-10-iscsi devstack@keystone.service[81433]: DEBUG dbcounter [-] [81433] Writing DB stats keystone:SELECT=89 {{(pid=81433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}